-- Logs begin at Sat 2022-02-12 03:46:13 UTC, end at Sat 2022-02-12 05:21:37 UTC. -- Feb 12 04:15:11.945278 dv-cinder-828060-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Feb 12 04:15:11.953957 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Feb 12 04:15:11.956009 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Feb 12 04:15:11 2022] *** Feb 12 04:15:11.956009 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Feb 12 04:15:11.956009 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Feb 12 04:15:11.956009 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: nodename: dv-cinder-828060-4-iscsi Feb 12 04:15:11.956009 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: machine: x86_64 Feb 12 04:15:11.956009 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: clock source: unix Feb 12 04:15:11.956009 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: pcre jit disabled Feb 12 04:15:11.956009 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: detected number of CPU cores: 4 Feb 12 04:15:11.956009 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: current working directory: / Feb 12 04:15:11.956009 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: detected binary path: /usr/bin/uwsgi-core Feb 12 04:15:11.956009 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: your processes number limit is 47680 Feb 12 04:15:11.956615 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: your memory page size is 4096 bytes Feb 12 04:15:11.956615 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: detected max file descriptor number: 2048 Feb 12 04:15:11.956615 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: lock engine: pthread robust mutexes Feb 12 04:15:11.956615 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: thunder lock: enabled Feb 12 04:15:11.956615 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Feb 12 04:15:11.956615 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: Python version: 3.8.10 (default, Nov 26 2021, 20:14:08) [GCC 9.3.0] Feb 12 04:15:12.001905 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: Python main interpreter initialized at 0x55d9b7f089c0 Feb 12 04:15:12.001905 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: python threads support enabled Feb 12 04:15:12.001905 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: your server socket listen backlog is limited to 100 connections Feb 12 04:15:12.001905 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: your mercy for graceful operations on workers is 90 seconds Feb 12 04:15:12.002261 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: mapped 403077 bytes (393 KB) for 2 cores Feb 12 04:15:12.002337 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: *** Operational MODE: preforking *** Feb 12 04:15:12.002599 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: *** uWSGI is running in multiple interpreter mode *** Feb 12 04:15:12.002599 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: spawned uWSGI master process (pid: 79254) Feb 12 04:15:12.002805 dv-cinder-828060-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Feb 12 04:15:12.003879 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: spawned uWSGI worker 1 (pid: 79266, cores: 1) Feb 12 04:15:12.003879 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: spawned uWSGI worker 2 (pid: 79267, cores: 1) Feb 12 04:15:12.003879 dv-cinder-828060-4-iscsi devstack@keystone.service[79254]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Feb 12 04:15:17.718027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 04:15:17.718027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: from cryptography.utils import int_from_bytes Feb 12 04:15:17.718807 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 04:15:17.718807 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: from cryptography.utils import int_from_bytes Feb 12 04:15:17.719293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 04:15:17.719293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: from cryptography.utils import int_from_bytes Feb 12 04:15:17.719753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 12 04:15:17.719753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: from cryptography.utils import int_from_bytes Feb 12 04:15:17.763335 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 12 04:15:17.763522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 12 04:15:17.763713 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] command line args: [] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 12 04:15:17.763984 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 12 04:15:17.764161 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ================================================================================ {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 12 04:15:17.764237 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 12 04:15:17.764403 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 12 04:15:17.764487 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] admin_token = **** {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.764596 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] command line args: [] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 12 04:15:17.764678 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] config_dir = [] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.764817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.764898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 12 04:15:17.764996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] config_source = [] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.765083 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ================================================================================ {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 12 04:15:17.765160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] debug = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.765272 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] admin_token = **** {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.765354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.765597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] config_dir = [] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.765729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.765834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.765936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] config_source = [] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.766037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.766143 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] debug = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.766247 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.766353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.766471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.766572 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.766672 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] list_limit = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.766781 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.766886 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] log_config_append = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.766981 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.767079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.767079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] log_dir = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.767293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.767393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] log_file = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.767502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] list_limit = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.767615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.767738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] log_config_append = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.767738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.767918 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.768039 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] log_dir = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.768127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.768199 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] log_file = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.768313 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.768390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.768509 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.768584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.768956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.768956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.769148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.769228 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.769303 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.769303 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.769493 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.769607 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.769680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.769797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.769872 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.770035 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.770150 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.770223 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.770334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.770422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.771036 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.771169 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.771416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.771505 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.771505 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.771722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.35/identity {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.771808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] publish_errors = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.771950 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.772029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.772244 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.772375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.772470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.772664 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.772749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.35/identity {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.772886 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.772977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] publish_errors = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.773120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.773196 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] standard_threads = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.773350 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.773516 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.773516 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.773646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.773782 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.773875 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.773946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] use_journal = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.774059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.774139 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] use_json = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.774209 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] standard_threads = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.774283 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] use_stderr = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.774400 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] use_syslog = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.774480 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.774630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.774743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.774821 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.774889 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.774985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] use_journal = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.775105 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.775189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] use_json = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.775359 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] use_stderr = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.775434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.775538 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] use_syslog = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.775615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.775772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 12 04:15:17.775859 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.776030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.776122 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.776270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.776345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.776518 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.776604 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.776759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.776833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.777002 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.777076 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.777240 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.777325 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.777475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.777563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.777722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.777799 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.777957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.778044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.778202 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.778279 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.778446 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.778529 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.778680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.778832 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.778931 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.779014 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.779170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.779263 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.779437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.779522 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.779674 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.779751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.779912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.779988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.780170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.780255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.780421 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.780497 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.780666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.780746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.780892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.780968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.781119 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.781196 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.781349 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.781458 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.781586 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.781673 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.781842 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.781937 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.782088 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.782167 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.782315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.782400 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.782543 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.782621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.782780 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.782862 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.783021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.783099 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.783287 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.783370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.783520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.783598 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.783754 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.783833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.783988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.784064 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.784225 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.784305 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.784453 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.784564 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.784685 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.784762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.784906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.784986 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.785134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.785221 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.785367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.785455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.785597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.785675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.785829 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.785915 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.786059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.786185 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.786855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.787102 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.787318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.787502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.787502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.787794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.787932 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.788039 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.788146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.788292 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.788399 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.788513 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.788657 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.788763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.788869 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.789012 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.789120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.789253 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.789361 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.789466 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.789604 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.789720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.789828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.789960 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.790068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.790173 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.790279 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.790361 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.790469 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.790539 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.790649 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.790726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.790803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.790882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.790953 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.791055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.791055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.791186 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.791270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.791421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.791496 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.791577 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.791725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.791814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.791941 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.792025 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.792180 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.792255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.792416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.792493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.792650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.792734 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.792883 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.792960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.793129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.793218 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.793365 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.793453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.793598 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.793674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.793833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.793915 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.794066 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.794153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.794301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.794386 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.794534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.794617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.794769 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.794845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.795001 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.795085 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.795274 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.795354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.795503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.795580 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.795738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.795854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.795973 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.796056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.796210 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.796285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.796442 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.796520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.796675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.796753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.796908 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.796985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.797141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.797225 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.797369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.797451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.797597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.797676 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.797829 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.797913 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.798057 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.798134 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.798290 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.798376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.798518 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.798595 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.798748 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.798823 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.798982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.799057 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.799211 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.799305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.799474 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.799552 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.799712 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.799789 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.799941 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] auth.external = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.800019 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.800169 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.800245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.800430 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.800505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.800687 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.800764 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.800915 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] auth.password = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.800992 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.801144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] auth.token = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.801231 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] auth.external = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.801376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.801452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.801606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.801686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.801893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.801971 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.802126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.802295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] auth.password = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.802389 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.802606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.802682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] auth.token = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.802836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.802999 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.803075 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] credential.caching = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.803264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.803354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.803524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.803602 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.803763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.803842 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.804009 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.804093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.804251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.804329 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.804484 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.804561 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.804707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] credential.caching = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.804779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.804960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.805038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.805205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.805280 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.805453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.805531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.805694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.805778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.805940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.806024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.806177 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.806256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.806443 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.806520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.806695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.806772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.806930 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] federation.caching = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.807008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.807170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.807261 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.807465 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.807543 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.807977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.808059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.808207 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.808285 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.808453 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.808540 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.808690 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.808768 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.808940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.809022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] federation.caching = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.809176 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.809261 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.809422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.809495 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.809654 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.809736 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.809891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.809975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.810121 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity.caching = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.810197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.810364 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.810446 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.810605 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.810689 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.810840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.810924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.811073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.811151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.811340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.811435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.811572 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.811650 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.811808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.811884 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity.caching = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.812055 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.812139 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.812300 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.812377 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.812530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.812608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.812760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.812845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.812990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.813073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.813228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.813304 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.813468 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.813553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.813710 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.813786 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.813960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.814036 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.814195 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.814280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.814430 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.814515 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.814664 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.814741 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.814911 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.814996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.815137 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.815213 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.815397 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.815476 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.815629 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.815722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.815866 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.815944 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.816106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.816190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.816345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.816434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.816593 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.816670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.816824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.816901 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.817074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.817160 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.817307 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.817424 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.817602 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.817679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.817853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.817940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.818101 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.818177 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.818331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.818408 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.818569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.818649 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.818800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.818878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.819042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.819154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.819297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.819384 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.819537 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.819619 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.819772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.819853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.820007 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.820089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.820246 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.820332 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.820483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.820563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.820710 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.820790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.820937 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.821016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.821182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.821266 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.821423 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.821504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.821654 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.821731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.821888 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.821967 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.822121 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.822208 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.822349 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.822429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.822578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.822656 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.822832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.822913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.823059 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.823140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.823323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.823410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.823571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.823651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.823800 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.823880 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.824033 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.824112 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.824276 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.824393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.824536 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.824615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.824771 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.825005 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.825093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.825256 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.825334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.825505 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.825585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.825743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.825830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.825976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.826056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.826213 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.826300 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.826450 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.826539 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.826697 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.826778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.826929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.827009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.827177 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.827282 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.827443 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.827521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.827680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.827759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.827917 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.828075 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.828152 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.828225 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.828383 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.828464 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.828627 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.828716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.828865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.828945 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.829102 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.829187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.829334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.829421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.829570 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.829648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.829801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.829878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.830034 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.830122 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.830270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.830350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.830514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.830593 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.830746 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.830832 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.830973 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.831051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.831208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.831309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.831468 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.831560 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] resource.caching = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.831709 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.831788 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.831951 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.832028 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.832188 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.832277 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.832418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.832497 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.832658 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.832737 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.832893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.833484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] resource.caching = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.833675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.833813 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.833945 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.834083 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.834227 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.834335 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.834412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.834482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] role.caching = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.834624 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.834704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] role.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.834864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.834945 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.835113 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.835193 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.835392 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.835473 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.835636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.835718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.835876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] role.caching = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.835955 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.836120 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.836205 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] role.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.836353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.836433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.836597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.836675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.836845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.836937 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.837075 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.837156 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.837319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.837398 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.837566 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.837643 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.837807 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.837886 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.838051 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.838130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.838304 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.838440 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.838527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.838676 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.838777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.838924 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.839018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.839174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.839325 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.839444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.839526 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.839692 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.839901 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.839981 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.840140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.840220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.840392 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.840471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.840638 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.840729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.840871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.840951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.841102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.841182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.841333 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.841422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.841583 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.841664 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.841838 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.841917 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.842079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.842166 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.842312 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.842391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.842545 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.842622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.842773 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.842859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.843008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] token.caching = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.843088 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.843275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.843376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.843524 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.843621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.843760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.843841 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.843998 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.844077 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.844233 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.844322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.844466 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.844545 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] token.caching = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.844702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.844781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.844941 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.845029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.845177 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.845256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.845410 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.845489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.845646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.845735 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.845879 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.845959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.846123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.846203 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.846370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.846457 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.846611 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.846689 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.846850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.846929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.847091 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.847179 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.847351 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.847432 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.connection = **** {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.847601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.847690 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.847851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.847932 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.848083 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.848164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.848325 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.848405 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.848563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.849259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.849425 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.849507 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.connection = **** {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.849672 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.849794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.849962 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.850107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.850240 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.850367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.850505 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.850633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.850761 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.850888 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.851016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.851144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.851312 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.851437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.851565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.851706 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.851706 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.851945 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.852086 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.852214 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.852341 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.852467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.852593 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.852720 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.852856 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79266) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 12 04:15:17.852984 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.852984 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.852984 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.853348 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.853348 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.853595 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 12 04:15:17.853721 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 12 04:15:17.884175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:17.884398 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:17.884623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:17.884730 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:17.884859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:17.885091 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:17.893232 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:17.893784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:17.921879 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:17.922104 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:17.923680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:17.923919 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.010349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.010521 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.062752 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.062916 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.062989 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.063065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.128307 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.128534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.128648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.128760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.128880 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.128989 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.129103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.129206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.129322 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.129423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.129540 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.129755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.155275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.155508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.155736 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.155960 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.156168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.156377 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.156585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.156667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.156819 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.157045 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.157270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.157488 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.157702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.157914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.168008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.168335 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.180614 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.180847 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.181066 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.181149 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.181285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.181369 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.181503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.181585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.181714 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.181797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.181923 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79266) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.182006 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.182132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.182346 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79267) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Feb 12 04:15:18.199792 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.199995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 12 04:15:18.200111 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.200320 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 12 04:15:18.200402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.200518 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 12 04:15:18.200651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.200783 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.200864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Feb 12 04:15:18.201037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.201117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.201288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.201377 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.201538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.201619 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.201827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.212604 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.212876 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.212972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.213246 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.213327 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.213567 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.213671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.213952 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.221559 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.221900 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.224827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.225105 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.225198 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.225383 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.225466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.225660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.225741 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.225937 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.226020 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.226194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.226275 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.226459 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.226558 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.226727 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.226808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.226991 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.227070 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.227283 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.227418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.227554 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.227638 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.227917 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.253539 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.253806 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.255845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.255989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.256121 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.256235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.261442 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.261553 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.261673 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.261758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.261946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.262029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.269121 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.269215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.269397 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.269478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.273958 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.274068 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.274266 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.274348 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.274516 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.274587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.276848 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.277030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.277030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.277147 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.277216 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.277278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.277278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.277395 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.277455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.277519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.294819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.294924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.295084 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.295165 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.299688 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.299820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.303823 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.303947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.304118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.304238 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.309348 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.309456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.312892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.313005 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.316488 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.316599 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.316781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.316891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.317059 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.317167 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.317376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.317495 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.317699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.317782 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.318101 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.318201 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.337373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.337469 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.337658 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.337740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.337920 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.338002 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.338178 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.338260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.346001 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.346091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.347689 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.347775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.347960 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.348041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.351533 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.351645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.351809 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.351892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.352078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.352159 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.352351 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.352443 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.352631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.352714 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.365855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.365949 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.366128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.366211 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.366402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.366485 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.366686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.366777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.366961 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.367051 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.367254 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.367338 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.367520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.367602 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.385202 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.385391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.388546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.388739 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.391808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.391999 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.393384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.393567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.394979 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.395148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.395275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.395959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.396144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.396418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.403381 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.403795 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.406168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.406600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.409345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.409630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.409789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.409909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.410076 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.410191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.410354 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.410627 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.419688 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.419971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.420246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.420339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.420573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.420849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.527892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79266) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.528102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.528379 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.528547 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79267) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Feb 12 04:15:18.528701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.528843 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.528926 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.529118 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.529209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.529386 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.529468 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.529652 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.529732 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.529918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.530000 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.530192 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.530271 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.530452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.530540 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.530714 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.530794 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.530972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.531053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.531263 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79266) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.531361 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.531512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.531770 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.532030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79267) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Feb 12 04:15:18.569771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d9b7f089c0 pid: 79266 (default app) Feb 12 04:15:18.570631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d9b7f089c0 pid: 79267 (default app) Feb 12 04:15:18.573038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998827e-a0eb-4ce8-9639-538e775aced0 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:18.573324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998827e-a0eb-4ce8-9639-538e775aced0 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:18.573595 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998827e-a0eb-4ce8-9639-538e775aced0 None None] PATH_INFO: `/v3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:18.578024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1/1] 10.222.0.35 () {50 vars in 791 bytes} [Sat Feb 12 04:15:18 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:27.567612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50c470-372f-46da-bd10-2f5cbbdc0c68 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:27.568167 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50c470-372f-46da-bd10-2f5cbbdc0c68 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:27.568167 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50c470-372f-46da-bd10-2f5cbbdc0c68 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:27.573343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1/2] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:15:27.578445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c1e7-cf3e-49e6-b79a-0c9a6ccb62b1 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:27.578841 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c1e7-cf3e-49e6-b79a-0c9a6ccb62b1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:27.578991 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7c1e7-cf3e-49e6-b79a-0c9a6ccb62b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:27.609595 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG oslo_db.sqlalchemy.engines [None req-bca7c1e7-cf3e-49e6-b79a-0c9a6ccb62b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79266) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:15:27.792880 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG passlib.handlers.bcrypt [None req-bca7c1e7-cf3e-49e6-b79a-0c9a6ccb62b1 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79266) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 12 04:15:27.793305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG passlib.handlers.bcrypt [None req-bca7c1e7-cf3e-49e6-b79a-0c9a6ccb62b1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79266) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 12 04:15:27.848626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-bca7c1e7-cf3e-49e6-b79a-0c9a6ccb62b1 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:27.850156 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-bca7c1e7-cf3e-49e6-b79a-0c9a6ccb62b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:27.970706 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 2/3] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:28.153051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50c470-372f-46da-bd10-2f5cbbdc0c68 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:28.186247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG oslo_db.sqlalchemy.engines [None req-3a50c470-372f-46da-bd10-2f5cbbdc0c68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 12 04:15:28.313751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50c470-372f-46da-bd10-2f5cbbdc0c68 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:28.318693 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b6ec1-0987-4fda-a42d-58fc920ea435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:28.319372 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b6ec1-0987-4fda-a42d-58fc920ea435 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:28.319653 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b6ec1-0987-4fda-a42d-58fc920ea435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:28.319924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b6ec1-0987-4fda-a42d-58fc920ea435 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:28.328099 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b6ec1-0987-4fda-a42d-58fc920ea435 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:28.379060 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b38b6ec1-0987-4fda-a42d-58fc920ea435 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 12 04:15:28.380094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b6ec1-0987-4fda-a42d-58fc920ea435 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:28.389230 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 2/4] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:15:28.395279 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7c1e7-cf3e-49e6-b79a-0c9a6ccb62b1 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:28.409330 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7c1e7-cf3e-49e6-b79a-0c9a6ccb62b1 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:28.421498 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1a514-7478-49dc-af69-d64f3c46e50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:28.422596 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1a514-7478-49dc-af69-d64f3c46e50f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:28.422882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1a514-7478-49dc-af69-d64f3c46e50f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:28.423160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1a514-7478-49dc-af69-d64f3c46e50f admin admin] PATH_INFO: `/v3/projects/b029942a00eb466b8575ae912b6910ac` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:28.424710 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1a514-7478-49dc-af69-d64f3c46e50f admin admin] RBAC: Authorizing `identity:get_project(project_id=b029942a00eb466b8575ae912b6910ac)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:28.476935 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.common.rbac_enforcer.enforcer [None req-bfc1a514-7478-49dc-af69-d64f3c46e50f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Feb 12 04:15:28.477274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1a514-7478-49dc-af69-d64f3c46e50f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:28.481920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 3/5] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:28 2022] GET /identity/v3/projects/b029942a00eb466b8575ae912b6910ac => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:30.670549 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66d9a3-115d-49a5-b4f8-77d70edb3ff1 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:30.671047 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66d9a3-115d-49a5-b4f8-77d70edb3ff1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:30.671144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66d9a3-115d-49a5-b4f8-77d70edb3ff1 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:30.675666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 3/6] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:30.681828 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1700e85-0e91-43f6-a256-3c73958ba5ce None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:30.682470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1700e85-0e91-43f6-a256-3c73958ba5ce None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:30.682644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1700e85-0e91-43f6-a256-3c73958ba5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:30.701999 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-d1700e85-0e91-43f6-a256-3c73958ba5ce None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:30.703544 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d1700e85-0e91-43f6-a256-3c73958ba5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:30.711513 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 4/7] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:30.734189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66d9a3-115d-49a5-b4f8-77d70edb3ff1 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:30.746656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66d9a3-115d-49a5-b4f8-77d70edb3ff1 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:30.750826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7553bd-92a1-44bb-b7a3-cb505d291a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:30.751491 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7553bd-92a1-44bb-b7a3-cb505d291a61 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:30.751778 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7553bd-92a1-44bb-b7a3-cb505d291a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:30.752053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7553bd-92a1-44bb-b7a3-cb505d291a61 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:30.759624 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7553bd-92a1-44bb-b7a3-cb505d291a61 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:30.761377 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7553bd-92a1-44bb-b7a3-cb505d291a61 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:30.769861 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 4/8] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:15:30.775125 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1700e85-0e91-43f6-a256-3c73958ba5ce None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:30.783955 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1700e85-0e91-43f6-a256-3c73958ba5ce None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:30.788951 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf942a0-278e-4387-89eb-5bceded9de55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:30.789782 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf942a0-278e-4387-89eb-5bceded9de55 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:30.790065 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf942a0-278e-4387-89eb-5bceded9de55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:30.790338 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf942a0-278e-4387-89eb-5bceded9de55 admin admin] PATH_INFO: `/v3/users/0d198e449ccb450a97886efab230ca66` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:30.791753 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf942a0-278e-4387-89eb-5bceded9de55 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d198e449ccb450a97886efab230ca66)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:30.793597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf942a0-278e-4387-89eb-5bceded9de55 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:30.795110 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 5/9] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:30 2022] GET /identity/v3/users/0d198e449ccb450a97886efab230ca66 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:33.053438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d14f9a-f4b0-4354-906a-62bd3ea006e8 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:33.053969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d14f9a-f4b0-4354-906a-62bd3ea006e8 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:33.053969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d14f9a-f4b0-4354-906a-62bd3ea006e8 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:33.055740 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 5/10] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:33.061114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2208435-e521-496b-ad03-7bf4cc7203cb None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:33.061510 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2208435-e521-496b-ad03-7bf4cc7203cb None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:33.061795 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2208435-e521-496b-ad03-7bf4cc7203cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:33.079812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-b2208435-e521-496b-ad03-7bf4cc7203cb None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:33.081008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b2208435-e521-496b-ad03-7bf4cc7203cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:33.085292 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0139198-3a1f-4209-86fc-955be106ed8c None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:33.085580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0139198-3a1f-4209-86fc-955be106ed8c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:33.085857 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0139198-3a1f-4209-86fc-955be106ed8c None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:33.087606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 6/11] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:15:33.089850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 6/12] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:33.092679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866ddb3-2647-4caa-a83b-de45d7a17728 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:33.092962 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866ddb3-2647-4caa-a83b-de45d7a17728 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:33.093241 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866ddb3-2647-4caa-a83b-de45d7a17728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:33.112691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2208435-e521-496b-ad03-7bf4cc7203cb None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:33.121895 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2208435-e521-496b-ad03-7bf4cc7203cb None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:33.126294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b04377-e056-4b52-9368-24155c9d2d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:33.127069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b04377-e056-4b52-9368-24155c9d2d06 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:33.127393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b04377-e056-4b52-9368-24155c9d2d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:33.127674 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b04377-e056-4b52-9368-24155c9d2d06 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:33.135059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG passlib.handlers.bcrypt [None req-1866ddb3-2647-4caa-a83b-de45d7a17728 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79267) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Feb 12 04:15:33.135530 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG passlib.handlers.bcrypt [None req-1866ddb3-2647-4caa-a83b-de45d7a17728 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79267) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Feb 12 04:15:33.141313 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b04377-e056-4b52-9368-24155c9d2d06 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:33.148964 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-45b04377-e056-4b52-9368-24155c9d2d06 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:15:33.150351 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 7/13] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:15:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:15:33.155621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b04377-e056-4b52-9368-24155c9d2d06 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:33.164785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b04377-e056-4b52-9368-24155c9d2d06 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:33.169185 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0cd91-12eb-49f4-a5b0-ec9abcf10c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:33.169774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0cd91-12eb-49f4-a5b0-ec9abcf10c88 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:33.170056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0cd91-12eb-49f4-a5b0-ec9abcf10c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:33.170329 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d0cd91-12eb-49f4-a5b0-ec9abcf10c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:33.171082 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0cd91-12eb-49f4-a5b0-ec9abcf10c88 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:33.171416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0cd91-12eb-49f4-a5b0-ec9abcf10c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:33.173184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-95d0cd91-12eb-49f4-a5b0-ec9abcf10c88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:33.173184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:15:33.173184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:15:33.174081 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d0cd91-12eb-49f4-a5b0-ec9abcf10c88 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:33.182622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-1866ddb3-2647-4caa-a83b-de45d7a17728 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:33.184235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-1866ddb3-2647-4caa-a83b-de45d7a17728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:33.187087 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 8/14] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:33.192680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0cd91-12eb-49f4-a5b0-ec9abcf10c88 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:33.202278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d0cd91-12eb-49f4-a5b0-ec9abcf10c88 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:33.206595 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1b441-9ff2-4ca5-b223-6de7bfbb2c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:33.206813 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 7/15] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:33.207572 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1b441-9ff2-4ca5-b223-6de7bfbb2c5b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:33.207916 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1b441-9ff2-4ca5-b223-6de7bfbb2c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:33.208231 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1b441-9ff2-4ca5-b223-6de7bfbb2c5b admin admin] PATH_INFO: `/v3/users/0d198e449ccb450a97886efab230ca66` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:33.209728 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1b441-9ff2-4ca5-b223-6de7bfbb2c5b admin admin] RBAC: Authorizing `identity:get_user(user_id=0d198e449ccb450a97886efab230ca66)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:33.211594 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1b441-9ff2-4ca5-b223-6de7bfbb2c5b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:33.213124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 9/16] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:33 2022] GET /identity/v3/users/0d198e449ccb450a97886efab230ca66 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:33.218055 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866ddb3-2647-4caa-a83b-de45d7a17728 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:33.227875 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866ddb3-2647-4caa-a83b-de45d7a17728 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:33.229927 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1b441-9ff2-4ca5-b223-6de7bfbb2c5b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:33.232483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f14b8-84a2-465a-9455-9ef7f342f0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:33.233588 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f14b8-84a2-465a-9455-9ef7f342f0ba admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:33.233874 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f14b8-84a2-465a-9455-9ef7f342f0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:33.234147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f14b8-84a2-465a-9455-9ef7f342f0ba admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:33.235651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f14b8-84a2-465a-9455-9ef7f342f0ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:33.237402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35f14b8-84a2-465a-9455-9ef7f342f0ba admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:33.239588 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 8/17] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:15:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:33.240509 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1b441-9ff2-4ca5-b223-6de7bfbb2c5b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:33.244816 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f14b8-84a2-465a-9455-9ef7f342f0ba admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:33.245058 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3d098-4042-4788-a740-12e665f1bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:33.245693 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3d098-4042-4788-a740-12e665f1bff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:33.245977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3d098-4042-4788-a740-12e665f1bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:33.246254 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3d098-4042-4788-a740-12e665f1bff4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:33.254100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3d098-4042-4788-a740-12e665f1bff4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:33.254918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f14b8-84a2-465a-9455-9ef7f342f0ba admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:33.256545 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e3d098-4042-4788-a740-12e665f1bff4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:33.259333 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ccbb0-3fdc-4c4b-b09b-099a6076b592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:33.259933 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ccbb0-3fdc-4c4b-b09b-099a6076b592 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:33.260223 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ccbb0-3fdc-4c4b-b09b-099a6076b592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:33.260494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ccbb0-3fdc-4c4b-b09b-099a6076b592 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:33.261316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ccbb0-3fdc-4c4b-b09b-099a6076b592 admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.domain.id=default, user.id=0d198e449ccb450a97886efab230ca66) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:33.261617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ccbb0-3fdc-4c4b-b09b-099a6076b592 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:33.263319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-748ccbb0-3fdc-4c4b-b09b-099a6076b592 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:33.263319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:15:33.263319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:15:33.264455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ccbb0-3fdc-4c4b-b09b-099a6076b592 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:33.265439 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 10/18] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 04:15:33.271240 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3d098-4042-4788-a740-12e665f1bff4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:33.273875 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 9/19] 10.222.0.35 () {56 vars in 1343 bytes} [Sat Feb 12 04:15:33 2022] GET /identity/v3/role_assignments?user.id=0d198e449ccb450a97886efab230ca66&scope.domain.id=default&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:33.279995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e3d098-4042-4788-a740-12e665f1bff4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:33.284627 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaea6f-3d09-429e-88cf-a1aca12f7654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:33.285440 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaea6f-3d09-429e-88cf-a1aca12f7654 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:33.285811 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaea6f-3d09-429e-88cf-a1aca12f7654 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:33.286102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaea6f-3d09-429e-88cf-a1aca12f7654 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:33.287472 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbaea6f-3d09-429e-88cf-a1aca12f7654 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:33.289426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbaea6f-3d09-429e-88cf-a1aca12f7654 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:33.291119 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 11/20] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:15:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:35.811687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2f3a3-ee78-4f5e-8db0-1c1d018b3fb7 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:35.812216 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2f3a3-ee78-4f5e-8db0-1c1d018b3fb7 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:35.812216 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2f3a3-ee78-4f5e-8db0-1c1d018b3fb7 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:35.814248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 10/21] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:35.820138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbf92c-3c15-4279-a03a-1802f508af38 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:35.821043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbf92c-3c15-4279-a03a-1802f508af38 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:35.821516 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdbf92c-3c15-4279-a03a-1802f508af38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:35.840695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-abdbf92c-3c15-4279-a03a-1802f508af38 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:35.842216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-abdbf92c-3c15-4279-a03a-1802f508af38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:35.857385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 12/22] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:15:35.892325 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2f3a3-ee78-4f5e-8db0-1c1d018b3fb7 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:35.910054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2f3a3-ee78-4f5e-8db0-1c1d018b3fb7 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:35.914583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2e23c-65d6-47d7-9b1a-ca6732d16ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:35.914873 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206bef2-ad40-464b-b86a-ea8d32cc1967 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:35.915126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206bef2-ad40-464b-b86a-ea8d32cc1967 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:35.915428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206bef2-ad40-464b-b86a-ea8d32cc1967 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:35.915524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2e23c-65d6-47d7-9b1a-ca6732d16ffa admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:35.915710 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2e23c-65d6-47d7-9b1a-ca6732d16ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:35.915987 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d2e23c-65d6-47d7-9b1a-ca6732d16ffa admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:35.917836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 13/23] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:15:35.924899 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f681a-1f32-45c7-a4d9-d2c73c23dba0 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:35.925467 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f681a-1f32-45c7-a4d9-d2c73c23dba0 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:35.925944 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1f681a-1f32-45c7-a4d9-d2c73c23dba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:35.933160 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d2e23c-65d6-47d7-9b1a-ca6732d16ffa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:35.940302 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-f2d2e23c-65d6-47d7-9b1a-ca6732d16ffa admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:15:35.942278 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 11/24] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:15:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:15:35.947883 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2e23c-65d6-47d7-9b1a-ca6732d16ffa admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:35.956249 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-8c1f681a-1f32-45c7-a4d9-d2c73c23dba0 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:35.957809 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-8c1f681a-1f32-45c7-a4d9-d2c73c23dba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:35.958266 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d2e23c-65d6-47d7-9b1a-ca6732d16ffa admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:35.975127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 14/25] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:15:35.975914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8db33-5f2a-459a-b194-b52a55242131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:35.976662 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8db33-5f2a-459a-b194-b52a55242131 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:35.976946 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8db33-5f2a-459a-b194-b52a55242131 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:35.977225 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8db33-5f2a-459a-b194-b52a55242131 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:35.978008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8db33-5f2a-459a-b194-b52a55242131 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:35.978311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8db33-5f2a-459a-b194-b52a55242131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:35.979344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-79d8db33-5f2a-459a-b194-b52a55242131 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:35.979344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:15:35.979344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:15:35.980268 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8db33-5f2a-459a-b194-b52a55242131 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:35.999740 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 12/26] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:36.005857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f681a-1f32-45c7-a4d9-d2c73c23dba0 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:36.015086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8db33-5f2a-459a-b194-b52a55242131 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:36.020996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1f681a-1f32-45c7-a4d9-d2c73c23dba0 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:36.026803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8db33-5f2a-459a-b194-b52a55242131 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:36.031782 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465175a7-d2a9-45cc-bd68-7d026ddd0150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:36.032877 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465175a7-d2a9-45cc-bd68-7d026ddd0150 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:36.033410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465175a7-d2a9-45cc-bd68-7d026ddd0150 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:36.033771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf316d5a-1233-48a6-a345-c42add9f4619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:36.034078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465175a7-d2a9-45cc-bd68-7d026ddd0150 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:36.034775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf316d5a-1233-48a6-a345-c42add9f4619 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:36.035258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf316d5a-1233-48a6-a345-c42add9f4619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:36.035705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf316d5a-1233-48a6-a345-c42add9f4619 admin admin] PATH_INFO: `/v3/users/0d198e449ccb450a97886efab230ca66` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:36.039963 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf316d5a-1233-48a6-a345-c42add9f4619 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d198e449ccb450a97886efab230ca66)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:36.042027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf316d5a-1233-48a6-a345-c42add9f4619 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:36.044199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 15/27] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:36 2022] GET /identity/v3/users/0d198e449ccb450a97886efab230ca66 => generated 247 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:36.059820 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465175a7-d2a9-45cc-bd68-7d026ddd0150 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:36.061073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf316d5a-1233-48a6-a345-c42add9f4619 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:36.061521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465175a7-d2a9-45cc-bd68-7d026ddd0150 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:36.077509 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf316d5a-1233-48a6-a345-c42add9f4619 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:36.080228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-465175a7-d2a9-45cc-bd68-7d026ddd0150 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:15:36.081984 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 13/28] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:15:36.087641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465175a7-d2a9-45cc-bd68-7d026ddd0150 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:36.090439 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b4853-36ed-409e-8d51-8b1f36aacbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:36.091527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4853-36ed-409e-8d51-8b1f36aacbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:36.092163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4853-36ed-409e-8d51-8b1f36aacbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:36.092636 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b4853-36ed-409e-8d51-8b1f36aacbe8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:36.095958 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b4853-36ed-409e-8d51-8b1f36aacbe8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:36.098397 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575b4853-36ed-409e-8d51-8b1f36aacbe8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:36.100565 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 16/29] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:15:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:36.103710 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465175a7-d2a9-45cc-bd68-7d026ddd0150 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:36.108214 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3f2cc-5f02-4b2c-b590-72a73b1c1603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:36.108870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3f2cc-5f02-4b2c-b590-72a73b1c1603 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:36.109153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3f2cc-5f02-4b2c-b590-72a73b1c1603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:36.109432 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3f2cc-5f02-4b2c-b590-72a73b1c1603 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:36.110167 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3f2cc-5f02-4b2c-b590-72a73b1c1603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:36.110468 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3f2cc-5f02-4b2c-b590-72a73b1c1603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:36.111487 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-65c3f2cc-5f02-4b2c-b590-72a73b1c1603 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:36.111487 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:15:36.111487 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:15:36.112387 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3f2cc-5f02-4b2c-b590-72a73b1c1603 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:36.119616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b4853-36ed-409e-8d51-8b1f36aacbe8 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:36.134808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b4853-36ed-409e-8d51-8b1f36aacbe8 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:36.147846 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 14/30] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:36.153281 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3f2cc-5f02-4b2c-b590-72a73b1c1603 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:36.154152 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3d56b1-59b7-4804-9e1a-de1e828d9f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:36.155302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d56b1-59b7-4804-9e1a-de1e828d9f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:36.155781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d56b1-59b7-4804-9e1a-de1e828d9f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:36.156254 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3d56b1-59b7-4804-9e1a-de1e828d9f1d admin admin] PATH_INFO: `/v3/domains/default/users/0d198e449ccb450a97886efab230ca66/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:36.163931 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3f2cc-5f02-4b2c-b590-72a73b1c1603 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:36.165104 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d56b1-59b7-4804-9e1a-de1e828d9f1d admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0d198e449ccb450a97886efab230ca66, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:36.166374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-6a3d56b1-59b7-4804-9e1a-de1e828d9f1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:36.166374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:15:36.166374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:15:36.168919 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3d56b1-59b7-4804-9e1a-de1e828d9f1d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:36.174992 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a986e9-fce5-4a10-a1c8-6f97c6e18786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:36.175673 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a986e9-fce5-4a10-a1c8-6f97c6e18786 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:36.175957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a986e9-fce5-4a10-a1c8-6f97c6e18786 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:36.176291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a986e9-fce5-4a10-a1c8-6f97c6e18786 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:36.177038 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a986e9-fce5-4a10-a1c8-6f97c6e18786 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:36.178563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-03a986e9-fce5-4a10-a1c8-6f97c6e18786 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:36.178563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:15:36.178563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:15:36.179777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a986e9-fce5-4a10-a1c8-6f97c6e18786 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:36.451880 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 17/31] 10.222.0.35 () {58 vars in 1382 bytes} [Sat Feb 12 04:15:36 2022] PUT /identity/v3/domains/default/users/0d198e449ccb450a97886efab230ca66/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:15:36.509046 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 15/32] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Feb 12 04:15:36 2022] POST /identity/v3/projects => generated 301 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:15:36.596010 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5c33-8340-4156-bdb4-0f7ee9e57363 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:36.596662 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5c33-8340-4156-bdb4-0f7ee9e57363 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:36.597141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b5c33-8340-4156-bdb4-0f7ee9e57363 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:36.602519 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 18/33] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:36.608989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a9c75-5ba2-4ac3-9d43-827c7f3edf3b None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:36.609270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a9c75-5ba2-4ac3-9d43-827c7f3edf3b None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:36.609712 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a9c75-5ba2-4ac3-9d43-827c7f3edf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:36.632843 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-339a9c75-5ba2-4ac3-9d43-827c7f3edf3b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:36.634650 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-339a9c75-5ba2-4ac3-9d43-827c7f3edf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:36.654562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a3880-58b9-4250-999c-a45d0a0f26e8 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:36.655198 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a3880-58b9-4250-999c-a45d0a0f26e8 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:36.655740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a3880-58b9-4250-999c-a45d0a0f26e8 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:36.657852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 19/34] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:15:36.668386 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b396709-d8a2-473b-85ac-ed69ae2e64bf None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:36.669242 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b396709-d8a2-473b-85ac-ed69ae2e64bf None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:36.669720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b396709-d8a2-473b-85ac-ed69ae2e64bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:36.712492 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1b396709-d8a2-473b-85ac-ed69ae2e64bf None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:36.714453 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1b396709-d8a2-473b-85ac-ed69ae2e64bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:36.730204 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 20/35] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Feb 12 04:15:36.730684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 16/36] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:36.757568 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a9c75-5ba2-4ac3-9d43-827c7f3edf3b None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:36.767700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a9c75-5ba2-4ac3-9d43-827c7f3edf3b None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:36.777149 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c291e4-de06-42cf-bf02-b2f4de41129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:36.778089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c291e4-de06-42cf-bf02-b2f4de41129d admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:36.778596 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c291e4-de06-42cf-bf02-b2f4de41129d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:36.779026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c291e4-de06-42cf-bf02-b2f4de41129d admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:36.780039 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c291e4-de06-42cf-bf02-b2f4de41129d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:36.781419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-59c291e4-de06-42cf-bf02-b2f4de41129d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:36.781419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:15:36.781419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:15:36.782698 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c291e4-de06-42cf-bf02-b2f4de41129d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:36.792134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b396709-d8a2-473b-85ac-ed69ae2e64bf None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:36.804671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b396709-d8a2-473b-85ac-ed69ae2e64bf None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:36.810341 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52701dfb-dec1-4605-8de2-f10934a5df23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:36.810341 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52701dfb-dec1-4605-8de2-f10934a5df23 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:36.810550 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52701dfb-dec1-4605-8de2-f10934a5df23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:36.814885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52701dfb-dec1-4605-8de2-f10934a5df23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:36.814885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52701dfb-dec1-4605-8de2-f10934a5df23 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:36.814885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-52701dfb-dec1-4605-8de2-f10934a5df23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:36.814885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:15:36.814885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:15:36.814885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52701dfb-dec1-4605-8de2-f10934a5df23 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:36.892992 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 17/37] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:15:36 2022] POST /identity/v3/roles => generated 225 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:15:36.921812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 21/38] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:15:36 2022] POST /identity/v3/roles => generated 219 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:15:37.450285 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c28a7-871e-45d2-b88d-b374b6d400a2 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:37.450672 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c28a7-871e-45d2-b88d-b374b6d400a2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:37.450851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c28a7-871e-45d2-b88d-b374b6d400a2 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:37.452689 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 18/39] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:37.458585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012daeb-f503-41f9-af03-c7b584b006aa None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:37.458869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012daeb-f503-41f9-af03-c7b584b006aa None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:37.459145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5012daeb-f503-41f9-af03-c7b584b006aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:37.476554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-5012daeb-f503-41f9-af03-c7b584b006aa None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:37.477747 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5012daeb-f503-41f9-af03-c7b584b006aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:37.485403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 22/40] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:37.507631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c28a7-871e-45d2-b88d-b374b6d400a2 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:37.519482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c28a7-871e-45d2-b88d-b374b6d400a2 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:37.524391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8bf04-43ae-41af-9302-3b54b71322fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:37.525041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8bf04-43ae-41af-9302-3b54b71322fe admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:37.525322 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8bf04-43ae-41af-9302-3b54b71322fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:37.525595 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf8bf04-43ae-41af-9302-3b54b71322fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:37.526366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8bf04-43ae-41af-9302-3b54b71322fe admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:37.528014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf8bf04-43ae-41af-9302-3b54b71322fe admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:37.570419 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f8fd9-6229-4dc2-bbb8-2e2216ca6605 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:37.570632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f8fd9-6229-4dc2-bbb8-2e2216ca6605 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:37.570912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f8fd9-6229-4dc2-bbb8-2e2216ca6605 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:37.572743 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 23/41] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:15:37.577639 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdb6c3-f023-4f46-b018-7c3584d44913 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:37.577926 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdb6c3-f023-4f46-b018-7c3584d44913 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:37.578206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdb6c3-f023-4f46-b018-7c3584d44913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:37.594942 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 19/42] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:15:37 2022] POST /identity/v3/roles => generated 223 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:15:37.600647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-80fdb6c3-f023-4f46-b018-7c3584d44913 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:37.602063 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-80fdb6c3-f023-4f46-b018-7c3584d44913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:37.610369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 24/43] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:15:37.634500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8bf04-43ae-41af-9302-3b54b71322fe admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:37.645813 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf8bf04-43ae-41af-9302-3b54b71322fe admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:37.650606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc77aee-18ae-48a5-8941-7a07899ecf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:37.651615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc77aee-18ae-48a5-8941-7a07899ecf54 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:37.651907 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc77aee-18ae-48a5-8941-7a07899ecf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:37.652188 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc77aee-18ae-48a5-8941-7a07899ecf54 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:37.653587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc77aee-18ae-48a5-8941-7a07899ecf54 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:37.655458 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc77aee-18ae-48a5-8941-7a07899ecf54 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:37.657492 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 20/44] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:15:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:37.663168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdb6c3-f023-4f46-b018-7c3584d44913 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:37.673054 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdb6c3-f023-4f46-b018-7c3584d44913 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:37.677967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1141e-7165-4208-8c7e-27a5c9d6332e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:37.678647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1141e-7165-4208-8c7e-27a5c9d6332e admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:37.678931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1141e-7165-4208-8c7e-27a5c9d6332e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:37.679208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1141e-7165-4208-8c7e-27a5c9d6332e admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:37.679992 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1141e-7165-4208-8c7e-27a5c9d6332e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:37.681034 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-d1b1141e-7165-4208-8c7e-27a5c9d6332e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:37.681034 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:15:37.681034 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:15:37.682529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1141e-7165-4208-8c7e-27a5c9d6332e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:37.779112 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 25/45] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Feb 12 04:15:37 2022] POST /identity/v3/projects => generated 312 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:15:38.933238 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e1cc0-392d-4511-9585-fc4f115c176a None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:38.933796 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e1cc0-392d-4511-9585-fc4f115c176a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:38.933796 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e1cc0-392d-4511-9585-fc4f115c176a None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:38.935680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 21/46] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:38.940909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5268a-7fe8-414a-a54d-7c13411a5d0b None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:38.941321 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5268a-7fe8-414a-a54d-7c13411a5d0b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:38.942002 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5268a-7fe8-414a-a54d-7c13411a5d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:38.960122 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-3ef5268a-7fe8-414a-a54d-7c13411a5d0b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:38.961323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3ef5268a-7fe8-414a-a54d-7c13411a5d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:39.016178 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 26/47] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:39.039923 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e1cc0-392d-4511-9585-fc4f115c176a None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:39.051699 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e1cc0-392d-4511-9585-fc4f115c176a None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:39.055853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a692b-4fd8-46d6-986d-51582096bc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:39.056611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a692b-4fd8-46d6-986d-51582096bc2d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:39.056891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a692b-4fd8-46d6-986d-51582096bc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:39.057417 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a692b-4fd8-46d6-986d-51582096bc2d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:39.067696 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a692b-4fd8-46d6-986d-51582096bc2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:39.074344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-550a692b-4fd8-46d6-986d-51582096bc2d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:15:39.075496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 22/48] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:15:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:15:39.080793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5268a-7fe8-414a-a54d-7c13411a5d0b None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:39.090727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5268a-7fe8-414a-a54d-7c13411a5d0b None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:39.095330 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220aa02f-df71-4fbb-8493-453174fc6493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:39.095973 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220aa02f-df71-4fbb-8493-453174fc6493 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:39.096251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220aa02f-df71-4fbb-8493-453174fc6493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:39.096522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220aa02f-df71-4fbb-8493-453174fc6493 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:39.097278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220aa02f-df71-4fbb-8493-453174fc6493 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:39.097579 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220aa02f-df71-4fbb-8493-453174fc6493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:39.099219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220aa02f-df71-4fbb-8493-453174fc6493 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:39.111209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 27/49] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:39.112254 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a692b-4fd8-46d6-986d-51582096bc2d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:39.122018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a692b-4fd8-46d6-986d-51582096bc2d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:39.126324 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47ac2d-c8b3-4070-a835-04cc528193a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:39.127145 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47ac2d-c8b3-4070-a835-04cc528193a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:39.127463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47ac2d-c8b3-4070-a835-04cc528193a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:39.127738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47ac2d-c8b3-4070-a835-04cc528193a5 admin admin] PATH_INFO: `/v3/users/0d198e449ccb450a97886efab230ca66` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:39.129653 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47ac2d-c8b3-4070-a835-04cc528193a5 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d198e449ccb450a97886efab230ca66)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:39.131478 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47ac2d-c8b3-4070-a835-04cc528193a5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:39.133010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 23/50] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:39 2022] GET /identity/v3/users/0d198e449ccb450a97886efab230ca66 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:39.137897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220aa02f-df71-4fbb-8493-453174fc6493 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:39.147792 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220aa02f-df71-4fbb-8493-453174fc6493 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:39.152056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9011ba-c838-4274-8660-b7fc3f97643b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:39.152803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9011ba-c838-4274-8660-b7fc3f97643b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:39.153084 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9011ba-c838-4274-8660-b7fc3f97643b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:39.153359 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9011ba-c838-4274-8660-b7fc3f97643b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:39.154532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9011ba-c838-4274-8660-b7fc3f97643b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:39.156220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9011ba-c838-4274-8660-b7fc3f97643b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:39.157727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 28/51] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:15:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:39.162725 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47ac2d-c8b3-4070-a835-04cc528193a5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:39.171900 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47ac2d-c8b3-4070-a835-04cc528193a5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:39.176270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c39015-a7b0-4efd-96c8-1b2a87057e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:39.176874 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c39015-a7b0-4efd-96c8-1b2a87057e8c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:39.177156 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c39015-a7b0-4efd-96c8-1b2a87057e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:39.177428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c39015-a7b0-4efd-96c8-1b2a87057e8c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:39.178258 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c39015-a7b0-4efd-96c8-1b2a87057e8c admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.domain.id=default, user.id=0d198e449ccb450a97886efab230ca66) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:39.178563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c39015-a7b0-4efd-96c8-1b2a87057e8c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:39.180386 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c39015-a7b0-4efd-96c8-1b2a87057e8c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:39.186356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 24/52] 10.222.0.35 () {56 vars in 1343 bytes} [Sat Feb 12 04:15:39 2022] GET /identity/v3/role_assignments?user.id=0d198e449ccb450a97886efab230ca66&scope.domain.id=default&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 530 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:40.004922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a8462-e274-4959-9836-befd531151f3 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:40.005437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a8462-e274-4959-9836-befd531151f3 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:40.005521 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a8462-e274-4959-9836-befd531151f3 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:40.007269 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 29/53] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:40.012352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a0ae9-8aa8-4e57-a1d9-d9dd0f044b89 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:40.012722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a0ae9-8aa8-4e57-a1d9-d9dd0f044b89 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:40.012910 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a0ae9-8aa8-4e57-a1d9-d9dd0f044b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:40.031015 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-084a0ae9-8aa8-4e57-a1d9-d9dd0f044b89 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:40.032245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-084a0ae9-8aa8-4e57-a1d9-d9dd0f044b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:40.039832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 25/54] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:40.063287 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a8462-e274-4959-9836-befd531151f3 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:40.075917 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a8462-e274-4959-9836-befd531151f3 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:40.080149 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283084c-13ac-4128-9531-ab8ca9226956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:40.080910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283084c-13ac-4128-9531-ab8ca9226956 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:40.081194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283084c-13ac-4128-9531-ab8ca9226956 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:40.081468 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283084c-13ac-4128-9531-ab8ca9226956 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:40.082721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283084c-13ac-4128-9531-ab8ca9226956 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:40.084456 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283084c-13ac-4128-9531-ab8ca9226956 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:40.085999 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 30/55] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:15:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:40.091065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a0ae9-8aa8-4e57-a1d9-d9dd0f044b89 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:40.099759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a0ae9-8aa8-4e57-a1d9-d9dd0f044b89 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:40.104093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7aec5-2fc5-4c27-a090-08dd7713c018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:40.104750 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7aec5-2fc5-4c27-a090-08dd7713c018 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:40.105033 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7aec5-2fc5-4c27-a090-08dd7713c018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:40.105307 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7aec5-2fc5-4c27-a090-08dd7713c018 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:40.106026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7aec5-2fc5-4c27-a090-08dd7713c018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:40.107965 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e7aec5-2fc5-4c27-a090-08dd7713c018 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:40.195421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 26/56] 10.222.0.35 () {60 vars in 1161 bytes} [Sat Feb 12 04:15:40 2022] POST /identity/v3/projects => generated 298 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:15:42.404367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92786e-755f-4a7c-8cfe-7ba0557af1e1 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:42.404889 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92786e-755f-4a7c-8cfe-7ba0557af1e1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:42.404976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92786e-755f-4a7c-8cfe-7ba0557af1e1 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:42.406684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 31/57] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:42.412128 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad97ce-c6be-4f3f-b847-ffe27973daa5 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:42.412544 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad97ce-c6be-4f3f-b847-ffe27973daa5 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:42.412684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ad97ce-c6be-4f3f-b847-ffe27973daa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:42.430465 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-97ad97ce-c6be-4f3f-b847-ffe27973daa5 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:42.431680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-97ad97ce-c6be-4f3f-b847-ffe27973daa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:42.485925 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 27/58] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:42.510795 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92786e-755f-4a7c-8cfe-7ba0557af1e1 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:42.523553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92786e-755f-4a7c-8cfe-7ba0557af1e1 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:42.528017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8ccdbc-7ed6-465e-bf23-45eb1ec4c735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:42.528835 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ccdbc-7ed6-465e-bf23-45eb1ec4c735 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:42.529067 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ccdbc-7ed6-465e-bf23-45eb1ec4c735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:42.529343 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ccdbc-7ed6-465e-bf23-45eb1ec4c735 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:42.530578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ccdbc-7ed6-465e-bf23-45eb1ec4c735 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:42.532341 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8ccdbc-7ed6-465e-bf23-45eb1ec4c735 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:42.535817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 32/59] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:15:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:42.539661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad97ce-c6be-4f3f-b847-ffe27973daa5 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:42.548412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ad97ce-c6be-4f3f-b847-ffe27973daa5 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:42.552867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40464e0-5997-4b91-8a5b-3b2990394a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:42.553514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40464e0-5997-4b91-8a5b-3b2990394a42 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:42.553797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40464e0-5997-4b91-8a5b-3b2990394a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:42.554073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40464e0-5997-4b91-8a5b-3b2990394a42 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:42.554803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40464e0-5997-4b91-8a5b-3b2990394a42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:42.555864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-b40464e0-5997-4b91-8a5b-3b2990394a42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:42.555864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:15:42.555864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:15:42.557329 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40464e0-5997-4b91-8a5b-3b2990394a42 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:42.731160 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 28/60] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:15:42 2022] POST /identity/v3/users => generated 275 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:15:45.977422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda549d-16de-464e-a0a1-23c2e1a344e8 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:45.978458 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda549d-16de-464e-a0a1-23c2e1a344e8 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:45.978944 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda549d-16de-464e-a0a1-23c2e1a344e8 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:45.981218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 33/61] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:45.987269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b714c7-86fe-4985-aaee-9ce04a694288 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:45.988092 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b714c7-86fe-4985-aaee-9ce04a694288 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:45.989137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b714c7-86fe-4985-aaee-9ce04a694288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.015583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-a2b714c7-86fe-4985-aaee-9ce04a694288 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:46.017120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a2b714c7-86fe-4985-aaee-9ce04a694288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:46.031346 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 29/62] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:15:46.069334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda549d-16de-464e-a0a1-23c2e1a344e8 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.088440 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda549d-16de-464e-a0a1-23c2e1a344e8 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.093345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b51e94-c673-4e82-bb24-23a49fb18629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.094369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b51e94-c673-4e82-bb24-23a49fb18629 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.094851 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b51e94-c673-4e82-bb24-23a49fb18629 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.095427 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b51e94-c673-4e82-bb24-23a49fb18629 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.109816 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b51e94-c673-4e82-bb24-23a49fb18629 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:46.123249 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-48b51e94-c673-4e82-bb24-23a49fb18629 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:15:46.124843 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 34/63] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:15:46.131314 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b714c7-86fe-4985-aaee-9ce04a694288 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.140714 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b714c7-86fe-4985-aaee-9ce04a694288 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.151482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cd0d7-89c5-4b1f-aba3-c1ca7b714957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.152422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd0d7-89c5-4b1f-aba3-c1ca7b714957 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.152907 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd0d7-89c5-4b1f-aba3-c1ca7b714957 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.153380 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7cd0d7-89c5-4b1f-aba3-c1ca7b714957 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.154366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cd0d7-89c5-4b1f-aba3-c1ca7b714957 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:46.154891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cd0d7-89c5-4b1f-aba3-c1ca7b714957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.156772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7cd0d7-89c5-4b1f-aba3-c1ca7b714957 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.170790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 30/64] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:46.176912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b51e94-c673-4e82-bb24-23a49fb18629 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.188324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b51e94-c673-4e82-bb24-23a49fb18629 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.199709 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a262119-5785-42e1-b3a0-c1b46e7847af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.200852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a262119-5785-42e1-b3a0-c1b46e7847af admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.201331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a262119-5785-42e1-b3a0-c1b46e7847af admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.201822 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a262119-5785-42e1-b3a0-c1b46e7847af admin admin] PATH_INFO: `/v3/users/07fc48f86c42414a9ed416bfe9660e3f` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.224008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a262119-5785-42e1-b3a0-c1b46e7847af admin admin] RBAC: Authorizing `identity:get_user(user_id=07fc48f86c42414a9ed416bfe9660e3f)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.226540 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a262119-5785-42e1-b3a0-c1b46e7847af admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.228583 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 35/65] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/users/07fc48f86c42414a9ed416bfe9660e3f => generated 275 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:46.239512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cd0d7-89c5-4b1f-aba3-c1ca7b714957 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.252138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7cd0d7-89c5-4b1f-aba3-c1ca7b714957 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.261902 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bceabc-5a8f-47a5-a023-643302be5cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.262896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bceabc-5a8f-47a5-a023-643302be5cfe admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.263407 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bceabc-5a8f-47a5-a023-643302be5cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.263970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bceabc-5a8f-47a5-a023-643302be5cfe admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.280604 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bceabc-5a8f-47a5-a023-643302be5cfe admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.282666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bceabc-5a8f-47a5-a023-643302be5cfe admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.297457 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 31/66] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:15:46.303907 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a262119-5785-42e1-b3a0-c1b46e7847af admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.315054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827eb8f-98d2-4b2e-8244-b9589ed493d0 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.317904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a262119-5785-42e1-b3a0-c1b46e7847af admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.318434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827eb8f-98d2-4b2e-8244-b9589ed493d0 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.318914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827eb8f-98d2-4b2e-8244-b9589ed493d0 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.320974 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 32/67] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:46.328840 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5388c-62da-43ba-a3a3-1507d97c036a None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.329293 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc65d3f-621e-44a4-b99c-e50a5e2e3f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.329468 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5388c-62da-43ba-a3a3-1507d97c036a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.329845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe5388c-62da-43ba-a3a3-1507d97c036a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.330599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65d3f-621e-44a4-b99c-e50a5e2e3f05 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.331023 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65d3f-621e-44a4-b99c-e50a5e2e3f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.331464 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65d3f-621e-44a4-b99c-e50a5e2e3f05 admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.333321 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc65d3f-621e-44a4-b99c-e50a5e2e3f05 admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.336175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc65d3f-621e-44a4-b99c-e50a5e2e3f05 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.339129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 36/68] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:46.349616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc65d3f-621e-44a4-b99c-e50a5e2e3f05 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.361829 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-1fe5388c-62da-43ba-a3a3-1507d97c036a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:46.366021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc65d3f-621e-44a4-b99c-e50a5e2e3f05 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.367287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-1fe5388c-62da-43ba-a3a3-1507d97c036a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:46.374778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc46229-d3a6-4932-8296-5439d1278435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.375696 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc46229-d3a6-4932-8296-5439d1278435 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.376199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc46229-d3a6-4932-8296-5439d1278435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.376685 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc46229-d3a6-4932-8296-5439d1278435 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.377734 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc46229-d3a6-4932-8296-5439d1278435 admin admin] RBAC: Adding query filter params (role.id=ca6edcc85e3841d9bebb1b58cecb96d3, scope.project.id=f4779a5fd09a4c01853830d4bee9d75e, user.id=07fc48f86c42414a9ed416bfe9660e3f) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:46.379409 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc46229-d3a6-4932-8296-5439d1278435 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.381985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-1cc46229-d3a6-4932-8296-5439d1278435 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:46.381985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:15:46.381985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:15:46.389126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc46229-d3a6-4932-8296-5439d1278435 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.389195 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 33/69] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:46.393088 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 37/70] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/role_assignments?user.id=07fc48f86c42414a9ed416bfe9660e3f&scope.project.id=f4779a5fd09a4c01853830d4bee9d75e&role.id=ca6edcc85e3841d9bebb1b58cecb96d3 => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:46.412328 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5388c-62da-43ba-a3a3-1507d97c036a None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.424645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe5388c-62da-43ba-a3a3-1507d97c036a None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.440091 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7fc84-77c0-4544-997c-42a30474f991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.441176 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7fc84-77c0-4544-997c-42a30474f991 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.441736 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7fc84-77c0-4544-997c-42a30474f991 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.442154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7fc84-77c0-4544-997c-42a30474f991 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.457564 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7fc84-77c0-4544-997c-42a30474f991 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:46.465182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-f8a7fc84-77c0-4544-997c-42a30474f991 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 04:15:46.466591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 34/71] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:15:46.471921 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177c33f-e944-468e-954b-d997946e8488 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.473264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177c33f-e944-468e-954b-d997946e8488 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.473772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b177c33f-e944-468e-954b-d997946e8488 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.476091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 38/72] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:46.480939 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7fc84-77c0-4544-997c-42a30474f991 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.482670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73194cdc-c298-48f0-979b-84653238f540 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.482966 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73194cdc-c298-48f0-979b-84653238f540 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.483278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73194cdc-c298-48f0-979b-84653238f540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.493538 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7fc84-77c0-4544-997c-42a30474f991 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.504880 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-73194cdc-c298-48f0-979b-84653238f540 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:46.506578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-73194cdc-c298-48f0-979b-84653238f540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:46.506723 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bd69e-34fd-461e-b29b-bbba12a7d833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.507448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bd69e-34fd-461e-b29b-bbba12a7d833 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.507735 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bd69e-34fd-461e-b29b-bbba12a7d833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.508017 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bd69e-34fd-461e-b29b-bbba12a7d833 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.508807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bd69e-34fd-461e-b29b-bbba12a7d833 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:46.509113 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bd69e-34fd-461e-b29b-bbba12a7d833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.510743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784bd69e-34fd-461e-b29b-bbba12a7d833 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.522070 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 35/73] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:46.528247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bd69e-34fd-461e-b29b-bbba12a7d833 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.533658 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 39/74] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:15:46.547256 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784bd69e-34fd-461e-b29b-bbba12a7d833 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.558301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd15f8-7fde-4888-bdd1-394597b48608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.558820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73194cdc-c298-48f0-979b-84653238f540 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.559201 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd15f8-7fde-4888-bdd1-394597b48608 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.559562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd15f8-7fde-4888-bdd1-394597b48608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.559850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd15f8-7fde-4888-bdd1-394597b48608 admin admin] PATH_INFO: `/v3/users/07fc48f86c42414a9ed416bfe9660e3f` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.564114 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd15f8-7fde-4888-bdd1-394597b48608 admin admin] RBAC: Authorizing `identity:get_user(user_id=07fc48f86c42414a9ed416bfe9660e3f)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.566960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd15f8-7fde-4888-bdd1-394597b48608 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.568977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 36/75] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/users/07fc48f86c42414a9ed416bfe9660e3f => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:46.569099 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73194cdc-c298-48f0-979b-84653238f540 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.574762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd15f8-7fde-4888-bdd1-394597b48608 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.587019 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d6e81-7bb9-4dd6-b31c-491c8a4b6783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.587872 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d6e81-7bb9-4dd6-b31c-491c8a4b6783 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.588392 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d6e81-7bb9-4dd6-b31c-491c8a4b6783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.588871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d6e81-7bb9-4dd6-b31c-491c8a4b6783 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.589950 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd15f8-7fde-4888-bdd1-394597b48608 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.600833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ab47b-4f53-4d6c-bb81-2fe49782a1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.601825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ab47b-4f53-4d6c-bb81-2fe49782a1cb admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.602302 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ab47b-4f53-4d6c-bb81-2fe49782a1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.602763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ab47b-4f53-4d6c-bb81-2fe49782a1cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.612222 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ab47b-4f53-4d6c-bb81-2fe49782a1cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.615206 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54ab47b-4f53-4d6c-bb81-2fe49782a1cb admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.616374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d6e81-7bb9-4dd6-b31c-491c8a4b6783 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:46.623657 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-648d6e81-7bb9-4dd6-b31c-491c8a4b6783 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:15:46.625204 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 40/76] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:15:46.627315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 37/77] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 04:15:46.632332 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ab47b-4f53-4d6c-bb81-2fe49782a1cb admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.639738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d6e81-7bb9-4dd6-b31c-491c8a4b6783 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.643599 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54ab47b-4f53-4d6c-bb81-2fe49782a1cb admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.648935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2d5d2-899f-4128-bcab-78d3c1f70014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.649828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2d5d2-899f-4128-bcab-78d3c1f70014 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.650412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2d5d2-899f-4128-bcab-78d3c1f70014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.650859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2d5d2-899f-4128-bcab-78d3c1f70014 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.651822 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2d5d2-899f-4128-bcab-78d3c1f70014 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:46.652356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2d5d2-899f-4128-bcab-78d3c1f70014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.652987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d6e81-7bb9-4dd6-b31c-491c8a4b6783 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.654431 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa2d5d2-899f-4128-bcab-78d3c1f70014 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.657915 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a715-4337-4f57-ba2e-2b039138461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.659014 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a715-4337-4f57-ba2e-2b039138461c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.659479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a715-4337-4f57-ba2e-2b039138461c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.659945 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a715-4337-4f57-ba2e-2b039138461c admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.661434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66a715-4337-4f57-ba2e-2b039138461c admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.663699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66a715-4337-4f57-ba2e-2b039138461c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.665095 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 38/78] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:46.665913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 41/79] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:46.666636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a65ac-c76b-4413-9c74-0b9e8efde693 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.666924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a65ac-c76b-4413-9c74-0b9e8efde693 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.671266 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a65ac-c76b-4413-9c74-0b9e8efde693 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.671266 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 39/80] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:46.672314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a715-4337-4f57-ba2e-2b039138461c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.673962 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a65ac-c76b-4413-9c74-0b9e8efde693 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.687323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a715-4337-4f57-ba2e-2b039138461c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.687642 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a65ac-c76b-4413-9c74-0b9e8efde693 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.692568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e7f50d-0040-4e32-b641-b481163f79b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.693603 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7f50d-0040-4e32-b641-b481163f79b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.693791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb3eed-26e7-42dd-9c2d-cec2cebf6fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.694214 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7f50d-0040-4e32-b641-b481163f79b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.694636 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e7f50d-0040-4e32-b641-b481163f79b1 admin admin] PATH_INFO: `/v3/users/0d198e449ccb450a97886efab230ca66` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.694741 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb3eed-26e7-42dd-9c2d-cec2cebf6fac admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.695218 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb3eed-26e7-42dd-9c2d-cec2cebf6fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.695596 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eb3eed-26e7-42dd-9c2d-cec2cebf6fac admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.696496 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7f50d-0040-4e32-b641-b481163f79b1 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d198e449ccb450a97886efab230ca66)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.696703 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb3eed-26e7-42dd-9c2d-cec2cebf6fac admin admin] RBAC: Adding query filter params (role.id=b9252c31847f4513a49cd10bb4f9cdaa, scope.project.id=f4779a5fd09a4c01853830d4bee9d75e, user.id=07fc48f86c42414a9ed416bfe9660e3f) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:46.697093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb3eed-26e7-42dd-9c2d-cec2cebf6fac admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.698818 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e7f50d-0040-4e32-b641-b481163f79b1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.699188 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eb3eed-26e7-42dd-9c2d-cec2cebf6fac admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.700848 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 42/81] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/users/0d198e449ccb450a97886efab230ca66 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:46.702169 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c6200-3cc6-4d71-9c0c-9ccd0950a197 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.702627 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c6200-3cc6-4d71-9c0c-9ccd0950a197 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.702911 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c6200-3cc6-4d71-9c0c-9ccd0950a197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.706370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 40/82] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/role_assignments?user.id=07fc48f86c42414a9ed416bfe9660e3f&scope.project.id=f4779a5fd09a4c01853830d4bee9d75e&role.id=b9252c31847f4513a49cd10bb4f9cdaa => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:46.708146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb3eed-26e7-42dd-9c2d-cec2cebf6fac admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.718560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eb3eed-26e7-42dd-9c2d-cec2cebf6fac admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.723884 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd290da-c937-4c81-8139-75c61f908154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.724770 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd290da-c937-4c81-8139-75c61f908154 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.725270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd290da-c937-4c81-8139-75c61f908154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.725750 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd290da-c937-4c81-8139-75c61f908154 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.738215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd290da-c937-4c81-8139-75c61f908154 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.738215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd290da-c937-4c81-8139-75c61f908154 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.740402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-ec6c6200-3cc6-4d71-9c0c-9ccd0950a197 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:46.741682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ec6c6200-3cc6-4d71-9c0c-9ccd0950a197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:46.749586 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 41/83] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:15:46.763265 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd290da-c937-4c81-8139-75c61f908154 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.768331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 43/84] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:46.775023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd290da-c937-4c81-8139-75c61f908154 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.780053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67afe4a9-bc25-42bd-83ef-1d12435dad67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.781164 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afe4a9-bc25-42bd-83ef-1d12435dad67 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.781682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afe4a9-bc25-42bd-83ef-1d12435dad67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.782139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67afe4a9-bc25-42bd-83ef-1d12435dad67 admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.783711 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afe4a9-bc25-42bd-83ef-1d12435dad67 admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.786105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67afe4a9-bc25-42bd-83ef-1d12435dad67 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.793465 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 42/85] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:46.795123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c6200-3cc6-4d71-9c0c-9ccd0950a197 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.807163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42418-f399-4a47-b0e5-964c015f5146 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.807482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42418-f399-4a47-b0e5-964c015f5146 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.807764 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a42418-f399-4a47-b0e5-964c015f5146 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.809788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 43/86] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:46.810774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c6200-3cc6-4d71-9c0c-9ccd0950a197 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.812145 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a42418-f399-4a47-b0e5-964c015f5146 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.819252 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66467e-70f5-48f5-aaa4-50a15ef48623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.819938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66467e-70f5-48f5-aaa4-50a15ef48623 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.820227 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66467e-70f5-48f5-aaa4-50a15ef48623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.820774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66467e-70f5-48f5-aaa4-50a15ef48623 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.822371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66467e-70f5-48f5-aaa4-50a15ef48623 admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=f4779a5fd09a4c01853830d4bee9d75e, user.id=0d198e449ccb450a97886efab230ca66) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:46.822705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66467e-70f5-48f5-aaa4-50a15ef48623 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.825144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66467e-70f5-48f5-aaa4-50a15ef48623 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.826723 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a42418-f399-4a47-b0e5-964c015f5146 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.832324 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0061eed-a785-4f02-af15-0ffc572add66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.832582 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 44/87] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/role_assignments?user.id=0d198e449ccb450a97886efab230ca66&scope.project.id=f4779a5fd09a4c01853830d4bee9d75e&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:46.833412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0061eed-a785-4f02-af15-0ffc572add66 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.833690 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0061eed-a785-4f02-af15-0ffc572add66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.833952 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0061eed-a785-4f02-af15-0ffc572add66 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.840241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053a623-bd06-4528-869b-bf64a97cea09 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.840546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053a623-bd06-4528-869b-bf64a97cea09 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.840789 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053a623-bd06-4528-869b-bf64a97cea09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.843169 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0061eed-a785-4f02-af15-0ffc572add66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.845059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0061eed-a785-4f02-af15-0ffc572add66 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.848473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 44/88] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:46.855266 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0061eed-a785-4f02-af15-0ffc572add66 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.867131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-2053a623-bd06-4528-869b-bf64a97cea09 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:46.868402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2053a623-bd06-4528-869b-bf64a97cea09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:46.875514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0061eed-a785-4f02-af15-0ffc572add66 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.877913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 45/89] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:46.888399 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7687940-73a9-44b7-809d-044e0978e106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.889078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7687940-73a9-44b7-809d-044e0978e106 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.889360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7687940-73a9-44b7-809d-044e0978e106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.889633 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7687940-73a9-44b7-809d-044e0978e106 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.890376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7687940-73a9-44b7-809d-044e0978e106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.892473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7687940-73a9-44b7-809d-044e0978e106 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.902907 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053a623-bd06-4528-869b-bf64a97cea09 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.915005 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053a623-bd06-4528-869b-bf64a97cea09 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.920370 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb401929-c5ab-458e-8082-5f99bf9917f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.927876 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb401929-c5ab-458e-8082-5f99bf9917f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.927876 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb401929-c5ab-458e-8082-5f99bf9917f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.927876 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb401929-c5ab-458e-8082-5f99bf9917f2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.936986 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb401929-c5ab-458e-8082-5f99bf9917f2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:46.944937 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-fb401929-c5ab-458e-8082-5f99bf9917f2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:15:46.946538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 46/90] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:15:46.952560 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb401929-c5ab-458e-8082-5f99bf9917f2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.963941 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb401929-c5ab-458e-8082-5f99bf9917f2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:46.968830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bfaf9-7424-403f-b551-08df6b79e50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:46.969511 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bfaf9-7424-403f-b551-08df6b79e50e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:46.969794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bfaf9-7424-403f-b551-08df6b79e50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:46.970114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2bfaf9-7424-403f-b551-08df6b79e50e admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:46.970961 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bfaf9-7424-403f-b551-08df6b79e50e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:46.971318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bfaf9-7424-403f-b551-08df6b79e50e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:46.973889 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2bfaf9-7424-403f-b551-08df6b79e50e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:46.984398 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 47/91] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:46.990312 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bfaf9-7424-403f-b551-08df6b79e50e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:46.998104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 45/92] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:15:46 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:15:47.001049 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2bfaf9-7424-403f-b551-08df6b79e50e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:47.007707 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ebefa-a2f5-43f9-8813-7b46d120d704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:47.009396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ebefa-a2f5-43f9-8813-7b46d120d704 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:47.009916 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ebefa-a2f5-43f9-8813-7b46d120d704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:47.010430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ebefa-a2f5-43f9-8813-7b46d120d704 admin admin] PATH_INFO: `/v3/users/07fc48f86c42414a9ed416bfe9660e3f` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:47.012296 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ebefa-a2f5-43f9-8813-7b46d120d704 admin admin] RBAC: Authorizing `identity:get_user(user_id=07fc48f86c42414a9ed416bfe9660e3f)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:47.014746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ebefa-a2f5-43f9-8813-7b46d120d704 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:47.016722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 48/93] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:46 2022] GET /identity/v3/users/07fc48f86c42414a9ed416bfe9660e3f => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:47.028306 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7687940-73a9-44b7-809d-044e0978e106 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:47.045732 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7687940-73a9-44b7-809d-044e0978e106 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:47.060105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238762e4-8ae4-4a9d-b3c2-7823f6181b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:47.060784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238762e4-8ae4-4a9d-b3c2-7823f6181b6e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:47.061065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238762e4-8ae4-4a9d-b3c2-7823f6181b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:47.061355 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238762e4-8ae4-4a9d-b3c2-7823f6181b6e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:47.070799 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238762e4-8ae4-4a9d-b3c2-7823f6181b6e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:47.072644 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238762e4-8ae4-4a9d-b3c2-7823f6181b6e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:47.083075 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 46/94] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:15:47.090742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ebefa-a2f5-43f9-8813-7b46d120d704 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:47.105770 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ebefa-a2f5-43f9-8813-7b46d120d704 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:47.110579 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7bc28-8993-41ab-badb-2e4376f959d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:47.111625 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7bc28-8993-41ab-badb-2e4376f959d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:47.111982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7bc28-8993-41ab-badb-2e4376f959d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:47.112356 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7bc28-8993-41ab-badb-2e4376f959d6 admin admin] PATH_INFO: `/v3/projects/1dbeaee7967d44f2b7cdfc56ef753ef9` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:47.113827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7bc28-8993-41ab-badb-2e4376f959d6 admin admin] RBAC: Authorizing `identity:get_project(project_id=1dbeaee7967d44f2b7cdfc56ef753ef9)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:47.116168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7bc28-8993-41ab-badb-2e4376f959d6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:47.118092 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 49/95] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:47 2022] GET /identity/v3/projects/1dbeaee7967d44f2b7cdfc56ef753ef9 => generated 312 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:47.124649 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238762e4-8ae4-4a9d-b3c2-7823f6181b6e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:47.134498 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238762e4-8ae4-4a9d-b3c2-7823f6181b6e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:47.139503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb71c5f-c0e7-48b7-8bdc-d9b2d2c6d024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:47.140180 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb71c5f-c0e7-48b7-8bdc-d9b2d2c6d024 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:47.140512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb71c5f-c0e7-48b7-8bdc-d9b2d2c6d024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:47.140807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb71c5f-c0e7-48b7-8bdc-d9b2d2c6d024 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:47.141736 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb71c5f-c0e7-48b7-8bdc-d9b2d2c6d024 admin admin] RBAC: Adding query filter params (role.id=ca6edcc85e3841d9bebb1b58cecb96d3, scope.project.id=1dbeaee7967d44f2b7cdfc56ef753ef9, user.id=07fc48f86c42414a9ed416bfe9660e3f) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:47.142100 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb71c5f-c0e7-48b7-8bdc-d9b2d2c6d024 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:47.144086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb71c5f-c0e7-48b7-8bdc-d9b2d2c6d024 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:47.151099 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 47/96] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:15:47 2022] GET /identity/v3/role_assignments?user.id=07fc48f86c42414a9ed416bfe9660e3f&scope.project.id=1dbeaee7967d44f2b7cdfc56ef753ef9&role.id=ca6edcc85e3841d9bebb1b58cecb96d3 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:49.264968 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04542d97-265f-435a-ade0-424df1dee494 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.265499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04542d97-265f-435a-ade0-424df1dee494 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.265499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04542d97-265f-435a-ade0-424df1dee494 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.267614 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 50/97] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:49.273974 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae767e9b-a414-4b25-a281-219c3158358e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.274443 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae767e9b-a414-4b25-a281-219c3158358e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.274536 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae767e9b-a414-4b25-a281-219c3158358e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.303534 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-ae767e9b-a414-4b25-a281-219c3158358e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:49.304755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ae767e9b-a414-4b25-a281-219c3158358e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:49.318079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 48/98] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:15:49.357476 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04542d97-265f-435a-ade0-424df1dee494 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:49.373056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04542d97-265f-435a-ade0-424df1dee494 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:49.377680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee8c69-04a6-47e4-afd4-9720f10e67f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:49.378475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee8c69-04a6-47e4-afd4-9720f10e67f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.378833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee8c69-04a6-47e4-afd4-9720f10e67f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.379116 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee8c69-04a6-47e4-afd4-9720f10e67f9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.388078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a1856-6f07-42c5-a84c-228ec40c6704 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.390679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a1856-6f07-42c5-a84c-228ec40c6704 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.390679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a1856-6f07-42c5-a84c-228ec40c6704 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.391334 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 49/99] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:49.393641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee8c69-04a6-47e4-afd4-9720f10e67f9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:49.398229 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836334f1-3788-4e3e-ab5a-0254f0609613 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.398765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836334f1-3788-4e3e-ab5a-0254f0609613 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.399353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836334f1-3788-4e3e-ab5a-0254f0609613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.401164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-3eee8c69-04a6-47e4-afd4-9720f10e67f9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:15:49.402662 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 51/100] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:15:49.421103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee8c69-04a6-47e4-afd4-9720f10e67f9 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:49.428035 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-836334f1-3788-4e3e-ab5a-0254f0609613 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:49.429561 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-836334f1-3788-4e3e-ab5a-0254f0609613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:49.442606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee8c69-04a6-47e4-afd4-9720f10e67f9 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:49.450716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 50/101] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:15:49.455924 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc746904-1038-4280-b4f5-8d2f92f6c328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:49.456603 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746904-1038-4280-b4f5-8d2f92f6c328 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.456960 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746904-1038-4280-b4f5-8d2f92f6c328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.457239 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746904-1038-4280-b4f5-8d2f92f6c328 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.458141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc746904-1038-4280-b4f5-8d2f92f6c328 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:49.458445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc746904-1038-4280-b4f5-8d2f92f6c328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:49.460113 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc746904-1038-4280-b4f5-8d2f92f6c328 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:49.469740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 52/102] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:15:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:49.476375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836334f1-3788-4e3e-ab5a-0254f0609613 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:49.493318 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836334f1-3788-4e3e-ab5a-0254f0609613 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:49.501143 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc746904-1038-4280-b4f5-8d2f92f6c328 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:49.508923 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555b998-5ba5-485d-9797-a6e5d5fdafd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:49.509806 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555b998-5ba5-485d-9797-a6e5d5fdafd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.510086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555b998-5ba5-485d-9797-a6e5d5fdafd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.510358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9555b998-5ba5-485d-9797-a6e5d5fdafd8 admin admin] PATH_INFO: `/v3/users/07fc48f86c42414a9ed416bfe9660e3f` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.512602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555b998-5ba5-485d-9797-a6e5d5fdafd8 admin admin] RBAC: Authorizing `identity:get_user(user_id=07fc48f86c42414a9ed416bfe9660e3f)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:49.514743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9555b998-5ba5-485d-9797-a6e5d5fdafd8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:49.518767 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc746904-1038-4280-b4f5-8d2f92f6c328 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:49.520433 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 51/103] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:49 2022] GET /identity/v3/users/07fc48f86c42414a9ed416bfe9660e3f => generated 275 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:49.526472 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c6127-d6a8-4f64-8f83-363dcbe34087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:49.527539 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c6127-d6a8-4f64-8f83-363dcbe34087 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.528018 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c6127-d6a8-4f64-8f83-363dcbe34087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.528116 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555b998-5ba5-485d-9797-a6e5d5fdafd8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:49.528664 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1c6127-d6a8-4f64-8f83-363dcbe34087 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.540151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9555b998-5ba5-485d-9797-a6e5d5fdafd8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:49.551174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1c6127-d6a8-4f64-8f83-363dcbe34087 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:49.553235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd705587-4fce-4ad4-a116-8c5a8cadf71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:49.554087 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705587-4fce-4ad4-a116-8c5a8cadf71a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.554366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705587-4fce-4ad4-a116-8c5a8cadf71a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.554642 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd705587-4fce-4ad4-a116-8c5a8cadf71a admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.559957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd705587-4fce-4ad4-a116-8c5a8cadf71a admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:49.560369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-3f1c6127-d6a8-4f64-8f83-363dcbe34087 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 04:15:49.562035 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd705587-4fce-4ad4-a116-8c5a8cadf71a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:49.562237 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 53/104] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:15:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:15:49.563858 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 52/105] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:49 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:49.573102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c6127-d6a8-4f64-8f83-363dcbe34087 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:49.573239 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd705587-4fce-4ad4-a116-8c5a8cadf71a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:49.588015 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd705587-4fce-4ad4-a116-8c5a8cadf71a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:49.588511 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1c6127-d6a8-4f64-8f83-363dcbe34087 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:49.596063 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692efa5-e5f2-41ae-ba04-01dd5580d38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:49.596939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692efa5-e5f2-41ae-ba04-01dd5580d38b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.597465 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692efa5-e5f2-41ae-ba04-01dd5580d38b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.597953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692efa5-e5f2-41ae-ba04-01dd5580d38b admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.598986 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692efa5-e5f2-41ae-ba04-01dd5580d38b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:49.599530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692efa5-e5f2-41ae-ba04-01dd5580d38b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:49.600887 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e50d5-609b-413b-8823-70e87ed3f30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:49.601772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e50d5-609b-413b-8823-70e87ed3f30d admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.601874 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692efa5-e5f2-41ae-ba04-01dd5580d38b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:49.602049 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e50d5-609b-413b-8823-70e87ed3f30d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.602326 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e50d5-609b-413b-8823-70e87ed3f30d admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e/users/07fc48f86c42414a9ed416bfe9660e3f/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.608570 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e50d5-609b-413b-8823-70e87ed3f30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4779a5fd09a4c01853830d4bee9d75e, user_id=07fc48f86c42414a9ed416bfe9660e3f, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:49.609602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-fe5e50d5-609b-413b-8823-70e87ed3f30d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:49.609602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:15:49.609602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:15:49.611601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e50d5-609b-413b-8823-70e87ed3f30d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:49.622961 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 54/106] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:15:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:49.629512 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692efa5-e5f2-41ae-ba04-01dd5580d38b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:49.646274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692efa5-e5f2-41ae-ba04-01dd5580d38b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:49.651359 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784cab0-5141-4f4b-8c2d-a68cce6bc19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:49.652536 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784cab0-5141-4f4b-8c2d-a68cce6bc19e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.653011 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784cab0-5141-4f4b-8c2d-a68cce6bc19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.653526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784cab0-5141-4f4b-8c2d-a68cce6bc19e admin admin] PATH_INFO: `/v3/users/07fc48f86c42414a9ed416bfe9660e3f` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.654920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784cab0-5141-4f4b-8c2d-a68cce6bc19e admin admin] RBAC: Authorizing `identity:get_user(user_id=07fc48f86c42414a9ed416bfe9660e3f)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:49.657327 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784cab0-5141-4f4b-8c2d-a68cce6bc19e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:49.659253 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 55/107] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:49 2022] GET /identity/v3/users/07fc48f86c42414a9ed416bfe9660e3f => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:49.666450 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784cab0-5141-4f4b-8c2d-a68cce6bc19e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:49.680819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784cab0-5141-4f4b-8c2d-a68cce6bc19e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:49.687446 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d587d-53b0-476a-a43a-5b0b2cf98ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:49.688532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d587d-53b0-476a-a43a-5b0b2cf98ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.689030 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d587d-53b0-476a-a43a-5b0b2cf98ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.689494 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d587d-53b0-476a-a43a-5b0b2cf98ba3 admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.693671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d587d-53b0-476a-a43a-5b0b2cf98ba3 admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:49.696243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d587d-53b0-476a-a43a-5b0b2cf98ba3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:49.698228 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 56/108] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:49 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:49.703925 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d587d-53b0-476a-a43a-5b0b2cf98ba3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:49.717845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 53/109] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:15:49 2022] PUT /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e/users/07fc48f86c42414a9ed416bfe9660e3f/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:15:49.718626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d587d-53b0-476a-a43a-5b0b2cf98ba3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:49.788630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c923c-9b46-4e35-ba9c-690672fa24e8 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.788917 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c923c-9b46-4e35-ba9c-690672fa24e8 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.789120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c923c-9b46-4e35-ba9c-690672fa24e8 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.791186 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 54/110] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:49.796794 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994588a-81d0-4916-8c6e-a800c43bc2a2 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.797083 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994588a-81d0-4916-8c6e-a800c43bc2a2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.797363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5994588a-81d0-4916-8c6e-a800c43bc2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.799599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba7bc3-d6ae-4c5b-9884-ee8d5403b87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:49.801403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba7bc3-d6ae-4c5b-9884-ee8d5403b87b admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.801999 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba7bc3-d6ae-4c5b-9884-ee8d5403b87b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.802526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba7bc3-d6ae-4c5b-9884-ee8d5403b87b admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e/users/07fc48f86c42414a9ed416bfe9660e3f/roles/b9252c31847f4513a49cd10bb4f9cdaa` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.805263 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba7bc3-d6ae-4c5b-9884-ee8d5403b87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4779a5fd09a4c01853830d4bee9d75e, user_id=07fc48f86c42414a9ed416bfe9660e3f, role_id=b9252c31847f4513a49cd10bb4f9cdaa)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:49.808653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba7bc3-d6ae-4c5b-9884-ee8d5403b87b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:49.844340 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-5994588a-81d0-4916-8c6e-a800c43bc2a2 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:49.845592 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-5994588a-81d0-4916-8c6e-a800c43bc2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:49.869154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 55/111] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:15:49.904760 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994588a-81d0-4916-8c6e-a800c43bc2a2 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:49.916593 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5994588a-81d0-4916-8c6e-a800c43bc2a2 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:49.925340 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95f22f-2475-48b5-8b33-2919219edab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:49.926852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95f22f-2475-48b5-8b33-2919219edab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:49.927137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95f22f-2475-48b5-8b33-2919219edab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:49.927444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95f22f-2475-48b5-8b33-2919219edab6 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:49.938994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 57/112] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:15:49 2022] PUT /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e/users/07fc48f86c42414a9ed416bfe9660e3f/roles/b9252c31847f4513a49cd10bb4f9cdaa => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:15:49.948323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95f22f-2475-48b5-8b33-2919219edab6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:49.955589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-dd95f22f-2475-48b5-8b33-2919219edab6 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:15:49.957532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 56/113] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:15:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:15:49.964301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba7bc3-d6ae-4c5b-9884-ee8d5403b87b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:50.049127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba7bc3-d6ae-4c5b-9884-ee8d5403b87b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:50.054622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd863485-a57d-4245-9050-2788dbf691d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:50.055572 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd863485-a57d-4245-9050-2788dbf691d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:50.056376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd863485-a57d-4245-9050-2788dbf691d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:50.057163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd863485-a57d-4245-9050-2788dbf691d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:50.057999 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb55505-5e17-42fc-874d-7069ff893d9f None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:50.058295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb55505-5e17-42fc-874d-7069ff893d9f None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:50.058564 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd863485-a57d-4245-9050-2788dbf691d3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:50.058659 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb55505-5e17-42fc-874d-7069ff893d9f None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:50.059161 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd863485-a57d-4245-9050-2788dbf691d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:50.060518 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 57/114] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:15:50.061412 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd863485-a57d-4245-9050-2788dbf691d3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:50.070818 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c488c7d-cc31-446f-ac21-1a3565c5d7b8 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:50.071103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c488c7d-cc31-446f-ac21-1a3565c5d7b8 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:50.071424 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c488c7d-cc31-446f-ac21-1a3565c5d7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:50.073127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 58/115] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:50.079006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd863485-a57d-4245-9050-2788dbf691d3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:50.090965 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd863485-a57d-4245-9050-2788dbf691d3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:50.096997 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63efbf6-0523-484b-a794-9c6463051a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:50.098219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63efbf6-0523-484b-a794-9c6463051a57 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:50.099311 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63efbf6-0523-484b-a794-9c6463051a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:50.099824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63efbf6-0523-484b-a794-9c6463051a57 admin admin] PATH_INFO: `/v3/users/0d198e449ccb450a97886efab230ca66` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:50.101320 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63efbf6-0523-484b-a794-9c6463051a57 admin admin] RBAC: Authorizing `identity:get_user(user_id=0d198e449ccb450a97886efab230ca66)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:50.103571 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63efbf6-0523-484b-a794-9c6463051a57 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:50.105718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 59/116] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:50 2022] GET /identity/v3/users/0d198e449ccb450a97886efab230ca66 => generated 247 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:50.111471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63efbf6-0523-484b-a794-9c6463051a57 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:50.120394 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-2c488c7d-cc31-446f-ac21-1a3565c5d7b8 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:50.121618 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2c488c7d-cc31-446f-ac21-1a3565c5d7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:50.123254 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63efbf6-0523-484b-a794-9c6463051a57 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:50.128344 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e122e-0db2-41fd-b01a-594314394f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:50.130764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e122e-0db2-41fd-b01a-594314394f2e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:50.131349 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e122e-0db2-41fd-b01a-594314394f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:50.131853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1e122e-0db2-41fd-b01a-594314394f2e admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:50.133452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e122e-0db2-41fd-b01a-594314394f2e admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:50.135992 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1e122e-0db2-41fd-b01a-594314394f2e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:50.138096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 60/117] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:50 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:50.142492 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 58/118] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Feb 12 04:15:50.143620 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e122e-0db2-41fd-b01a-594314394f2e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:50.154085 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1e122e-0db2-41fd-b01a-594314394f2e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:50.158699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab974a-18dc-4ecc-acbb-624a060668be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:50.159935 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab974a-18dc-4ecc-acbb-624a060668be admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:50.160553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab974a-18dc-4ecc-acbb-624a060668be admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:50.161022 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab974a-18dc-4ecc-acbb-624a060668be admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e/users/0d198e449ccb450a97886efab230ca66/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:50.163251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab974a-18dc-4ecc-acbb-624a060668be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4779a5fd09a4c01853830d4bee9d75e, user_id=0d198e449ccb450a97886efab230ca66, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:50.166127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eab974a-18dc-4ecc-acbb-624a060668be admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:50.177802 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c488c7d-cc31-446f-ac21-1a3565c5d7b8 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:50.197906 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c488c7d-cc31-446f-ac21-1a3565c5d7b8 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:50.212993 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc342dd5-9fd9-4251-94c5-6473f9ca12b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:50.213807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc342dd5-9fd9-4251-94c5-6473f9ca12b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:50.214093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc342dd5-9fd9-4251-94c5-6473f9ca12b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:50.214371 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc342dd5-9fd9-4251-94c5-6473f9ca12b7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:50.240513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc342dd5-9fd9-4251-94c5-6473f9ca12b7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:50.247582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-dc342dd5-9fd9-4251-94c5-6473f9ca12b7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:15:50.248820 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 59/119] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:15:50.254365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc342dd5-9fd9-4251-94c5-6473f9ca12b7 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:50.268341 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc342dd5-9fd9-4251-94c5-6473f9ca12b7 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:50.280687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667e6a4-8cdb-4ac5-b32e-65fec736ebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:50.281374 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e6a4-8cdb-4ac5-b32e-65fec736ebae admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:50.281659 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e6a4-8cdb-4ac5-b32e-65fec736ebae admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:50.281937 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667e6a4-8cdb-4ac5-b32e-65fec736ebae admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:50.282720 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667e6a4-8cdb-4ac5-b32e-65fec736ebae admin admin] RBAC: Adding query filter params (name=member) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:50.283029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667e6a4-8cdb-4ac5-b32e-65fec736ebae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:50.284687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667e6a4-8cdb-4ac5-b32e-65fec736ebae admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:50.295356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 60/120] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:15:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:50.302010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667e6a4-8cdb-4ac5-b32e-65fec736ebae admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:50.304578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 61/121] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:15:50 2022] PUT /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e/users/0d198e449ccb450a97886efab230ca66/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:15:50.314686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667e6a4-8cdb-4ac5-b32e-65fec736ebae admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:50.382713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9574bf6-b314-44d4-af63-8dc23c5da277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:50.384302 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574bf6-b314-44d4-af63-8dc23c5da277 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:50.384789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574bf6-b314-44d4-af63-8dc23c5da277 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:50.385320 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9574bf6-b314-44d4-af63-8dc23c5da277 admin admin] PATH_INFO: `/v3/users/07fc48f86c42414a9ed416bfe9660e3f` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:50.386798 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9574bf6-b314-44d4-af63-8dc23c5da277 admin admin] RBAC: Authorizing `identity:get_user(user_id=07fc48f86c42414a9ed416bfe9660e3f)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:50.389428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9574bf6-b314-44d4-af63-8dc23c5da277 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:50.391458 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 61/122] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:50 2022] GET /identity/v3/users/07fc48f86c42414a9ed416bfe9660e3f => generated 275 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:50.398042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab974a-18dc-4ecc-acbb-624a060668be admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:50.418001 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eab974a-18dc-4ecc-acbb-624a060668be admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:50.428971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0618aa-ab77-4fef-a023-92b9c3f46ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:50.429853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0618aa-ab77-4fef-a023-92b9c3f46ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:50.430133 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0618aa-ab77-4fef-a023-92b9c3f46ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:50.430405 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0618aa-ab77-4fef-a023-92b9c3f46ed0 admin admin] PATH_INFO: `/v3/projects/1dbeaee7967d44f2b7cdfc56ef753ef9` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:50.432911 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0618aa-ab77-4fef-a023-92b9c3f46ed0 admin admin] RBAC: Authorizing `identity:get_project(project_id=1dbeaee7967d44f2b7cdfc56ef753ef9)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:50.434980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0618aa-ab77-4fef-a023-92b9c3f46ed0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:50.436725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 62/123] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:50 2022] GET /identity/v3/projects/1dbeaee7967d44f2b7cdfc56ef753ef9 => generated 312 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:50.443754 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9574bf6-b314-44d4-af63-8dc23c5da277 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:50.454899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9574bf6-b314-44d4-af63-8dc23c5da277 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:50.463173 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a0ae7-ff9a-4c08-8f5e-0bee4857b7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:50.464593 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0ae7-ff9a-4c08-8f5e-0bee4857b7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:50.465096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0ae7-ff9a-4c08-8f5e-0bee4857b7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:50.465614 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a0ae7-ff9a-4c08-8f5e-0bee4857b7b2 admin admin] PATH_INFO: `/v3/projects/1dbeaee7967d44f2b7cdfc56ef753ef9/users/07fc48f86c42414a9ed416bfe9660e3f/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:50.468009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a0ae7-ff9a-4c08-8f5e-0bee4857b7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dbeaee7967d44f2b7cdfc56ef753ef9, user_id=07fc48f86c42414a9ed416bfe9660e3f, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:50.471108 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772a0ae7-ff9a-4c08-8f5e-0bee4857b7b2 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:50.562130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 62/124] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:15:50 2022] PUT /identity/v3/projects/1dbeaee7967d44f2b7cdfc56ef753ef9/users/07fc48f86c42414a9ed416bfe9660e3f/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:15:51.089276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577526d-3eee-4d30-9772-ba69d5087e7e None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:51.089648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577526d-3eee-4d30-9772-ba69d5087e7e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:51.089836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2577526d-3eee-4d30-9772-ba69d5087e7e None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:51.091779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 63/125] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:51.097342 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f639-a186-4342-bb02-0a932eeb16af None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:51.097900 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f639-a186-4342-bb02-0a932eeb16af None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:51.098372 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55f639-a186-4342-bb02-0a932eeb16af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:51.119175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-4c55f639-a186-4342-bb02-0a932eeb16af None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:51.120698 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4c55f639-a186-4342-bb02-0a932eeb16af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:51.192552 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 63/126] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:51.240912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577526d-3eee-4d30-9772-ba69d5087e7e None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:51.256399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2577526d-3eee-4d30-9772-ba69d5087e7e None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:51.262643 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c97dd-1732-4229-bb39-3c477401c05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:51.263448 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c97dd-1732-4229-bb39-3c477401c05a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:51.263731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c97dd-1732-4229-bb39-3c477401c05a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:51.264006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c97dd-1732-4229-bb39-3c477401c05a admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:51.285956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c97dd-1732-4229-bb39-3c477401c05a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:51.292817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-b83c97dd-1732-4229-bb39-3c477401c05a admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 04:15:51.294093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 64/127] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:15:51.300083 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55f639-a186-4342-bb02-0a932eeb16af None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:51.312221 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55f639-a186-4342-bb02-0a932eeb16af None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:51.318856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6885b28-c119-4f3c-af22-85f5d30d5a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:51.319801 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6885b28-c119-4f3c-af22-85f5d30d5a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:51.320283 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6885b28-c119-4f3c-af22-85f5d30d5a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:51.320781 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6885b28-c119-4f3c-af22-85f5d30d5a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:51.321745 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6885b28-c119-4f3c-af22-85f5d30d5a72 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:51.322251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6885b28-c119-4f3c-af22-85f5d30d5a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:51.328171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6885b28-c119-4f3c-af22-85f5d30d5a72 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:51.340564 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 64/128] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:15:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:51.345772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c97dd-1732-4229-bb39-3c477401c05a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:51.360191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c97dd-1732-4229-bb39-3c477401c05a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:51.367417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53cf26-f407-4552-aa2b-704d570eff28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:51.368481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53cf26-f407-4552-aa2b-704d570eff28 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:51.368759 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53cf26-f407-4552-aa2b-704d570eff28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:51.369029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d53cf26-f407-4552-aa2b-704d570eff28 admin admin] PATH_INFO: `/v3/users/8578f6ce0ee642909674ff1a9a329f44` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:51.393146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53cf26-f407-4552-aa2b-704d570eff28 admin admin] RBAC: Authorizing `identity:get_user(user_id=8578f6ce0ee642909674ff1a9a329f44)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:51.395602 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d53cf26-f407-4552-aa2b-704d570eff28 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:51.397360 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 65/129] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:51 2022] GET /identity/v3/users/8578f6ce0ee642909674ff1a9a329f44 => generated 289 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:51.403045 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6885b28-c119-4f3c-af22-85f5d30d5a72 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:51.416252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6885b28-c119-4f3c-af22-85f5d30d5a72 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:51.422225 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6c0f5-3ad0-48c2-b4e7-634e68bfe839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:51.426935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6c0f5-3ad0-48c2-b4e7-634e68bfe839 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:51.426935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6c0f5-3ad0-48c2-b4e7-634e68bfe839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:51.426935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6c0f5-3ad0-48c2-b4e7-634e68bfe839 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:51.437309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6c0f5-3ad0-48c2-b4e7-634e68bfe839 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:51.439467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6c0f5-3ad0-48c2-b4e7-634e68bfe839 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:51.451032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 65/130] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:15:51.456167 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53cf26-f407-4552-aa2b-704d570eff28 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:51.457896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d79b3-db81-4db5-a66d-375330bb5c83 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:51.458409 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d79b3-db81-4db5-a66d-375330bb5c83 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:51.458878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d79b3-db81-4db5-a66d-375330bb5c83 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:51.460940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 66/131] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:15:51.466168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f502bc-a2e1-442c-a63b-192bbfcf706d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:51.466679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f502bc-a2e1-442c-a63b-192bbfcf706d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:51.467171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f502bc-a2e1-442c-a63b-192bbfcf706d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:51.470467 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d53cf26-f407-4552-aa2b-704d570eff28 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:51.489315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e36a96-07b9-4e25-93f3-c9ed7a7e35dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:51.490285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e36a96-07b9-4e25-93f3-c9ed7a7e35dc admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:51.490573 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e36a96-07b9-4e25-93f3-c9ed7a7e35dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:51.490838 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e36a96-07b9-4e25-93f3-c9ed7a7e35dc admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:51.494447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-f8f502bc-a2e1-442c-a63b-192bbfcf706d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:51.494697 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e36a96-07b9-4e25-93f3-c9ed7a7e35dc admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:51.496156 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f8f502bc-a2e1-442c-a63b-192bbfcf706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:51.496787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e36a96-07b9-4e25-93f3-c9ed7a7e35dc admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:51.498516 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 66/132] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:51 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:51.504554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e36a96-07b9-4e25-93f3-c9ed7a7e35dc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:51.509882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 67/133] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:15:51.521996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e36a96-07b9-4e25-93f3-c9ed7a7e35dc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:51.537388 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083809f3-3bdd-4003-b0ec-cac9caaa6559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:51.538053 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083809f3-3bdd-4003-b0ec-cac9caaa6559 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:51.538336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083809f3-3bdd-4003-b0ec-cac9caaa6559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:51.538612 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083809f3-3bdd-4003-b0ec-cac9caaa6559 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:51.539493 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083809f3-3bdd-4003-b0ec-cac9caaa6559 admin admin] RBAC: Adding query filter params (role.id=6f527e6f2b2041689856666de79d95a3, scope.project.id=f4779a5fd09a4c01853830d4bee9d75e, user.id=8578f6ce0ee642909674ff1a9a329f44) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:51.539804 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083809f3-3bdd-4003-b0ec-cac9caaa6559 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:51.541666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083809f3-3bdd-4003-b0ec-cac9caaa6559 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:51.552218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 67/134] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:15:51 2022] GET /identity/v3/role_assignments?user.id=8578f6ce0ee642909674ff1a9a329f44&scope.project.id=f4779a5fd09a4c01853830d4bee9d75e&role.id=6f527e6f2b2041689856666de79d95a3 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:51.553565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f502bc-a2e1-442c-a63b-192bbfcf706d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:51.573905 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f502bc-a2e1-442c-a63b-192bbfcf706d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:51.583043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754692ee-c3dd-4f72-8806-e269032301d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:51.584247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754692ee-c3dd-4f72-8806-e269032301d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:51.584728 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754692ee-c3dd-4f72-8806-e269032301d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:51.585220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754692ee-c3dd-4f72-8806-e269032301d9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:51.586627 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754692ee-c3dd-4f72-8806-e269032301d9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:51.588588 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754692ee-c3dd-4f72-8806-e269032301d9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:51.590984 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 68/135] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:15:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:51.596565 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083809f3-3bdd-4003-b0ec-cac9caaa6559 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:51.610716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083809f3-3bdd-4003-b0ec-cac9caaa6559 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:51.618466 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6ace4-ffb4-4b94-9591-3b01a3686bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:51.619254 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6ace4-ffb4-4b94-9591-3b01a3686bad admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:51.619548 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6ace4-ffb4-4b94-9591-3b01a3686bad admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:51.619867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6ace4-ffb4-4b94-9591-3b01a3686bad admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:51.620730 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6ace4-ffb4-4b94-9591-3b01a3686bad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:51.622868 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6ace4-ffb4-4b94-9591-3b01a3686bad admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:51.746014 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 68/136] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Feb 12 04:15:51 2022] POST /identity/v3/projects => generated 302 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:15:53.024280 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc650090-b9b4-419a-b92c-81095061246d None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.025273 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc650090-b9b4-419a-b92c-81095061246d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.025755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc650090-b9b4-419a-b92c-81095061246d None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.027764 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 69/137] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:53.033091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d9694-a473-462a-bb95-e563112b1874 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.033521 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d9694-a473-462a-bb95-e563112b1874 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.033710 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d9694-a473-462a-bb95-e563112b1874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.059608 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-171d9694-a473-462a-bb95-e563112b1874 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:53.060783 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-171d9694-a473-462a-bb95-e563112b1874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:53.140594 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 69/138] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:53.176932 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc650090-b9b4-419a-b92c-81095061246d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:53.193116 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc650090-b9b4-419a-b92c-81095061246d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:53.202960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e47d78-04ed-40f9-abdc-c441caf2e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:53.204213 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e47d78-04ed-40f9-abdc-c441caf2e218 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.204716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e47d78-04ed-40f9-abdc-c441caf2e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.205189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e47d78-04ed-40f9-abdc-c441caf2e218 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.221577 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e47d78-04ed-40f9-abdc-c441caf2e218 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:53.229919 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-f5e47d78-04ed-40f9-abdc-c441caf2e218 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:15:53.231430 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 70/139] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:15:53.240317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d9694-a473-462a-bb95-e563112b1874 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:53.249725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d9694-a473-462a-bb95-e563112b1874 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:53.259853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babfb91-14df-462d-880d-f4f5f387b047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:53.260811 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babfb91-14df-462d-880d-f4f5f387b047 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.261292 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babfb91-14df-462d-880d-f4f5f387b047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.261760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babfb91-14df-462d-880d-f4f5f387b047 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.262722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babfb91-14df-462d-880d-f4f5f387b047 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:53.263253 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babfb91-14df-462d-880d-f4f5f387b047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:53.265092 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babfb91-14df-462d-880d-f4f5f387b047 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:53.275071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 70/140] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:15:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:53.284290 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e47d78-04ed-40f9-abdc-c441caf2e218 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:53.301548 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e47d78-04ed-40f9-abdc-c441caf2e218 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:53.311357 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a89b6-2efc-499d-a0d4-c91e041948fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:53.312508 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a89b6-2efc-499d-a0d4-c91e041948fc admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.312995 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a89b6-2efc-499d-a0d4-c91e041948fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.313468 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a89b6-2efc-499d-a0d4-c91e041948fc admin admin] PATH_INFO: `/v3/users/07fc48f86c42414a9ed416bfe9660e3f` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.314932 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a89b6-2efc-499d-a0d4-c91e041948fc admin admin] RBAC: Authorizing `identity:get_user(user_id=07fc48f86c42414a9ed416bfe9660e3f)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:53.317841 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a89b6-2efc-499d-a0d4-c91e041948fc admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:53.319731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 71/141] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:53 2022] GET /identity/v3/users/07fc48f86c42414a9ed416bfe9660e3f => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:53.325316 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babfb91-14df-462d-880d-f4f5f387b047 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:53.340215 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babfb91-14df-462d-880d-f4f5f387b047 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:53.347838 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47463f8b-dfd9-4a15-9242-f0583b8eb671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:53.348746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47463f8b-dfd9-4a15-9242-f0583b8eb671 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.349225 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47463f8b-dfd9-4a15-9242-f0583b8eb671 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.349695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47463f8b-dfd9-4a15-9242-f0583b8eb671 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.358441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47463f8b-dfd9-4a15-9242-f0583b8eb671 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:53.360507 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47463f8b-dfd9-4a15-9242-f0583b8eb671 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:53.372611 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 71/142] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:15:53.378177 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a89b6-2efc-499d-a0d4-c91e041948fc admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:53.392257 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a89b6-2efc-499d-a0d4-c91e041948fc admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:53.398403 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcbaa1c-1c5e-440e-b1b0-fbe83eb9f484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:53.399562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbaa1c-1c5e-440e-b1b0-fbe83eb9f484 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.400022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbaa1c-1c5e-440e-b1b0-fbe83eb9f484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.400500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcbaa1c-1c5e-440e-b1b0-fbe83eb9f484 admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.401873 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbaa1c-1c5e-440e-b1b0-fbe83eb9f484 admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:53.404194 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcbaa1c-1c5e-440e-b1b0-fbe83eb9f484 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:53.406075 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 72/143] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:53 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:53.412566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47463f8b-dfd9-4a15-9242-f0583b8eb671 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:53.422097 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47463f8b-dfd9-4a15-9242-f0583b8eb671 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:53.429430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f7314b-91fa-40bf-a48e-90fcdb9c8a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:53.430292 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7314b-91fa-40bf-a48e-90fcdb9c8a8b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.430778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7314b-91fa-40bf-a48e-90fcdb9c8a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.431260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f7314b-91fa-40bf-a48e-90fcdb9c8a8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.432538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7314b-91fa-40bf-a48e-90fcdb9c8a8b admin admin] RBAC: Adding query filter params (role.id=ca6edcc85e3841d9bebb1b58cecb96d3, scope.project.id=f4779a5fd09a4c01853830d4bee9d75e, user.id=07fc48f86c42414a9ed416bfe9660e3f) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:53.433025 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7314b-91fa-40bf-a48e-90fcdb9c8a8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:53.435060 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f7314b-91fa-40bf-a48e-90fcdb9c8a8b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:53.444647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 72/144] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:15:53 2022] GET /identity/v3/role_assignments?user.id=07fc48f86c42414a9ed416bfe9660e3f&scope.project.id=f4779a5fd09a4c01853830d4bee9d75e&role.id=ca6edcc85e3841d9bebb1b58cecb96d3 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:53.524602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9a59a-5af7-4387-be3e-27e059a5605f None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.525276 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9a59a-5af7-4387-be3e-27e059a5605f None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.525754 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9a59a-5af7-4387-be3e-27e059a5605f None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.527770 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 73/145] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:53.533379 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb4b2e-e294-4b62-b83f-34b458d547c9 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.533897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb4b2e-e294-4b62-b83f-34b458d547c9 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.534372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eb4b2e-e294-4b62-b83f-34b458d547c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.560240 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c1eb4b2e-e294-4b62-b83f-34b458d547c9 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:53.561817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c1eb4b2e-e294-4b62-b83f-34b458d547c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:53.571088 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 73/146] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:15:53.594669 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9a59a-5af7-4387-be3e-27e059a5605f None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:53.611934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9a59a-5af7-4387-be3e-27e059a5605f None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:53.623200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684323f-ff4a-450f-827c-37c5e6da9015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:53.624433 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684323f-ff4a-450f-827c-37c5e6da9015 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.624939 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684323f-ff4a-450f-827c-37c5e6da9015 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.625409 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684323f-ff4a-450f-827c-37c5e6da9015 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.644490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684323f-ff4a-450f-827c-37c5e6da9015 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:53.652409 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-4684323f-ff4a-450f-827c-37c5e6da9015 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 04:15:53.654316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 74/147] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:15:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:15:53.660259 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb4b2e-e294-4b62-b83f-34b458d547c9 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:53.669776 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eb4b2e-e294-4b62-b83f-34b458d547c9 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:53.679733 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60a707-afd1-4680-8702-300e65de2d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:53.680763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60a707-afd1-4680-8702-300e65de2d2c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.681272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60a707-afd1-4680-8702-300e65de2d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.681986 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60a707-afd1-4680-8702-300e65de2d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.682976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60a707-afd1-4680-8702-300e65de2d2c admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:53.683535 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60a707-afd1-4680-8702-300e65de2d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:53.685414 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60a707-afd1-4680-8702-300e65de2d2c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:53.699808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 74/148] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:15:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:53.705697 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684323f-ff4a-450f-827c-37c5e6da9015 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:53.716212 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684323f-ff4a-450f-827c-37c5e6da9015 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:53.727694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3017-518e-456c-9036-0651f078c17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:53.728942 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3017-518e-456c-9036-0651f078c17e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.729449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3017-518e-456c-9036-0651f078c17e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.729943 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f3017-518e-456c-9036-0651f078c17e admin admin] PATH_INFO: `/v3/users/07fc48f86c42414a9ed416bfe9660e3f` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.731466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3017-518e-456c-9036-0651f078c17e admin admin] RBAC: Authorizing `identity:get_user(user_id=07fc48f86c42414a9ed416bfe9660e3f)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:53.733827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71f3017-518e-456c-9036-0651f078c17e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:53.735754 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 75/149] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:53 2022] GET /identity/v3/users/07fc48f86c42414a9ed416bfe9660e3f => generated 275 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:53.742800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60a707-afd1-4680-8702-300e65de2d2c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:53.755380 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60a707-afd1-4680-8702-300e65de2d2c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:53.761376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89773317-9b1c-4e45-9a67-527d8d3a095e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:53.762364 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89773317-9b1c-4e45-9a67-527d8d3a095e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.762877 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89773317-9b1c-4e45-9a67-527d8d3a095e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.763430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89773317-9b1c-4e45-9a67-527d8d3a095e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.780019 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89773317-9b1c-4e45-9a67-527d8d3a095e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:53.785634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89773317-9b1c-4e45-9a67-527d8d3a095e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:53.801553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 75/150] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:15:53.807606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3017-518e-456c-9036-0651f078c17e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:53.818841 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f3017-518e-456c-9036-0651f078c17e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:53.825827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ed2f8-3726-4953-ad61-b8a509c1c128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:53.826996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ed2f8-3726-4953-ad61-b8a509c1c128 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.827537 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ed2f8-3726-4953-ad61-b8a509c1c128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.828062 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ed2f8-3726-4953-ad61-b8a509c1c128 admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.829596 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ed2f8-3726-4953-ad61-b8a509c1c128 admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:53.832687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ed2f8-3726-4953-ad61-b8a509c1c128 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:53.835265 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 76/151] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:53 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:53.841059 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89773317-9b1c-4e45-9a67-527d8d3a095e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:53.851785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89773317-9b1c-4e45-9a67-527d8d3a095e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:53.858771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ce05e7-110f-4267-87a4-b1dab3f096e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:53.859911 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce05e7-110f-4267-87a4-b1dab3f096e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.860427 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce05e7-110f-4267-87a4-b1dab3f096e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.860903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ce05e7-110f-4267-87a4-b1dab3f096e2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.862020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce05e7-110f-4267-87a4-b1dab3f096e2 admin admin] RBAC: Adding query filter params (role.id=b9252c31847f4513a49cd10bb4f9cdaa, scope.project.id=f4779a5fd09a4c01853830d4bee9d75e, user.id=07fc48f86c42414a9ed416bfe9660e3f) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:53.862666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce05e7-110f-4267-87a4-b1dab3f096e2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:53.865447 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ce05e7-110f-4267-87a4-b1dab3f096e2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:53.876557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 76/152] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:15:53 2022] GET /identity/v3/role_assignments?user.id=07fc48f86c42414a9ed416bfe9660e3f&scope.project.id=f4779a5fd09a4c01853830d4bee9d75e&role.id=b9252c31847f4513a49cd10bb4f9cdaa => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:53.996031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759937e-d7c2-4e13-947b-847402b7cba9 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:53.996670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759937e-d7c2-4e13-947b-847402b7cba9 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:53.997176 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b759937e-d7c2-4e13-947b-847402b7cba9 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:53.999617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 77/153] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:54.006329 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd602f3f-3652-43de-8f0b-949308a0fc1c None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.006608 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd602f3f-3652-43de-8f0b-949308a0fc1c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.006891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd602f3f-3652-43de-8f0b-949308a0fc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.036079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-cd602f3f-3652-43de-8f0b-949308a0fc1c None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:54.037691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-cd602f3f-3652-43de-8f0b-949308a0fc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:54.050492 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 77/154] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:15:54.097616 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759937e-d7c2-4e13-947b-847402b7cba9 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.115596 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b759937e-d7c2-4e13-947b-847402b7cba9 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.122683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8489f-953e-4790-941f-7c66fddee753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.123924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8489f-953e-4790-941f-7c66fddee753 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.124483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8489f-953e-4790-941f-7c66fddee753 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.124972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8489f-953e-4790-941f-7c66fddee753 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.125696 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f4776-0e4b-4b21-9391-b1a70bad529b None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.125990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f4776-0e4b-4b21-9391-b1a70bad529b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.126285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f4776-0e4b-4b21-9391-b1a70bad529b None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.128165 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 78/155] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:15:54.134947 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cb032-ba70-4a3a-bc30-853191619445 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.135313 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cb032-ba70-4a3a-bc30-853191619445 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.135519 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cb032-ba70-4a3a-bc30-853191619445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.141017 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a8489f-953e-4790-941f-7c66fddee753 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:54.149808 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-f1a8489f-953e-4790-941f-7c66fddee753 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:15:54.151067 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 78/156] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:15:54.159263 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8489f-953e-4790-941f-7c66fddee753 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.166306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-746cb032-ba70-4a3a-bc30-853191619445 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:54.168399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-746cb032-ba70-4a3a-bc30-853191619445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:54.174849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a8489f-953e-4790-941f-7c66fddee753 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.184106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 79/157] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:15:54.184784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60f348-cf0c-4d1d-a9f5-277f3335a88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.185549 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60f348-cf0c-4d1d-a9f5-277f3335a88d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.185812 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60f348-cf0c-4d1d-a9f5-277f3335a88d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.186088 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60f348-cf0c-4d1d-a9f5-277f3335a88d admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.186871 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60f348-cf0c-4d1d-a9f5-277f3335a88d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:54.187179 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60f348-cf0c-4d1d-a9f5-277f3335a88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:54.188879 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60f348-cf0c-4d1d-a9f5-277f3335a88d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:54.205595 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 79/158] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:54.212042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cb032-ba70-4a3a-bc30-853191619445 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.214485 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60f348-cf0c-4d1d-a9f5-277f3335a88d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.224285 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60f348-cf0c-4d1d-a9f5-277f3335a88d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.226016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cb032-ba70-4a3a-bc30-853191619445 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.231362 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8edb9e-8670-428e-8747-d7268252b783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.232165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8edb9e-8670-428e-8747-d7268252b783 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.232456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8edb9e-8670-428e-8747-d7268252b783 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.232733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8edb9e-8670-428e-8747-d7268252b783 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.237324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c1e01-cc1e-4e48-89f3-3d7ea21c36be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.238310 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c1e01-cc1e-4e48-89f3-3d7ea21c36be admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.238590 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c1e01-cc1e-4e48-89f3-3d7ea21c36be admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.238907 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004c1e01-cc1e-4e48-89f3-3d7ea21c36be admin admin] PATH_INFO: `/v3/users/0d198e449ccb450a97886efab230ca66` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.240341 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c1e01-cc1e-4e48-89f3-3d7ea21c36be admin admin] RBAC: Authorizing `identity:get_user(user_id=0d198e449ccb450a97886efab230ca66)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:54.242274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004c1e01-cc1e-4e48-89f3-3d7ea21c36be admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:54.244456 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 80/159] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/users/0d198e449ccb450a97886efab230ca66 => generated 247 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:54.254031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8edb9e-8670-428e-8747-d7268252b783 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:54.254215 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c1e01-cc1e-4e48-89f3-3d7ea21c36be admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.261112 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-5b8edb9e-8670-428e-8747-d7268252b783 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:15:54.262327 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 80/160] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:15:54.264222 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004c1e01-cc1e-4e48-89f3-3d7ea21c36be admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.273041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8edb9e-8670-428e-8747-d7268252b783 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.275462 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc75cce-5b13-4965-8b80-6977a7ccf63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.276120 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc75cce-5b13-4965-8b80-6977a7ccf63d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.276451 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc75cce-5b13-4965-8b80-6977a7ccf63d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.276729 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc75cce-5b13-4965-8b80-6977a7ccf63d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.287268 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8edb9e-8670-428e-8747-d7268252b783 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.288211 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc75cce-5b13-4965-8b80-6977a7ccf63d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:54.290445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc75cce-5b13-4965-8b80-6977a7ccf63d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:54.291851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdeff2-0f81-4e9c-93ac-9e4a4e10f298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.292514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdeff2-0f81-4e9c-93ac-9e4a4e10f298 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.292791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdeff2-0f81-4e9c-93ac-9e4a4e10f298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.293062 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfdeff2-0f81-4e9c-93ac-9e4a4e10f298 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.293827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdeff2-0f81-4e9c-93ac-9e4a4e10f298 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:54.294128 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdeff2-0f81-4e9c-93ac-9e4a4e10f298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:54.295958 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfdeff2-0f81-4e9c-93ac-9e4a4e10f298 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:54.301115 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 81/161] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:15:54.310080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc75cce-5b13-4965-8b80-6977a7ccf63d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.311147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 81/162] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:54.317722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdeff2-0f81-4e9c-93ac-9e4a4e10f298 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.319502 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc75cce-5b13-4965-8b80-6977a7ccf63d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.324697 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed96c50-923a-4deb-9ced-6ab40ca4b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.325819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed96c50-923a-4deb-9ced-6ab40ca4b386 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.326108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed96c50-923a-4deb-9ced-6ab40ca4b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.326381 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed96c50-923a-4deb-9ced-6ab40ca4b386 admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.327624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed96c50-923a-4deb-9ced-6ab40ca4b386 admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:54.327867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfdeff2-0f81-4e9c-93ac-9e4a4e10f298 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.329825 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed96c50-923a-4deb-9ced-6ab40ca4b386 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:54.332278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 82/163] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:54.336392 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6d478-f176-45d1-8d7c-9e1f6097325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.337370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6d478-f176-45d1-8d7c-9e1f6097325f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.337699 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6d478-f176-45d1-8d7c-9e1f6097325f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.337972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd6d478-f176-45d1-8d7c-9e1f6097325f admin admin] PATH_INFO: `/v3/users/07fc48f86c42414a9ed416bfe9660e3f` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.339144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed96c50-923a-4deb-9ced-6ab40ca4b386 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.339356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6d478-f176-45d1-8d7c-9e1f6097325f admin admin] RBAC: Authorizing `identity:get_user(user_id=07fc48f86c42414a9ed416bfe9660e3f)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:54.341850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd6d478-f176-45d1-8d7c-9e1f6097325f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:54.343616 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 82/164] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/users/07fc48f86c42414a9ed416bfe9660e3f => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:54.349578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6d478-f176-45d1-8d7c-9e1f6097325f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.356093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed96c50-923a-4deb-9ced-6ab40ca4b386 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.359845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd6d478-f176-45d1-8d7c-9e1f6097325f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.361365 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1ce39-6fe4-42ce-8266-07a0de5b4980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.362013 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1ce39-6fe4-42ce-8266-07a0de5b4980 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.362297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1ce39-6fe4-42ce-8266-07a0de5b4980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.362576 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1ce39-6fe4-42ce-8266-07a0de5b4980 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.363505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1ce39-6fe4-42ce-8266-07a0de5b4980 admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=f4779a5fd09a4c01853830d4bee9d75e, user.id=0d198e449ccb450a97886efab230ca66) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:54.363812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1ce39-6fe4-42ce-8266-07a0de5b4980 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:54.364830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c057c-0554-45c0-9720-b986c8c2341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.365454 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c057c-0554-45c0-9720-b986c8c2341c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.365681 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1ce39-6fe4-42ce-8266-07a0de5b4980 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:54.365853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c057c-0554-45c0-9720-b986c8c2341c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.366049 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038c057c-0554-45c0-9720-b986c8c2341c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.375329 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 83/165] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/role_assignments?user.id=0d198e449ccb450a97886efab230ca66&scope.project.id=f4779a5fd09a4c01853830d4bee9d75e&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:54.381437 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c057c-0554-45c0-9720-b986c8c2341c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:54.384672 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038c057c-0554-45c0-9720-b986c8c2341c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:54.395959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 83/166] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 04:15:54.401595 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1ce39-6fe4-42ce-8266-07a0de5b4980 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.412552 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1ce39-6fe4-42ce-8266-07a0de5b4980 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.417317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6e363-bbf3-47c7-a845-fa94c22b65a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.418182 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6e363-bbf3-47c7-a845-fa94c22b65a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.418453 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6e363-bbf3-47c7-a845-fa94c22b65a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.418722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6e363-bbf3-47c7-a845-fa94c22b65a4 admin admin] PATH_INFO: `/v3/projects/1dbeaee7967d44f2b7cdfc56ef753ef9` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.419971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6e363-bbf3-47c7-a845-fa94c22b65a4 admin admin] RBAC: Authorizing `identity:get_project(project_id=1dbeaee7967d44f2b7cdfc56ef753ef9)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:54.422123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6e363-bbf3-47c7-a845-fa94c22b65a4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:54.424265 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 84/167] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/projects/1dbeaee7967d44f2b7cdfc56ef753ef9 => generated 312 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:54.430162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c057c-0554-45c0-9720-b986c8c2341c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.440107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038c057c-0554-45c0-9720-b986c8c2341c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.445733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e43478-f0ed-4d99-aaa7-5da5e1cb1b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.446408 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e43478-f0ed-4d99-aaa7-5da5e1cb1b02 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.446733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e43478-f0ed-4d99-aaa7-5da5e1cb1b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.446960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e43478-f0ed-4d99-aaa7-5da5e1cb1b02 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.447896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e43478-f0ed-4d99-aaa7-5da5e1cb1b02 admin admin] RBAC: Adding query filter params (role.id=ca6edcc85e3841d9bebb1b58cecb96d3, scope.project.id=1dbeaee7967d44f2b7cdfc56ef753ef9, user.id=07fc48f86c42414a9ed416bfe9660e3f) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:54.448260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e43478-f0ed-4d99-aaa7-5da5e1cb1b02 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:54.450327 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e43478-f0ed-4d99-aaa7-5da5e1cb1b02 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:54.458078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 84/168] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/role_assignments?user.id=07fc48f86c42414a9ed416bfe9660e3f&scope.project.id=1dbeaee7967d44f2b7cdfc56ef753ef9&role.id=ca6edcc85e3841d9bebb1b58cecb96d3 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:54.737227 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d52a1-3841-40b6-b2d5-07d880bb336c None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.737623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d52a1-3841-40b6-b2d5-07d880bb336c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.738490 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d52a1-3841-40b6-b2d5-07d880bb336c None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.740479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 85/169] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:54.745697 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546a31f-bb4f-4a22-a9c9-b501c2b718bb None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.745991 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546a31f-bb4f-4a22-a9c9-b501c2b718bb None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.746273 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546a31f-bb4f-4a22-a9c9-b501c2b718bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.764061 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-b546a31f-bb4f-4a22-a9c9-b501c2b718bb None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:54.765237 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b546a31f-bb4f-4a22-a9c9-b501c2b718bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:54.773115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 85/170] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:54 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:54.796534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d52a1-3841-40b6-b2d5-07d880bb336c None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.809711 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d52a1-3841-40b6-b2d5-07d880bb336c None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.813917 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dd321-839e-4c31-b65b-c8e6c5e7ce2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.814684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dd321-839e-4c31-b65b-c8e6c5e7ce2d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.814965 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dd321-839e-4c31-b65b-c8e6c5e7ce2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.815262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0dd321-839e-4c31-b65b-c8e6c5e7ce2d admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.826452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0dd321-839e-4c31-b65b-c8e6c5e7ce2d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:54.833771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-cd0dd321-839e-4c31-b65b-c8e6c5e7ce2d admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 04:15:54.835045 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 86/171] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:15:54.841031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546a31f-bb4f-4a22-a9c9-b501c2b718bb None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.850831 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546a31f-bb4f-4a22-a9c9-b501c2b718bb None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.855358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef31efd-b99f-479a-ad77-3f8f180fcf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.856098 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef31efd-b99f-479a-ad77-3f8f180fcf66 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.856448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef31efd-b99f-479a-ad77-3f8f180fcf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.856789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef31efd-b99f-479a-ad77-3f8f180fcf66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.857628 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef31efd-b99f-479a-ad77-3f8f180fcf66 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:54.857999 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef31efd-b99f-479a-ad77-3f8f180fcf66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:54.859691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef31efd-b99f-479a-ad77-3f8f180fcf66 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:54.868929 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 86/172] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:54.874344 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dd321-839e-4c31-b65b-c8e6c5e7ce2d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.884800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0dd321-839e-4c31-b65b-c8e6c5e7ce2d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.889034 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24f9a2-5b63-45e6-b408-827832dbb0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.889879 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24f9a2-5b63-45e6-b408-827832dbb0a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.890162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24f9a2-5b63-45e6-b408-827832dbb0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.890438 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b24f9a2-5b63-45e6-b408-827832dbb0a7 admin admin] PATH_INFO: `/v3/users/8578f6ce0ee642909674ff1a9a329f44` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.891661 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24f9a2-5b63-45e6-b408-827832dbb0a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=8578f6ce0ee642909674ff1a9a329f44)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:54.893815 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b24f9a2-5b63-45e6-b408-827832dbb0a7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:54.895784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 87/173] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/users/8578f6ce0ee642909674ff1a9a329f44 => generated 289 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:54.900920 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef31efd-b99f-479a-ad77-3f8f180fcf66 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.910896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef31efd-b99f-479a-ad77-3f8f180fcf66 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.915148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48b36f-c9cf-48b1-85ad-3ba575114e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.916008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48b36f-c9cf-48b1-85ad-3ba575114e6e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.916287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48b36f-c9cf-48b1-85ad-3ba575114e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.916557 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48b36f-c9cf-48b1-85ad-3ba575114e6e admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.917740 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48b36f-c9cf-48b1-85ad-3ba575114e6e admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:54.919810 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48b36f-c9cf-48b1-85ad-3ba575114e6e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:54.921428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 87/174] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:54 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:54.927277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24f9a2-5b63-45e6-b408-827832dbb0a7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:54.936961 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b24f9a2-5b63-45e6-b408-827832dbb0a7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:54.941503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6271953f-e80f-4ff7-b4df-69ce847ade4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:54.942397 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271953f-e80f-4ff7-b4df-69ce847ade4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:54.942689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271953f-e80f-4ff7-b4df-69ce847ade4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:54.942968 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6271953f-e80f-4ff7-b4df-69ce847ade4f admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e/users/8578f6ce0ee642909674ff1a9a329f44/roles/6f527e6f2b2041689856666de79d95a3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:54.944963 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271953f-e80f-4ff7-b4df-69ce847ade4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4779a5fd09a4c01853830d4bee9d75e, user_id=8578f6ce0ee642909674ff1a9a329f44, role_id=6f527e6f2b2041689856666de79d95a3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:54.947624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6271953f-e80f-4ff7-b4df-69ce847ade4f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:55.062850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 88/175] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:15:54 2022] PUT /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e/users/8578f6ce0ee642909674ff1a9a329f44/roles/6f527e6f2b2041689856666de79d95a3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:15:55.104289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc4b42-7fbf-4136-a367-84e52e3b548e None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:55.104808 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc4b42-7fbf-4136-a367-84e52e3b548e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:55.104913 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc4b42-7fbf-4136-a367-84e52e3b548e None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:55.106638 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 88/176] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:55.112356 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e8b73-9d4b-4159-bb6b-e0a120e22eb9 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:55.112644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e8b73-9d4b-4159-bb6b-e0a120e22eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:55.112970 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382e8b73-9d4b-4159-bb6b-e0a120e22eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:55.131763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-382e8b73-9d4b-4159-bb6b-e0a120e22eb9 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:55.132994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-382e8b73-9d4b-4159-bb6b-e0a120e22eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:55.193601 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 89/177] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:55.219201 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc4b42-7fbf-4136-a367-84e52e3b548e None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:55.232220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc4b42-7fbf-4136-a367-84e52e3b548e None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:55.236702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be1c4f-eade-4a42-8e8d-f9771bb224ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:55.237476 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be1c4f-eade-4a42-8e8d-f9771bb224ff admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:55.238372 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be1c4f-eade-4a42-8e8d-f9771bb224ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:55.238786 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be1c4f-eade-4a42-8e8d-f9771bb224ff admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:55.240151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be1c4f-eade-4a42-8e8d-f9771bb224ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:55.241825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be1c4f-eade-4a42-8e8d-f9771bb224ff admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:55.243440 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 89/178] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:15:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:55.248800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e8b73-9d4b-4159-bb6b-e0a120e22eb9 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:55.258549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382e8b73-9d4b-4159-bb6b-e0a120e22eb9 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:55.262799 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74606b99-f20e-410a-a80f-7587cb7d99b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:55.263486 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74606b99-f20e-410a-a80f-7587cb7d99b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:55.263766 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74606b99-f20e-410a-a80f-7587cb7d99b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:55.264037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74606b99-f20e-410a-a80f-7587cb7d99b6 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:55.264771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74606b99-f20e-410a-a80f-7587cb7d99b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:55.265786 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-74606b99-f20e-410a-a80f-7587cb7d99b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:15:55.265786 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:15:55.265786 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:15:55.266978 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74606b99-f20e-410a-a80f-7587cb7d99b6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:55.371025 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 90/179] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:15:55 2022] POST /identity/v3/users => generated 283 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:15:57.287403 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e56e8-12bd-4c23-a760-07ef385f6917 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.288278 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e56e8-12bd-4c23-a760-07ef385f6917 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.288754 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e56e8-12bd-4c23-a760-07ef385f6917 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.290823 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 90/180] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:57.296470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaa634-1f24-4dca-ab67-75e1d5872988 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.296906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaa634-1f24-4dca-ab67-75e1d5872988 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.297076 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eaa634-1f24-4dca-ab67-75e1d5872988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.315607 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-93eaa634-1f24-4dca-ab67-75e1d5872988 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:57.316904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-93eaa634-1f24-4dca-ab67-75e1d5872988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:57.324834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 91/181] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:57.349510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e56e8-12bd-4c23-a760-07ef385f6917 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:57.365287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e56e8-12bd-4c23-a760-07ef385f6917 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:57.369943 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcbe69-fc63-4430-9e5f-2fc174aa5c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:57.370960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcbe69-fc63-4430-9e5f-2fc174aa5c93 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.371442 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcbe69-fc63-4430-9e5f-2fc174aa5c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.371894 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcbe69-fc63-4430-9e5f-2fc174aa5c93 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.383339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcbe69-fc63-4430-9e5f-2fc174aa5c93 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:57.390534 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-cedcbe69-fc63-4430-9e5f-2fc174aa5c93 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 04:15:57.391985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 91/182] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:15:57.398521 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaa634-1f24-4dca-ab67-75e1d5872988 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:57.407949 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eaa634-1f24-4dca-ab67-75e1d5872988 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:57.412716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f45f4-b009-4b68-a5c2-ef2a48053958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:57.413598 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f45f4-b009-4b68-a5c2-ef2a48053958 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.414070 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f45f4-b009-4b68-a5c2-ef2a48053958 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.414517 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f45f4-b009-4b68-a5c2-ef2a48053958 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.415477 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f45f4-b009-4b68-a5c2-ef2a48053958 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:57.415955 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f45f4-b009-4b68-a5c2-ef2a48053958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:57.417744 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f45f4-b009-4b68-a5c2-ef2a48053958 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:57.427504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 92/183] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:15:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:57.433642 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcbe69-fc63-4430-9e5f-2fc174aa5c93 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:57.444933 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcbe69-fc63-4430-9e5f-2fc174aa5c93 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:57.449833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3030b8-bacf-4749-a414-cc76afc67fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:57.450724 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3030b8-bacf-4749-a414-cc76afc67fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.451007 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3030b8-bacf-4749-a414-cc76afc67fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.451314 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3030b8-bacf-4749-a414-cc76afc67fc1 admin admin] PATH_INFO: `/v3/users/8578f6ce0ee642909674ff1a9a329f44` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.452641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3030b8-bacf-4749-a414-cc76afc67fc1 admin admin] RBAC: Authorizing `identity:get_user(user_id=8578f6ce0ee642909674ff1a9a329f44)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:57.454869 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3030b8-bacf-4749-a414-cc76afc67fc1 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:57.457570 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 92/184] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:57 2022] GET /identity/v3/users/8578f6ce0ee642909674ff1a9a329f44 => generated 289 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:57.463522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f45f4-b009-4b68-a5c2-ef2a48053958 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:57.474013 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f45f4-b009-4b68-a5c2-ef2a48053958 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:57.478470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56035b22-de79-4e15-b6d1-da62e193e4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:57.479116 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56035b22-de79-4e15-b6d1-da62e193e4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.479433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56035b22-de79-4e15-b6d1-da62e193e4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.479711 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56035b22-de79-4e15-b6d1-da62e193e4a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.488037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56035b22-de79-4e15-b6d1-da62e193e4a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:57.489788 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56035b22-de79-4e15-b6d1-da62e193e4a2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:57.498921 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 93/185] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:15:57.504894 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3030b8-bacf-4749-a414-cc76afc67fc1 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:57.514967 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3030b8-bacf-4749-a414-cc76afc67fc1 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:57.520277 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df665803-d4c2-4ffa-b50f-996439cdcd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:57.521120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df665803-d4c2-4ffa-b50f-996439cdcd0c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.521436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df665803-d4c2-4ffa-b50f-996439cdcd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.526360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df665803-d4c2-4ffa-b50f-996439cdcd0c admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.526360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df665803-d4c2-4ffa-b50f-996439cdcd0c admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:57.526360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df665803-d4c2-4ffa-b50f-996439cdcd0c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:57.526713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 93/186] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:57 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:57.532795 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56035b22-de79-4e15-b6d1-da62e193e4a2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:57.542259 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56035b22-de79-4e15-b6d1-da62e193e4a2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:57.546744 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5092f-5418-4ba0-88fd-5a2b5dbaf3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:57.547412 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5092f-5418-4ba0-88fd-5a2b5dbaf3fb admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.547698 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5092f-5418-4ba0-88fd-5a2b5dbaf3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.547987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5092f-5418-4ba0-88fd-5a2b5dbaf3fb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.548827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5092f-5418-4ba0-88fd-5a2b5dbaf3fb admin admin] RBAC: Adding query filter params (role.id=6f527e6f2b2041689856666de79d95a3, scope.project.id=f4779a5fd09a4c01853830d4bee9d75e, user.id=8578f6ce0ee642909674ff1a9a329f44) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:57.549137 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5092f-5418-4ba0-88fd-5a2b5dbaf3fb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:57.551293 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb5092f-5418-4ba0-88fd-5a2b5dbaf3fb admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:57.557733 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 94/187] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:15:57 2022] GET /identity/v3/role_assignments?user.id=8578f6ce0ee642909674ff1a9a329f44&scope.project.id=f4779a5fd09a4c01853830d4bee9d75e&role.id=6f527e6f2b2041689856666de79d95a3 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:57.723100 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36af872-9e35-4d85-9f4e-7620012b4920 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.723525 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36af872-9e35-4d85-9f4e-7620012b4920 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.723730 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36af872-9e35-4d85-9f4e-7620012b4920 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.725506 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 94/188] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:57.731439 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121549a5-fbde-4caa-bd50-df260a971e41 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.731725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121549a5-fbde-4caa-bd50-df260a971e41 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.731995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121549a5-fbde-4caa-bd50-df260a971e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.752419 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-121549a5-fbde-4caa-bd50-df260a971e41 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:57.754324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-121549a5-fbde-4caa-bd50-df260a971e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:57.762318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 95/189] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:57.788990 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36af872-9e35-4d85-9f4e-7620012b4920 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:57.801508 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36af872-9e35-4d85-9f4e-7620012b4920 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:57.805850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1b56c-882d-43f7-831e-61abb2605969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:57.806959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1b56c-882d-43f7-831e-61abb2605969 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.807173 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1b56c-882d-43f7-831e-61abb2605969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.807539 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1b56c-882d-43f7-831e-61abb2605969 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.819175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1b56c-882d-43f7-831e-61abb2605969 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:57.826125 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-8cd1b56c-882d-43f7-831e-61abb2605969 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:15:57.827396 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 95/190] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:15:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:15:57.834269 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121549a5-fbde-4caa-bd50-df260a971e41 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:57.843969 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121549a5-fbde-4caa-bd50-df260a971e41 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:57.848551 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e5eb6-ebc2-4cc2-8548-cb2d7e4546ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:57.849335 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e5eb6-ebc2-4cc2-8548-cb2d7e4546ba admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.849687 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e5eb6-ebc2-4cc2-8548-cb2d7e4546ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.850028 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e5eb6-ebc2-4cc2-8548-cb2d7e4546ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.850922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e5eb6-ebc2-4cc2-8548-cb2d7e4546ba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:57.851554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e5eb6-ebc2-4cc2-8548-cb2d7e4546ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:57.853230 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e5eb6-ebc2-4cc2-8548-cb2d7e4546ba admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:57.862420 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 96/191] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:15:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:57.868218 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1b56c-882d-43f7-831e-61abb2605969 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:57.872331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879bef7-1be1-43a5-8c70-b51e0553c79b None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.872618 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879bef7-1be1-43a5-8c70-b51e0553c79b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.872889 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7879bef7-1be1-43a5-8c70-b51e0553c79b None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.874626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 97/192] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:15:57.875772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63319282-948f-434a-85ff-729a5e52c17d None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.876108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63319282-948f-434a-85ff-729a5e52c17d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.876383 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63319282-948f-434a-85ff-729a5e52c17d None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.878061 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 98/193] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:15:57.879828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1b56c-882d-43f7-831e-61abb2605969 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:57.880202 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7ad89-fcdb-4f52-8fb1-0973aff0a233 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.880490 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7ad89-fcdb-4f52-8fb1-0973aff0a233 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.880834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7ad89-fcdb-4f52-8fb1-0973aff0a233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.884287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d545b-3cf3-4ed1-ab21-5db34128a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:57.885133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d545b-3cf3-4ed1-ab21-5db34128a7ed admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.885417 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d545b-3cf3-4ed1-ab21-5db34128a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.885696 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d545b-3cf3-4ed1-ab21-5db34128a7ed admin admin] PATH_INFO: `/v3/users/9cfcaea566684e13972653ad21f0f65d` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.898120 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-5df7ad89-fcdb-4f52-8fb1-0973aff0a233 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:57.899329 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5df7ad89-fcdb-4f52-8fb1-0973aff0a233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:57.901119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d545b-3cf3-4ed1-ab21-5db34128a7ed admin admin] RBAC: Authorizing `identity:get_user(user_id=9cfcaea566684e13972653ad21f0f65d)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:57.903265 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d545b-3cf3-4ed1-ab21-5db34128a7ed admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:57.904908 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 96/194] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:57 2022] GET /identity/v3/users/9cfcaea566684e13972653ad21f0f65d => generated 283 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:57.906226 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc93383-48d8-42f8-baf5-b7b3f1b6d8bf None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.906580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc93383-48d8-42f8-baf5-b7b3f1b6d8bf None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.906791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc93383-48d8-42f8-baf5-b7b3f1b6d8bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.907938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 99/195] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:15:57.910642 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7ad89-fcdb-4f52-8fb1-0973aff0a233 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:57.919563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7ad89-fcdb-4f52-8fb1-0973aff0a233 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:57.923855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c829d08-902f-4e06-965c-e389d9e8bbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:57.924458 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c829d08-902f-4e06-965c-e389d9e8bbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.924566 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-ccc93383-48d8-42f8-baf5-b7b3f1b6d8bf None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:15:57.924733 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c829d08-902f-4e06-965c-e389d9e8bbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.925006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c829d08-902f-4e06-965c-e389d9e8bbe6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.926289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ccc93383-48d8-42f8-baf5-b7b3f1b6d8bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:15:57.933883 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c829d08-902f-4e06-965c-e389d9e8bbe6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:57.934296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 97/196] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:15:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:15:57.935132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc93383-48d8-42f8-baf5-b7b3f1b6d8bf None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:57.940685 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c829d08-902f-4e06-965c-e389d9e8bbe6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:57.944347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc93383-48d8-42f8-baf5-b7b3f1b6d8bf None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:57.948959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6cea9-66b3-4303-9373-ca40a40a8851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:57.949972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 100/197] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 04:15:57.950142 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6cea9-66b3-4303-9373-ca40a40a8851 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.950595 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6cea9-66b3-4303-9373-ca40a40a8851 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.950874 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b6cea9-66b3-4303-9373-ca40a40a8851 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.952147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6cea9-66b3-4303-9373-ca40a40a8851 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:57.953807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b6cea9-66b3-4303-9373-ca40a40a8851 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:57.955347 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c829d08-902f-4e06-965c-e389d9e8bbe6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:57.955458 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 98/198] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:15:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:57.957506 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6cea9-66b3-4303-9373-ca40a40a8851 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:57.964338 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c829d08-902f-4e06-965c-e389d9e8bbe6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:57.966653 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b6cea9-66b3-4303-9373-ca40a40a8851 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:57.968549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73276575-4936-4c5d-9fc7-8ccefd653335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:57.969376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276575-4936-4c5d-9fc7-8ccefd653335 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.969655 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276575-4936-4c5d-9fc7-8ccefd653335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.969926 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73276575-4936-4c5d-9fc7-8ccefd653335 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.970892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680dcc5-ec51-4d9f-acc5-144d079d060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:57.971098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73276575-4936-4c5d-9fc7-8ccefd653335 admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:57.971803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680dcc5-ec51-4d9f-acc5-144d079d060f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.972613 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680dcc5-ec51-4d9f-acc5-144d079d060f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.972893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680dcc5-ec51-4d9f-acc5-144d079d060f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.973690 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73276575-4936-4c5d-9fc7-8ccefd653335 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:57.975616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 101/199] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:57 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:57.976021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73276575-4936-4c5d-9fc7-8ccefd653335 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:57.983452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680dcc5-ec51-4d9f-acc5-144d079d060f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:15:57.984907 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73276575-4936-4c5d-9fc7-8ccefd653335 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:57.989137 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ef493-64e5-4828-9008-4e65c5a512fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:57.989734 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef493-64e5-4828-9008-4e65c5a512fd admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:57.990012 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef493-64e5-4828-9008-4e65c5a512fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:57.990281 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ef493-64e5-4828-9008-4e65c5a512fd admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:57.990767 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-7680dcc5-ec51-4d9f-acc5-144d079d060f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 04:15:57.990976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ef493-64e5-4828-9008-4e65c5a512fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:57.991947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 99/200] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:15:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:15:57.992855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ef493-64e5-4828-9008-4e65c5a512fd admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:57.997086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680dcc5-ec51-4d9f-acc5-144d079d060f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:58.007565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680dcc5-ec51-4d9f-acc5-144d079d060f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:58.011892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154fcc7-e788-49d2-87a4-386a596c696d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:58.012501 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154fcc7-e788-49d2-87a4-386a596c696d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:58.013365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154fcc7-e788-49d2-87a4-386a596c696d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:58.013365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e154fcc7-e788-49d2-87a4-386a596c696d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:58.013901 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154fcc7-e788-49d2-87a4-386a596c696d admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=438e35c51ae94615bf6eb31f94403eb6, user.id=9cfcaea566684e13972653ad21f0f65d) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:58.014213 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154fcc7-e788-49d2-87a4-386a596c696d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:58.016082 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e154fcc7-e788-49d2-87a4-386a596c696d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:58.021920 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 100/201] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:15:57 2022] GET /identity/v3/role_assignments?user.id=9cfcaea566684e13972653ad21f0f65d&scope.project.id=438e35c51ae94615bf6eb31f94403eb6&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:58.022728 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154fcc7-e788-49d2-87a4-386a596c696d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:58.032408 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e154fcc7-e788-49d2-87a4-386a596c696d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:58.037050 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd054f2-d7f4-4aaa-a571-14db7e10452e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:58.037728 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd054f2-d7f4-4aaa-a571-14db7e10452e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:58.038002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd054f2-d7f4-4aaa-a571-14db7e10452e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:58.038324 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd054f2-d7f4-4aaa-a571-14db7e10452e admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:58.039162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd054f2-d7f4-4aaa-a571-14db7e10452e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:58.039443 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd054f2-d7f4-4aaa-a571-14db7e10452e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:58.041065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd054f2-d7f4-4aaa-a571-14db7e10452e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:58.051151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 101/202] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:15:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:15:58.057271 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd054f2-d7f4-4aaa-a571-14db7e10452e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:58.068114 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd054f2-d7f4-4aaa-a571-14db7e10452e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:58.072791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b1ba5-6cbc-4488-9416-4625ff5dce40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:58.073579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b1ba5-6cbc-4488-9416-4625ff5dce40 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:58.073857 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b1ba5-6cbc-4488-9416-4625ff5dce40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:58.074130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b1ba5-6cbc-4488-9416-4625ff5dce40 admin admin] PATH_INFO: `/v3/users/9cfcaea566684e13972653ad21f0f65d` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:58.075479 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b1ba5-6cbc-4488-9416-4625ff5dce40 admin admin] RBAC: Authorizing `identity:get_user(user_id=9cfcaea566684e13972653ad21f0f65d)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:58.077624 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b1ba5-6cbc-4488-9416-4625ff5dce40 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:58.079363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 102/203] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:15:57 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:15:58.082569 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 102/204] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:15:58 2022] GET /identity/v3/users/9cfcaea566684e13972653ad21f0f65d => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:58.085422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ef493-64e5-4828-9008-4e65c5a512fd admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:58.096119 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ef493-64e5-4828-9008-4e65c5a512fd admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:58.101491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce25f68-4777-493e-aa17-f60380e9920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:58.102175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce25f68-4777-493e-aa17-f60380e9920b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:58.102462 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce25f68-4777-493e-aa17-f60380e9920b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:58.102738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce25f68-4777-493e-aa17-f60380e9920b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:58.112040 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce25f68-4777-493e-aa17-f60380e9920b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:58.114413 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce25f68-4777-493e-aa17-f60380e9920b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:58.125103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 103/205] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:15:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:15:58.131820 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b1ba5-6cbc-4488-9416-4625ff5dce40 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:58.142317 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b1ba5-6cbc-4488-9416-4625ff5dce40 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:58.147421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa94bed1-d643-45a9-a9be-b0cf15caa08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:58.148311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94bed1-d643-45a9-a9be-b0cf15caa08a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:58.148587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94bed1-d643-45a9-a9be-b0cf15caa08a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:58.148866 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa94bed1-d643-45a9-a9be-b0cf15caa08a admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:58.150177 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94bed1-d643-45a9-a9be-b0cf15caa08a admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:58.152321 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa94bed1-d643-45a9-a9be-b0cf15caa08a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:58.154376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 103/206] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:15:58 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:15:58.160564 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce25f68-4777-493e-aa17-f60380e9920b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:15:58.170374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce25f68-4777-493e-aa17-f60380e9920b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:15:58.175060 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f957fdb-a520-4803-b066-53b55561673d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:15:58.176350 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f957fdb-a520-4803-b066-53b55561673d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:15:58.176625 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f957fdb-a520-4803-b066-53b55561673d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:15:58.176894 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f957fdb-a520-4803-b066-53b55561673d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:15:58.177773 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f957fdb-a520-4803-b066-53b55561673d admin admin] RBAC: Adding query filter params (role.id=b9252c31847f4513a49cd10bb4f9cdaa, scope.project.id=438e35c51ae94615bf6eb31f94403eb6, user.id=9cfcaea566684e13972653ad21f0f65d) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:15:58.178082 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f957fdb-a520-4803-b066-53b55561673d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:15:58.180205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f957fdb-a520-4803-b066-53b55561673d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:15:58.187116 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 104/207] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:15:58 2022] GET /identity/v3/role_assignments?user.id=9cfcaea566684e13972653ad21f0f65d&scope.project.id=438e35c51ae94615bf6eb31f94403eb6&role.id=b9252c31847f4513a49cd10bb4f9cdaa => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:00.285209 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a428-d2d7-4747-ab61-b0209024e889 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.286172 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a428-d2d7-4747-ab61-b0209024e889 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.286658 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a428-d2d7-4747-ab61-b0209024e889 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.289140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 104/208] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:00.294991 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f7bfb-34d8-41a6-9c18-0522569ca520 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.295982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f7bfb-34d8-41a6-9c18-0522569ca520 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.296583 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f7bfb-34d8-41a6-9c18-0522569ca520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.317004 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-a10f7bfb-34d8-41a6-9c18-0522569ca520 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:00.318896 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a10f7bfb-34d8-41a6-9c18-0522569ca520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:00.327090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 105/209] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:00.350525 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454a428-d2d7-4747-ab61-b0209024e889 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.363975 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454a428-d2d7-4747-ab61-b0209024e889 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.368756 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b7a73-c473-4530-a177-17f147d4b7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.369838 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b7a73-c473-4530-a177-17f147d4b7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.370333 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b7a73-c473-4530-a177-17f147d4b7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.370804 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b7a73-c473-4530-a177-17f147d4b7d2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.383466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b7a73-c473-4530-a177-17f147d4b7d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:00.390785 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-d45b7a73-c473-4530-a177-17f147d4b7d2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:16:00.392470 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 105/210] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:00.398257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f7bfb-34d8-41a6-9c18-0522569ca520 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.407786 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f7bfb-34d8-41a6-9c18-0522569ca520 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.413175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748584e-1fd0-46f1-9a53-9cb35b88e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.413852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748584e-1fd0-46f1-9a53-9cb35b88e043 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.414135 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748584e-1fd0-46f1-9a53-9cb35b88e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.414409 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748584e-1fd0-46f1-9a53-9cb35b88e043 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.415188 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748584e-1fd0-46f1-9a53-9cb35b88e043 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:00.415526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748584e-1fd0-46f1-9a53-9cb35b88e043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:00.417159 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748584e-1fd0-46f1-9a53-9cb35b88e043 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:00.426881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 106/211] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:00.432815 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b7a73-c473-4530-a177-17f147d4b7d2 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.444072 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b7a73-c473-4530-a177-17f147d4b7d2 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.448739 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b59211-a2b9-4cc3-a21b-a59bb457282d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.449617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b59211-a2b9-4cc3-a21b-a59bb457282d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.449901 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b59211-a2b9-4cc3-a21b-a59bb457282d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.450178 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b59211-a2b9-4cc3-a21b-a59bb457282d admin admin] PATH_INFO: `/v3/users/9cfcaea566684e13972653ad21f0f65d` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.451450 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b59211-a2b9-4cc3-a21b-a59bb457282d admin admin] RBAC: Authorizing `identity:get_user(user_id=9cfcaea566684e13972653ad21f0f65d)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:00.453343 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5af88-c45f-48a6-893a-9171cdecbe5b None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.453691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b59211-a2b9-4cc3-a21b-a59bb457282d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:00.454561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5af88-c45f-48a6-893a-9171cdecbe5b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.455131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5af88-c45f-48a6-893a-9171cdecbe5b None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.455563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 106/212] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/users/9cfcaea566684e13972653ad21f0f65d => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:00.457956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 107/213] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:00.461725 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b59211-a2b9-4cc3-a21b-a59bb457282d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.464186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b6f95-99a5-43bf-b714-c3983ad2fb98 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.464470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b6f95-99a5-43bf-b714-c3983ad2fb98 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.464746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b6f95-99a5-43bf-b714-c3983ad2fb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.478040 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b59211-a2b9-4cc3-a21b-a59bb457282d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.482926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70bc54-30a2-4dd9-8429-73fe7dcdd626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.484103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70bc54-30a2-4dd9-8429-73fe7dcdd626 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.484533 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70bc54-30a2-4dd9-8429-73fe7dcdd626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.484974 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de70bc54-30a2-4dd9-8429-73fe7dcdd626 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.486314 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70bc54-30a2-4dd9-8429-73fe7dcdd626 admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:00.489202 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de70bc54-30a2-4dd9-8429-73fe7dcdd626 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:00.491135 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 107/214] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:00.497631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70bc54-30a2-4dd9-8429-73fe7dcdd626 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.508435 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-791b6f95-99a5-43bf-b714-c3983ad2fb98 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:00.508931 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de70bc54-30a2-4dd9-8429-73fe7dcdd626 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.510436 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-791b6f95-99a5-43bf-b714-c3983ad2fb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:00.513725 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee2278-8648-4de0-97e1-63d8872364e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.514626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee2278-8648-4de0-97e1-63d8872364e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.514889 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee2278-8648-4de0-97e1-63d8872364e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.515162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee2278-8648-4de0-97e1-63d8872364e8 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6/users/9cfcaea566684e13972653ad21f0f65d/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.517327 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee2278-8648-4de0-97e1-63d8872364e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=438e35c51ae94615bf6eb31f94403eb6, user_id=9cfcaea566684e13972653ad21f0f65d, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:00.520133 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 108/215] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:00.523357 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee2278-8648-4de0-97e1-63d8872364e8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:00.540644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b4d2b-5e1d-46ce-bb56-370fd129c599 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.540644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b4d2b-5e1d-46ce-bb56-370fd129c599 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.540644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b4d2b-5e1d-46ce-bb56-370fd129c599 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.540644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 109/216] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:00.542921 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb7c7e-8a82-4a50-96f7-9ec0c982bdd5 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.543205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb7c7e-8a82-4a50-96f7-9ec0c982bdd5 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.543513 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb7c7e-8a82-4a50-96f7-9ec0c982bdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.562472 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-40fb7c7e-8a82-4a50-96f7-9ec0c982bdd5 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:00.563681 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-40fb7c7e-8a82-4a50-96f7-9ec0c982bdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:00.572155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 110/217] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:00.576650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb7c7e-8a82-4a50-96f7-9ec0c982bdd5 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.586681 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb7c7e-8a82-4a50-96f7-9ec0c982bdd5 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.591100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87607434-02a5-406d-b1a2-aab1bb795760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.591938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87607434-02a5-406d-b1a2-aab1bb795760 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.592219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87607434-02a5-406d-b1a2-aab1bb795760 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.592607 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87607434-02a5-406d-b1a2-aab1bb795760 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.594782 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 108/218] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:16:00 2022] PUT /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6/users/9cfcaea566684e13972653ad21f0f65d/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:00.596124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c672a-4f18-498f-91bc-ad76e6b68a21 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.596408 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c672a-4f18-498f-91bc-ad76e6b68a21 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.596679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c672a-4f18-498f-91bc-ad76e6b68a21 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.599440 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 109/219] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:00.602304 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c672a-4f18-498f-91bc-ad76e6b68a21 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.615144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87607434-02a5-406d-b1a2-aab1bb795760 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:00.623594 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-87607434-02a5-406d-b1a2-aab1bb795760 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 04:16:00.625093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 111/220] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:00.632074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42f01-ad05-449e-9fe8-31db53e72037 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.632869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42f01-ad05-449e-9fe8-31db53e72037 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.633289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42f01-ad05-449e-9fe8-31db53e72037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.656700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-98b42f01-ad05-449e-9fe8-31db53e72037 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:00.657942 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-98b42f01-ad05-449e-9fe8-31db53e72037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:00.677103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c672a-4f18-498f-91bc-ad76e6b68a21 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.683067 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d235e-c58d-4bea-8663-ca8396e0f8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.684420 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d235e-c58d-4bea-8663-ca8396e0f8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.684896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d235e-c58d-4bea-8663-ca8396e0f8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.685271 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d235e-c58d-4bea-8663-ca8396e0f8b9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.698580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d235e-c58d-4bea-8663-ca8396e0f8b9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:00.706284 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-db7d235e-c58d-4bea-8663-ca8396e0f8b9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:16:00.711347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 110/221] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:00.711347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d235e-c58d-4bea-8663-ca8396e0f8b9 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.721996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d235e-c58d-4bea-8663-ca8396e0f8b9 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.727700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed824-9cf9-45d3-91ce-f374892c7ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.728963 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed824-9cf9-45d3-91ce-f374892c7ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.729412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed824-9cf9-45d3-91ce-f374892c7ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.729842 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed824-9cf9-45d3-91ce-f374892c7ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.730690 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eed824-9cf9-45d3-91ce-f374892c7ea8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:00.731001 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eed824-9cf9-45d3-91ce-f374892c7ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:00.733750 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eed824-9cf9-45d3-91ce-f374892c7ea8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:00.739578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 112/222] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:00.739578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b42f01-ad05-449e-9fe8-31db53e72037 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.747508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b42f01-ad05-449e-9fe8-31db53e72037 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.748792 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 111/223] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:00.755384 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed824-9cf9-45d3-91ce-f374892c7ea8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.757674 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c6f6e-f3ad-4892-bd13-395666788eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.758355 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6f6e-f3ad-4892-bd13-395666788eee admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.758632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6f6e-f3ad-4892-bd13-395666788eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.758903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c6f6e-f3ad-4892-bd13-395666788eee admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.759721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c6f6e-f3ad-4892-bd13-395666788eee admin admin] RBAC: Adding query filter params (name=member) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:00.760146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c6f6e-f3ad-4892-bd13-395666788eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:00.761776 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c6f6e-f3ad-4892-bd13-395666788eee admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:00.767467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed824-9cf9-45d3-91ce-f374892c7ea8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.773293 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 113/224] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:00.774354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c6f6e-f3ad-4892-bd13-395666788eee admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.775442 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e205a7b-6a82-452c-819a-82571dc0ece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.776417 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205a7b-6a82-452c-819a-82571dc0ece8 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.776686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205a7b-6a82-452c-819a-82571dc0ece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.776950 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e205a7b-6a82-452c-819a-82571dc0ece8 admin admin] PATH_INFO: `/v3/users/9cfcaea566684e13972653ad21f0f65d` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.778332 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e205a7b-6a82-452c-819a-82571dc0ece8 admin admin] RBAC: Authorizing `identity:get_user(user_id=9cfcaea566684e13972653ad21f0f65d)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:00.781184 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e205a7b-6a82-452c-819a-82571dc0ece8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:00.783016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 112/225] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/users/9cfcaea566684e13972653ad21f0f65d => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:00.787316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e205a7b-6a82-452c-819a-82571dc0ece8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.792833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c6f6e-f3ad-4892-bd13-395666788eee admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.796612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e205a7b-6a82-452c-819a-82571dc0ece8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.799379 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ed7b8-43ac-4d3f-b102-0cdac8eb1a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.801441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e923310-85f7-4daa-8dc1-e197441bdece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.801903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ed7b8-43ac-4d3f-b102-0cdac8eb1a3a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.802188 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ed7b8-43ac-4d3f-b102-0cdac8eb1a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.802459 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ed7b8-43ac-4d3f-b102-0cdac8eb1a3a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.802704 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e923310-85f7-4daa-8dc1-e197441bdece admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.803069 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e923310-85f7-4daa-8dc1-e197441bdece admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.803540 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e923310-85f7-4daa-8dc1-e197441bdece admin admin] PATH_INFO: `/v3/users/cc1f334b9b0f46598d19a542e8677bb0` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.803751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ed7b8-43ac-4d3f-b102-0cdac8eb1a3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:00.805526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ed7b8-43ac-4d3f-b102-0cdac8eb1a3a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:00.807537 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 114/226] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:00.808304 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ed7b8-43ac-4d3f-b102-0cdac8eb1a3a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.818403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ed7b8-43ac-4d3f-b102-0cdac8eb1a3a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.820875 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e923310-85f7-4daa-8dc1-e197441bdece admin admin] RBAC: Authorizing `identity:get_user(user_id=cc1f334b9b0f46598d19a542e8677bb0)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:00.823090 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e923310-85f7-4daa-8dc1-e197441bdece admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:00.823546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb05bdb-0179-4aa8-b60a-1cac417d93da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.824390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb05bdb-0179-4aa8-b60a-1cac417d93da admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.824665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb05bdb-0179-4aa8-b60a-1cac417d93da admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.824934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb05bdb-0179-4aa8-b60a-1cac417d93da admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.826251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 113/227] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/users/cc1f334b9b0f46598d19a542e8677bb0 => generated 297 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:00.826361 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb05bdb-0179-4aa8-b60a-1cac417d93da admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:00.826443 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e923310-85f7-4daa-8dc1-e197441bdece admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.828286 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb05bdb-0179-4aa8-b60a-1cac417d93da admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:00.830081 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 115/228] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:00.833294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb05bdb-0179-4aa8-b60a-1cac417d93da admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.841658 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e923310-85f7-4daa-8dc1-e197441bdece admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.846214 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd92348-f0fb-4db4-a033-7ed8dd275db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.846918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd92348-f0fb-4db4-a033-7ed8dd275db0 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.847202 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd92348-f0fb-4db4-a033-7ed8dd275db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.847505 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd92348-f0fb-4db4-a033-7ed8dd275db0 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.848243 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd92348-f0fb-4db4-a033-7ed8dd275db0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:00.848829 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb05bdb-0179-4aa8-b60a-1cac417d93da admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.850150 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd92348-f0fb-4db4-a033-7ed8dd275db0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:00.853872 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63f8f5-aa7c-418e-bad5-1b73c2056ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.854553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f8f5-aa7c-418e-bad5-1b73c2056ffd admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.854985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f8f5-aa7c-418e-bad5-1b73c2056ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.855354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd63f8f5-aa7c-418e-bad5-1b73c2056ffd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.864532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63f8f5-aa7c-418e-bad5-1b73c2056ffd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:00.867217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd63f8f5-aa7c-418e-bad5-1b73c2056ffd admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:00.879988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 116/229] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 04:16:00.881598 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63f8f5-aa7c-418e-bad5-1b73c2056ffd admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.895833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd63f8f5-aa7c-418e-bad5-1b73c2056ffd admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.900364 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc8849a-6e64-4fa0-b11a-6698a96bb249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.901231 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8849a-6e64-4fa0-b11a-6698a96bb249 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.901559 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8849a-6e64-4fa0-b11a-6698a96bb249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.901828 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc8849a-6e64-4fa0-b11a-6698a96bb249 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6/users/9cfcaea566684e13972653ad21f0f65d/roles/b9252c31847f4513a49cd10bb4f9cdaa` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.904051 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8849a-6e64-4fa0-b11a-6698a96bb249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=438e35c51ae94615bf6eb31f94403eb6, user_id=9cfcaea566684e13972653ad21f0f65d, role_id=b9252c31847f4513a49cd10bb4f9cdaa)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:00.906686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc8849a-6e64-4fa0-b11a-6698a96bb249 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:00.953670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 114/230] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:16:00 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:00.953670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd92348-f0fb-4db4-a033-7ed8dd275db0 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.965262 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd92348-f0fb-4db4-a033-7ed8dd275db0 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:00.970005 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39928f46-d38a-4454-87c0-26158d8756a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:00.970884 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39928f46-d38a-4454-87c0-26158d8756a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:00.971168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39928f46-d38a-4454-87c0-26158d8756a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:00.971489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39928f46-d38a-4454-87c0-26158d8756a8 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:00.972851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39928f46-d38a-4454-87c0-26158d8756a8 admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:00.974922 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39928f46-d38a-4454-87c0-26158d8756a8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:00.976969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 115/231] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:00.982968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39928f46-d38a-4454-87c0-26158d8756a8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:00.987613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 117/232] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:16:00 2022] PUT /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6/users/9cfcaea566684e13972653ad21f0f65d/roles/b9252c31847f4513a49cd10bb4f9cdaa => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:00.993026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39928f46-d38a-4454-87c0-26158d8756a8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:01.065248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149cd446-2965-40b5-b4ef-ed8d0e1e563c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:01.066546 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cd446-2965-40b5-b4ef-ed8d0e1e563c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:01.066940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cd446-2965-40b5-b4ef-ed8d0e1e563c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:01.067349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149cd446-2965-40b5-b4ef-ed8d0e1e563c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:01.068380 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cd446-2965-40b5-b4ef-ed8d0e1e563c admin admin] RBAC: Adding query filter params (role.id=ca6edcc85e3841d9bebb1b58cecb96d3, scope.project.id=438e35c51ae94615bf6eb31f94403eb6, user.id=cc1f334b9b0f46598d19a542e8677bb0) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:01.068762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cd446-2965-40b5-b4ef-ed8d0e1e563c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:01.070930 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149cd446-2965-40b5-b4ef-ed8d0e1e563c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:01.078063 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 116/233] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:00 2022] GET /identity/v3/role_assignments?user.id=cc1f334b9b0f46598d19a542e8677bb0&scope.project.id=438e35c51ae94615bf6eb31f94403eb6&role.id=ca6edcc85e3841d9bebb1b58cecb96d3 => generated 259 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:03.239267 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd40a05-c749-40ca-a004-2788b3dfda4b None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.239778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd40a05-c749-40ca-a004-2788b3dfda4b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.239778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd40a05-c749-40ca-a004-2788b3dfda4b None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.241821 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 118/234] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:03.247664 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a6af-7e8c-4c69-9f75-af8e7a590a7f None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.248094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a6af-7e8c-4c69-9f75-af8e7a590a7f None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.248269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a6af-7e8c-4c69-9f75-af8e7a590a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.284289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-9d23a6af-7e8c-4c69-9f75-af8e7a590a7f None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:03.285734 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9d23a6af-7e8c-4c69-9f75-af8e7a590a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:03.296708 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 117/235] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (3 switches on core 0) Feb 12 04:16:03.331171 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd40a05-c749-40ca-a004-2788b3dfda4b None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:03.349294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd40a05-c749-40ca-a004-2788b3dfda4b None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:03.354396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd13d77-9638-4ccb-813d-f4ef562b2fc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:03.355174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13d77-9638-4ccb-813d-f4ef562b2fc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.355471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13d77-9638-4ccb-813d-f4ef562b2fc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.355740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd13d77-9638-4ccb-813d-f4ef562b2fc5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.371542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd13d77-9638-4ccb-813d-f4ef562b2fc5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:03.378990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-dfd13d77-9638-4ccb-813d-f4ef562b2fc5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:16:03.380258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 119/236] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:03.385993 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23a6af-7e8c-4c69-9f75-af8e7a590a7f None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:03.398684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23a6af-7e8c-4c69-9f75-af8e7a590a7f None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:03.412459 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3a736-7582-40bd-acea-080c6038b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:03.413134 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3a736-7582-40bd-acea-080c6038b8ab admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.413413 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3a736-7582-40bd-acea-080c6038b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.413684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3a736-7582-40bd-acea-080c6038b8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.414457 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3a736-7582-40bd-acea-080c6038b8ab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:03.414757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3a736-7582-40bd-acea-080c6038b8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:03.416449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3a736-7582-40bd-acea-080c6038b8ab admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:03.430538 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 118/237] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:03.436285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd13d77-9638-4ccb-813d-f4ef562b2fc5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:03.452308 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd13d77-9638-4ccb-813d-f4ef562b2fc5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:03.459805 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054ebc6-5d39-42d4-b32c-b27e4b727e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:03.467216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054ebc6-5d39-42d4-b32c-b27e4b727e74 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.467216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054ebc6-5d39-42d4-b32c-b27e4b727e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.467216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054ebc6-5d39-42d4-b32c-b27e4b727e74 admin admin] PATH_INFO: `/v3/users/9cfcaea566684e13972653ad21f0f65d` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.467980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054ebc6-5d39-42d4-b32c-b27e4b727e74 admin admin] RBAC: Authorizing `identity:get_user(user_id=9cfcaea566684e13972653ad21f0f65d)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:03.470129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054ebc6-5d39-42d4-b32c-b27e4b727e74 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:03.471849 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 120/238] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:03 2022] GET /identity/v3/users/9cfcaea566684e13972653ad21f0f65d => generated 283 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:03.477609 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3a736-7582-40bd-acea-080c6038b8ab admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:03.493447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3a736-7582-40bd-acea-080c6038b8ab admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:03.499542 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92deb296-dc4e-49bc-a700-ee479a976920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:03.500216 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92deb296-dc4e-49bc-a700-ee479a976920 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.500500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92deb296-dc4e-49bc-a700-ee479a976920 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.500782 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92deb296-dc4e-49bc-a700-ee479a976920 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.515467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92deb296-dc4e-49bc-a700-ee479a976920 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:03.517272 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92deb296-dc4e-49bc-a700-ee479a976920 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:03.533397 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 119/239] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 04:16:03.539251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054ebc6-5d39-42d4-b32c-b27e4b727e74 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:03.552905 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054ebc6-5d39-42d4-b32c-b27e4b727e74 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:03.563450 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225c2ed-8e27-4945-9a4d-c23f02c347f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:03.565391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225c2ed-8e27-4945-9a4d-c23f02c347f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.565391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225c2ed-8e27-4945-9a4d-c23f02c347f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.565391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225c2ed-8e27-4945-9a4d-c23f02c347f0 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.567556 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225c2ed-8e27-4945-9a4d-c23f02c347f0 admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:03.569454 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4225c2ed-8e27-4945-9a4d-c23f02c347f0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:03.572198 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 121/240] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:03 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:03.576948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92deb296-dc4e-49bc-a700-ee479a976920 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:03.589230 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92deb296-dc4e-49bc-a700-ee479a976920 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:03.604829 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaecf557-cb00-492d-8554-fbec7bb3a82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:03.605495 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecf557-cb00-492d-8554-fbec7bb3a82d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.605777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecf557-cb00-492d-8554-fbec7bb3a82d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.606046 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaecf557-cb00-492d-8554-fbec7bb3a82d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.606908 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecf557-cb00-492d-8554-fbec7bb3a82d admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=438e35c51ae94615bf6eb31f94403eb6, user.id=9cfcaea566684e13972653ad21f0f65d) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:03.607217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecf557-cb00-492d-8554-fbec7bb3a82d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:03.609080 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaecf557-cb00-492d-8554-fbec7bb3a82d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:03.619855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 120/241] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:03 2022] GET /identity/v3/role_assignments?user.id=9cfcaea566684e13972653ad21f0f65d&scope.project.id=438e35c51ae94615bf6eb31f94403eb6&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 608 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:03.628863 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59eb85-d458-40d3-a645-9c8c13d9496f None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.629184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59eb85-d458-40d3-a645-9c8c13d9496f None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.629411 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59eb85-d458-40d3-a645-9c8c13d9496f None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.631585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 122/242] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:03.637600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12332b1b-485f-4ae7-bc4a-728768c06cd7 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.637897 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12332b1b-485f-4ae7-bc4a-728768c06cd7 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.639473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12332b1b-485f-4ae7-bc4a-728768c06cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.665482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-12332b1b-485f-4ae7-bc4a-728768c06cd7 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:03.666748 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-12332b1b-485f-4ae7-bc4a-728768c06cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:03.685320 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 121/243] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:03.732770 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59eb85-d458-40d3-a645-9c8c13d9496f None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:03.749721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59eb85-d458-40d3-a645-9c8c13d9496f None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:03.757589 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0d16b-bece-4a24-bcc1-6db6b0f52385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:03.758419 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0d16b-bece-4a24-bcc1-6db6b0f52385 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.758698 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0d16b-bece-4a24-bcc1-6db6b0f52385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.758972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0d16b-bece-4a24-bcc1-6db6b0f52385 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.785146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0d16b-bece-4a24-bcc1-6db6b0f52385 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:03.792591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-52f0d16b-bece-4a24-bcc1-6db6b0f52385 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 04:16:03.793863 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 123/244] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:03.799811 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12332b1b-485f-4ae7-bc4a-728768c06cd7 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:03.812875 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12332b1b-485f-4ae7-bc4a-728768c06cd7 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:03.821537 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05256e1a-6c29-4416-a9c7-b72a19a2eb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:03.822210 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05256e1a-6c29-4416-a9c7-b72a19a2eb98 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.822494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05256e1a-6c29-4416-a9c7-b72a19a2eb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.822772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05256e1a-6c29-4416-a9c7-b72a19a2eb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.823643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05256e1a-6c29-4416-a9c7-b72a19a2eb98 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:03.823947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05256e1a-6c29-4416-a9c7-b72a19a2eb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:03.825540 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05256e1a-6c29-4416-a9c7-b72a19a2eb98 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:03.838286 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 122/245] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:03.843972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0d16b-bece-4a24-bcc1-6db6b0f52385 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:03.858799 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0d16b-bece-4a24-bcc1-6db6b0f52385 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:03.864299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e8332-947c-41e7-a0be-74d8c38cfa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:03.865154 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e8332-947c-41e7-a0be-74d8c38cfa2e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.865431 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e8332-947c-41e7-a0be-74d8c38cfa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.865701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e8332-947c-41e7-a0be-74d8c38cfa2e admin admin] PATH_INFO: `/v3/users/9cfcaea566684e13972653ad21f0f65d` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.866910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e8332-947c-41e7-a0be-74d8c38cfa2e admin admin] RBAC: Authorizing `identity:get_user(user_id=9cfcaea566684e13972653ad21f0f65d)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:03.869064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e8332-947c-41e7-a0be-74d8c38cfa2e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:03.870650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 124/246] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:03 2022] GET /identity/v3/users/9cfcaea566684e13972653ad21f0f65d => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:03.876460 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05256e1a-6c29-4416-a9c7-b72a19a2eb98 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:03.890265 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05256e1a-6c29-4416-a9c7-b72a19a2eb98 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:03.899550 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86571b46-3afe-4399-9a25-e6ce17448fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:03.900210 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571b46-3afe-4399-9a25-e6ce17448fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.900489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571b46-3afe-4399-9a25-e6ce17448fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.900797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571b46-3afe-4399-9a25-e6ce17448fa3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.903004 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea44521-7b9d-4a82-ae37-26e318674ef5 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.903550 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea44521-7b9d-4a82-ae37-26e318674ef5 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.903989 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea44521-7b9d-4a82-ae37-26e318674ef5 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.906000 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 125/247] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:03.912479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb16d1-9312-4d57-81c9-408e967cf283 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.913032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb16d1-9312-4d57-81c9-408e967cf283 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.913132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86571b46-3afe-4399-9a25-e6ce17448fa3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:03.913583 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb16d1-9312-4d57-81c9-408e967cf283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.914862 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86571b46-3afe-4399-9a25-e6ce17448fa3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:03.924316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 123/248] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:03.930502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86571b46-3afe-4399-9a25-e6ce17448fa3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:03.939515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86571b46-3afe-4399-9a25-e6ce17448fa3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:03.940230 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c4cb16d1-9312-4d57-81c9-408e967cf283 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:03.942020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c4cb16d1-9312-4d57-81c9-408e967cf283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:03.949019 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a1121-0e9b-45e5-9f04-e3360cd4e202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:03.949881 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a1121-0e9b-45e5-9f04-e3360cd4e202 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.950158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a1121-0e9b-45e5-9f04-e3360cd4e202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.950431 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a1121-0e9b-45e5-9f04-e3360cd4e202 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.951710 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a1121-0e9b-45e5-9f04-e3360cd4e202 admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:03.959245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a1121-0e9b-45e5-9f04-e3360cd4e202 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:03.959245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 124/249] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:03 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:03.959876 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 126/250] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:03.962151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a1121-0e9b-45e5-9f04-e3360cd4e202 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:03.973577 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a1121-0e9b-45e5-9f04-e3360cd4e202 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:03.978843 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b079d-0e46-4ffd-b414-28cc944a4ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:03.980219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb16d1-9312-4d57-81c9-408e967cf283 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:03.983611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b079d-0e46-4ffd-b414-28cc944a4ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:03.984139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b079d-0e46-4ffd-b414-28cc944a4ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:03.984691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b079d-0e46-4ffd-b414-28cc944a4ed0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:03.985834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b079d-0e46-4ffd-b414-28cc944a4ed0 admin admin] RBAC: Adding query filter params (role.id=b9252c31847f4513a49cd10bb4f9cdaa, scope.project.id=438e35c51ae94615bf6eb31f94403eb6, user.id=9cfcaea566684e13972653ad21f0f65d) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:03.986220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b079d-0e46-4ffd-b414-28cc944a4ed0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:03.988834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b079d-0e46-4ffd-b414-28cc944a4ed0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:03.990549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb16d1-9312-4d57-81c9-408e967cf283 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:03.995158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 125/251] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:03 2022] GET /identity/v3/role_assignments?user.id=9cfcaea566684e13972653ad21f0f65d&scope.project.id=438e35c51ae94615bf6eb31f94403eb6&role.id=b9252c31847f4513a49cd10bb4f9cdaa => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:03.999039 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3dde9-3ce2-4418-86c4-340559beaa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:04.000191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3dde9-3ce2-4418-86c4-340559beaa97 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.000730 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3dde9-3ce2-4418-86c4-340559beaa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.001172 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce3dde9-3ce2-4418-86c4-340559beaa97 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.008979 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b10bc-ae38-465b-8dd7-ebd396755b51 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.009396 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b10bc-ae38-465b-8dd7-ebd396755b51 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.009739 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b10bc-ae38-465b-8dd7-ebd396755b51 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.011798 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 126/252] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:04.014847 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce3dde9-3ce2-4418-86c4-340559beaa97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:04.019291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24f0bd-9fb1-4d75-868e-b4b4be8d2aeb None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.019291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24f0bd-9fb1-4d75-868e-b4b4be8d2aeb None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.019291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d24f0bd-9fb1-4d75-868e-b4b4be8d2aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.025594 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-dce3dde9-3ce2-4418-86c4-340559beaa97 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:16:04.027136 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 127/253] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:04.033797 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3dde9-3ce2-4418-86c4-340559beaa97 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:04.046607 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-7d24f0bd-9fb1-4d75-868e-b4b4be8d2aeb None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:04.047988 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7d24f0bd-9fb1-4d75-868e-b4b4be8d2aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:04.051843 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce3dde9-3ce2-4418-86c4-340559beaa97 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:04.059867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 127/254] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:04.063620 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307547be-bc6b-4324-a521-113ae71ef2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:04.064451 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307547be-bc6b-4324-a521-113ae71ef2af admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.064882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307547be-bc6b-4324-a521-113ae71ef2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.065279 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307547be-bc6b-4324-a521-113ae71ef2af admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.066428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307547be-bc6b-4324-a521-113ae71ef2af admin admin] RBAC: Adding query filter params (name=member) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:04.066735 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307547be-bc6b-4324-a521-113ae71ef2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:04.068363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307547be-bc6b-4324-a521-113ae71ef2af admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:04.072436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d2ac6-643b-46f7-8c11-eb2ddb6366f1 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.072724 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d2ac6-643b-46f7-8c11-eb2ddb6366f1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.073007 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d2ac6-643b-46f7-8c11-eb2ddb6366f1 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.074867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 128/255] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:04.078668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 128/256] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:04.081836 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade9553-2512-42ca-8f46-35eede659078 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.082124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade9553-2512-42ca-8f46-35eede659078 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.082402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade9553-2512-42ca-8f46-35eede659078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.084950 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307547be-bc6b-4324-a521-113ae71ef2af admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:04.096478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307547be-bc6b-4324-a521-113ae71ef2af admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:04.101217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb01ad-09f6-4c17-a6be-3948027952f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:04.101784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-dade9553-2512-42ca-8f46-35eede659078 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:04.102098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb01ad-09f6-4c17-a6be-3948027952f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.102375 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb01ad-09f6-4c17-a6be-3948027952f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.102644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb01ad-09f6-4c17-a6be-3948027952f4 admin admin] PATH_INFO: `/v3/users/cc1f334b9b0f46598d19a542e8677bb0` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.103011 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-dade9553-2512-42ca-8f46-35eede659078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:04.103921 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb01ad-09f6-4c17-a6be-3948027952f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc1f334b9b0f46598d19a542e8677bb0)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:04.106064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb01ad-09f6-4c17-a6be-3948027952f4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:04.107952 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 129/257] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:04 2022] GET /identity/v3/users/cc1f334b9b0f46598d19a542e8677bb0 => generated 297 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:04.108627 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb01ad-09f6-4c17-a6be-3948027952f4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:04.110817 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 129/258] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:04.115433 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade9553-2512-42ca-8f46-35eede659078 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:04.124175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb01ad-09f6-4c17-a6be-3948027952f4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:04.127938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade9553-2512-42ca-8f46-35eede659078 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:04.128906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8098a1-4c0d-4c08-9dfa-83c2df3fea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:04.129711 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8098a1-4c0d-4c08-9dfa-83c2df3fea55 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.130010 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8098a1-4c0d-4c08-9dfa-83c2df3fea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.130274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8098a1-4c0d-4c08-9dfa-83c2df3fea55 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.131648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8098a1-4c0d-4c08-9dfa-83c2df3fea55 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:04.133361 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8098a1-4c0d-4c08-9dfa-83c2df3fea55 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:04.134792 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fc425-a20b-480f-9a38-fbb62b6a6bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:04.139373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 130/259] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:04.139373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8098a1-4c0d-4c08-9dfa-83c2df3fea55 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:04.140134 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fc425-a20b-480f-9a38-fbb62b6a6bcd admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.140423 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fc425-a20b-480f-9a38-fbb62b6a6bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.140703 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fc425-a20b-480f-9a38-fbb62b6a6bcd admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.142288 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fc425-a20b-480f-9a38-fbb62b6a6bcd admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:04.145005 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fc425-a20b-480f-9a38-fbb62b6a6bcd admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:04.146792 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 130/260] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:04 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:04.147573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fc425-a20b-480f-9a38-fbb62b6a6bcd admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:04.148758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8098a1-4c0d-4c08-9dfa-83c2df3fea55 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:04.153278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5c0cb-68d2-42f4-8b1c-389591be446c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:04.154115 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c0cb-68d2-42f4-8b1c-389591be446c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.154395 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c0cb-68d2-42f4-8b1c-389591be446c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.154667 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5c0cb-68d2-42f4-8b1c-389591be446c admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.162854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fc425-a20b-480f-9a38-fbb62b6a6bcd admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:04.167160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5c0cb-68d2-42f4-8b1c-389591be446c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:04.167363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2649726-b026-4958-85b6-8736dbf7cd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:04.168018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2649726-b026-4958-85b6-8736dbf7cd66 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.168304 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2649726-b026-4958-85b6-8736dbf7cd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.168580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2649726-b026-4958-85b6-8736dbf7cd66 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.169321 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2649726-b026-4958-85b6-8736dbf7cd66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:04.171286 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2649726-b026-4958-85b6-8736dbf7cd66 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:04.174252 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-eac5c0cb-68d2-42f4-8b1c-389591be446c admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 04:16:04.175834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 131/261] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:04.176407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5c0cb-68d2-42f4-8b1c-389591be446c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:04.187185 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5c0cb-68d2-42f4-8b1c-389591be446c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:04.191680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a965dd-dd0a-4c26-a9df-7bf6c2fdfdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:04.192552 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a965dd-dd0a-4c26-a9df-7bf6c2fdfdb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.193489 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a965dd-dd0a-4c26-a9df-7bf6c2fdfdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.193489 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a965dd-dd0a-4c26-a9df-7bf6c2fdfdb5 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6/users/cc1f334b9b0f46598d19a542e8677bb0/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.195480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a965dd-dd0a-4c26-a9df-7bf6c2fdfdb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=438e35c51ae94615bf6eb31f94403eb6, user_id=cc1f334b9b0f46598d19a542e8677bb0, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:04.198239 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a965dd-dd0a-4c26-a9df-7bf6c2fdfdb5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:04.291825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 131/262] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:16:04 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:04.292737 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2649726-b026-4958-85b6-8736dbf7cd66 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:04.302459 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 132/263] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:16:04 2022] PUT /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6/users/cc1f334b9b0f46598d19a542e8677bb0/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:04.310073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2649726-b026-4958-85b6-8736dbf7cd66 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:04.371141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34220-fe0e-450e-ad78-6f3f10a5664a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:04.371855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34220-fe0e-450e-ad78-6f3f10a5664a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.372136 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34220-fe0e-450e-ad78-6f3f10a5664a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.372412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34220-fe0e-450e-ad78-6f3f10a5664a admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.373190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b34220-fe0e-450e-ad78-6f3f10a5664a admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:04.373496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b34220-fe0e-450e-ad78-6f3f10a5664a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:04.375153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b34220-fe0e-450e-ad78-6f3f10a5664a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:04.385084 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 132/264] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:04.393407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a965dd-dd0a-4c26-a9df-7bf6c2fdfdb5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:04.410827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a965dd-dd0a-4c26-a9df-7bf6c2fdfdb5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:04.417333 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99040f-2d1f-485c-ac1f-1949b108b50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:04.418697 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99040f-2d1f-485c-ac1f-1949b108b50c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.419113 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99040f-2d1f-485c-ac1f-1949b108b50c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.419573 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99040f-2d1f-485c-ac1f-1949b108b50c admin admin] PATH_INFO: `/v3/users/0b8b7415b13341e0bf0ec6e1a2c1eb8b` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.444306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99040f-2d1f-485c-ac1f-1949b108b50c admin admin] RBAC: Authorizing `identity:get_user(user_id=0b8b7415b13341e0bf0ec6e1a2c1eb8b)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:04.448386 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99040f-2d1f-485c-ac1f-1949b108b50c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:04.451539 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 133/265] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:04 2022] GET /identity/v3/users/0b8b7415b13341e0bf0ec6e1a2c1eb8b => generated 297 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:04.458066 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34220-fe0e-450e-ad78-6f3f10a5664a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:04.468566 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34220-fe0e-450e-ad78-6f3f10a5664a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:04.473500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0238e25-1b9a-4407-98b9-61e0b72d91f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:04.474275 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0238e25-1b9a-4407-98b9-61e0b72d91f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.474634 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0238e25-1b9a-4407-98b9-61e0b72d91f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.474983 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0238e25-1b9a-4407-98b9-61e0b72d91f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.484170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0238e25-1b9a-4407-98b9-61e0b72d91f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:04.486113 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0238e25-1b9a-4407-98b9-61e0b72d91f6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:04.496901 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 133/266] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 04:16:04.503465 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99040f-2d1f-485c-ac1f-1949b108b50c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:04.513312 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99040f-2d1f-485c-ac1f-1949b108b50c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:04.517754 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ed21ec-e5c7-467b-bae7-9f2b50a41f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:04.518755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed21ec-e5c7-467b-bae7-9f2b50a41f44 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.519672 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed21ec-e5c7-467b-bae7-9f2b50a41f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.520164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ed21ec-e5c7-467b-bae7-9f2b50a41f44 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.521403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed21ec-e5c7-467b-bae7-9f2b50a41f44 admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:04.523495 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ed21ec-e5c7-467b-bae7-9f2b50a41f44 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:04.525166 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 134/267] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:04 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:04.531043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0238e25-1b9a-4407-98b9-61e0b72d91f6 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:04.540515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0238e25-1b9a-4407-98b9-61e0b72d91f6 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:04.546554 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d30466-c588-48a4-90f0-940104bdc844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:04.547197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30466-c588-48a4-90f0-940104bdc844 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:04.547503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30466-c588-48a4-90f0-940104bdc844 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:04.547773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d30466-c588-48a4-90f0-940104bdc844 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:04.548632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d30466-c588-48a4-90f0-940104bdc844 admin admin] RBAC: Adding query filter params (role.id=6f527e6f2b2041689856666de79d95a3, scope.project.id=438e35c51ae94615bf6eb31f94403eb6, user.id=0b8b7415b13341e0bf0ec6e1a2c1eb8b) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:04.548937 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d30466-c588-48a4-90f0-940104bdc844 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:04.550918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d30466-c588-48a4-90f0-940104bdc844 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:04.557231 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 134/268] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:04 2022] GET /identity/v3/role_assignments?user.id=0b8b7415b13341e0bf0ec6e1a2c1eb8b&scope.project.id=438e35c51ae94615bf6eb31f94403eb6&role.id=6f527e6f2b2041689856666de79d95a3 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:06.554247 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074196b-14da-4f2d-bbef-1ca5660fc335 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.554839 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074196b-14da-4f2d-bbef-1ca5660fc335 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.554839 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074196b-14da-4f2d-bbef-1ca5660fc335 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.556777 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 135/269] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:06.562050 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10d9d4-987d-4b7f-bb22-9bd8070bc54e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.562451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10d9d4-987d-4b7f-bb22-9bd8070bc54e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.562586 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10d9d4-987d-4b7f-bb22-9bd8070bc54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.581478 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-dc10d9d4-987d-4b7f-bb22-9bd8070bc54e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:06.582669 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-dc10d9d4-987d-4b7f-bb22-9bd8070bc54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:06.590582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 135/270] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:06.613970 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074196b-14da-4f2d-bbef-1ca5660fc335 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:06.626230 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074196b-14da-4f2d-bbef-1ca5660fc335 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:06.630660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c07dd-e9e0-4f5c-8e5f-08ab3acdf27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:06.631491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c07dd-e9e0-4f5c-8e5f-08ab3acdf27c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.631747 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c07dd-e9e0-4f5c-8e5f-08ab3acdf27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.632018 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c07dd-e9e0-4f5c-8e5f-08ab3acdf27c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.642557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3c07dd-e9e0-4f5c-8e5f-08ab3acdf27c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:06.650081 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-9c3c07dd-e9e0-4f5c-8e5f-08ab3acdf27c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:16:06.651463 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 136/271] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:06.657073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10d9d4-987d-4b7f-bb22-9bd8070bc54e None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:06.666473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10d9d4-987d-4b7f-bb22-9bd8070bc54e None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:06.670888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d7ff0-8ecd-4828-9b05-6af16644d2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:06.671567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d7ff0-8ecd-4828-9b05-6af16644d2bc admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.671847 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d7ff0-8ecd-4828-9b05-6af16644d2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.672120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55d7ff0-8ecd-4828-9b05-6af16644d2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.672876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d7ff0-8ecd-4828-9b05-6af16644d2bc admin admin] RBAC: Adding query filter params (name=member) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:06.673180 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d7ff0-8ecd-4828-9b05-6af16644d2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:06.675328 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55d7ff0-8ecd-4828-9b05-6af16644d2bc admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:06.684424 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 136/272] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:06.693075 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c07dd-e9e0-4f5c-8e5f-08ab3acdf27c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:06.703068 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c07dd-e9e0-4f5c-8e5f-08ab3acdf27c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:06.707546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55df7ffa-b10f-42c4-86ed-a08cdc0d2233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:06.708399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df7ffa-b10f-42c4-86ed-a08cdc0d2233 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.708670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df7ffa-b10f-42c4-86ed-a08cdc0d2233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.708936 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df7ffa-b10f-42c4-86ed-a08cdc0d2233 admin admin] PATH_INFO: `/v3/users/cc1f334b9b0f46598d19a542e8677bb0` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.710144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df7ffa-b10f-42c4-86ed-a08cdc0d2233 admin admin] RBAC: Authorizing `identity:get_user(user_id=cc1f334b9b0f46598d19a542e8677bb0)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:06.712285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55df7ffa-b10f-42c4-86ed-a08cdc0d2233 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:06.714146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 137/273] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:06 2022] GET /identity/v3/users/cc1f334b9b0f46598d19a542e8677bb0 => generated 297 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:06.719508 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d7ff0-8ecd-4828-9b05-6af16644d2bc admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:06.729805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55d7ff0-8ecd-4828-9b05-6af16644d2bc admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:06.734198 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa05270-0905-42df-9d22-9c0177e4eaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:06.734827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa05270-0905-42df-9d22-9c0177e4eaaa admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.735104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa05270-0905-42df-9d22-9c0177e4eaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.735406 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa05270-0905-42df-9d22-9c0177e4eaaa admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.743824 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa05270-0905-42df-9d22-9c0177e4eaaa admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:06.745563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa05270-0905-42df-9d22-9c0177e4eaaa admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:06.749582 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c649b-f48f-4897-9b8a-9618fd38bd25 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.749977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c649b-f48f-4897-9b8a-9618fd38bd25 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.750382 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c649b-f48f-4897-9b8a-9618fd38bd25 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.752318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 138/274] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:06.755809 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 137/275] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:06.757523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ebd18-ee68-4c39-a140-b7e8c914bf5e None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.757819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ebd18-ee68-4c39-a140-b7e8c914bf5e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.758096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09ebd18-ee68-4c39-a140-b7e8c914bf5e None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.759018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a73a7-b575-47c5-964b-90c269a5313f None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.759442 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a73a7-b575-47c5-964b-90c269a5313f None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.759816 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a73a7-b575-47c5-964b-90c269a5313f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.760189 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 139/276] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:06.760897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ebd18-ee68-4c39-a140-b7e8c914bf5e None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:06.777478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09ebd18-ee68-4c39-a140-b7e8c914bf5e None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:06.778092 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-817a73a7-b575-47c5-964b-90c269a5313f None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:06.779279 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-817a73a7-b575-47c5-964b-90c269a5313f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:06.782401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c86b3a-851d-4e0d-8ff9-942f99cbf242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:06.783504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c86b3a-851d-4e0d-8ff9-942f99cbf242 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.783916 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c86b3a-851d-4e0d-8ff9-942f99cbf242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.784977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c86b3a-851d-4e0d-8ff9-942f99cbf242 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.786462 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c86b3a-851d-4e0d-8ff9-942f99cbf242 admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:06.787500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 138/277] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:06.788819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c86b3a-851d-4e0d-8ff9-942f99cbf242 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:06.789680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd2474-9aa4-48f0-b3a5-adc84ba06922 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.789976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd2474-9aa4-48f0-b3a5-adc84ba06922 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.790240 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd2474-9aa4-48f0-b3a5-adc84ba06922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.790599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 140/278] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:06 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:06.792630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8772d-5e31-48b5-a135-3c9a1b6a95ed None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.792911 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8772d-5e31-48b5-a135-3c9a1b6a95ed None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.793181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8772d-5e31-48b5-a135-3c9a1b6a95ed None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.794923 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 141/279] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:06.797064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8772d-5e31-48b5-a135-3c9a1b6a95ed None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:06.812046 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8772d-5e31-48b5-a135-3c9a1b6a95ed None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:06.812803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-fadd2474-9aa4-48f0-b3a5-adc84ba06922 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:06.813981 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-fadd2474-9aa4-48f0-b3a5-adc84ba06922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:06.816190 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bd985-530f-44f6-9f92-f5f13e7c3424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:06.816808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bd985-530f-44f6-9f92-f5f13e7c3424 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.817086 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bd985-530f-44f6-9f92-f5f13e7c3424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.817355 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bd985-530f-44f6-9f92-f5f13e7c3424 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.818179 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bd985-530f-44f6-9f92-f5f13e7c3424 admin admin] RBAC: Adding query filter params (role.id=ca6edcc85e3841d9bebb1b58cecb96d3, scope.project.id=438e35c51ae94615bf6eb31f94403eb6, user.id=cc1f334b9b0f46598d19a542e8677bb0) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:06.818482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bd985-530f-44f6-9f92-f5f13e7c3424 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:06.820318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bd985-530f-44f6-9f92-f5f13e7c3424 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:06.821854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 139/280] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:06.824119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cccee0-67ef-42c4-a264-87ee2a33a95a None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.824416 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cccee0-67ef-42c4-a264-87ee2a33a95a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.824692 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cccee0-67ef-42c4-a264-87ee2a33a95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.826557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 142/281] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:06 2022] GET /identity/v3/role_assignments?user.id=cc1f334b9b0f46598d19a542e8677bb0&scope.project.id=438e35c51ae94615bf6eb31f94403eb6&role.id=ca6edcc85e3841d9bebb1b58cecb96d3 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:06.827208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bd985-530f-44f6-9f92-f5f13e7c3424 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:06.836880 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bd985-530f-44f6-9f92-f5f13e7c3424 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:06.841526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43fba9-15bf-4840-8a53-20e2d1107413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:06.842371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43fba9-15bf-4840-8a53-20e2d1107413 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.842656 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43fba9-15bf-4840-8a53-20e2d1107413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.842920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43fba9-15bf-4840-8a53-20e2d1107413 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.855415 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-e0cccee0-67ef-42c4-a264-87ee2a33a95a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:06.856305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43fba9-15bf-4840-8a53-20e2d1107413 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:06.856818 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e0cccee0-67ef-42c4-a264-87ee2a33a95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:06.865402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 140/282] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:06.866314 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cccee0-67ef-42c4-a264-87ee2a33a95a None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:06.866663 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-5f43fba9-15bf-4840-8a53-20e2d1107413 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:16:06.868298 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 143/283] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:06.877245 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43fba9-15bf-4840-8a53-20e2d1107413 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:06.880577 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cccee0-67ef-42c4-a264-87ee2a33a95a None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:06.886675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37983917-b733-4aa5-a7d9-5869235d64dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:06.888061 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37983917-b733-4aa5-a7d9-5869235d64dc admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.888434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37983917-b733-4aa5-a7d9-5869235d64dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.888562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43fba9-15bf-4840-8a53-20e2d1107413 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:06.888901 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37983917-b733-4aa5-a7d9-5869235d64dc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.890300 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37983917-b733-4aa5-a7d9-5869235d64dc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:06.892259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37983917-b733-4aa5-a7d9-5869235d64dc admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:06.893063 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdb103-5c4f-4bbb-bd97-492e336df107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:06.894668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdb103-5c4f-4bbb-bd97-492e336df107 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.895025 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdb103-5c4f-4bbb-bd97-492e336df107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.895427 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfdb103-5c4f-4bbb-bd97-492e336df107 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.896188 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdb103-5c4f-4bbb-bd97-492e336df107 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:06.897486 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdb103-5c4f-4bbb-bd97-492e336df107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:06.897608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 141/284] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:06.897608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37983917-b733-4aa5-a7d9-5869235d64dc admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:06.898331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfdb103-5c4f-4bbb-bd97-492e336df107 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:06.908236 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 144/285] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:06.908936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37983917-b733-4aa5-a7d9-5869235d64dc admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:06.912426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdb103-5c4f-4bbb-bd97-492e336df107 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:06.914147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3d03b-0f29-4810-9162-203a13bca109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:06.914943 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3d03b-0f29-4810-9162-203a13bca109 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.915257 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3d03b-0f29-4810-9162-203a13bca109 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.915551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba3d03b-0f29-4810-9162-203a13bca109 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.923561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfdb103-5c4f-4bbb-bd97-492e336df107 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:06.927683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba3d03b-0f29-4810-9162-203a13bca109 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:06.929083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf1314-ae4d-41dd-8fb8-cae073cf263c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:06.929856 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf1314-ae4d-41dd-8fb8-cae073cf263c admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.930236 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf1314-ae4d-41dd-8fb8-cae073cf263c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.930611 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf1314-ae4d-41dd-8fb8-cae073cf263c admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.931725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf1314-ae4d-41dd-8fb8-cae073cf263c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:06.933781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf1314-ae4d-41dd-8fb8-cae073cf263c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:06.934851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-bba3d03b-0f29-4810-9162-203a13bca109 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 04:16:06.941056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 142/286] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:06.941056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3d03b-0f29-4810-9162-203a13bca109 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:06.952025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba3d03b-0f29-4810-9162-203a13bca109 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:06.956740 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9ef76-9a74-4bf6-b631-a40bca606d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:06.957618 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9ef76-9a74-4bf6-b631-a40bca606d19 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.957898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9ef76-9a74-4bf6-b631-a40bca606d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.958894 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9ef76-9a74-4bf6-b631-a40bca606d19 admin admin] PATH_INFO: `/v3/users/1ea0b75437184459b5bf60dbc0752406` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.973094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9ef76-9a74-4bf6-b631-a40bca606d19 admin admin] RBAC: Authorizing `identity:get_user(user_id=1ea0b75437184459b5bf60dbc0752406)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:06.975280 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9ef76-9a74-4bf6-b631-a40bca606d19 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:06.977059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 143/287] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:06 2022] GET /identity/v3/users/1ea0b75437184459b5bf60dbc0752406 => generated 293 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:06.982751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9ef76-9a74-4bf6-b631-a40bca606d19 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:06.993484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9ef76-9a74-4bf6-b631-a40bca606d19 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:06.997843 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b49dc7-aede-4543-bea1-74c334583fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:06.998494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b49dc7-aede-4543-bea1-74c334583fbe admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:06.998774 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b49dc7-aede-4543-bea1-74c334583fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:06.999050 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b49dc7-aede-4543-bea1-74c334583fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:06.999855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b49dc7-aede-4543-bea1-74c334583fbe admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:07.000164 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b49dc7-aede-4543-bea1-74c334583fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:07.001735 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b49dc7-aede-4543-bea1-74c334583fbe admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:07.010707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 144/288] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:07.011675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b49dc7-aede-4543-bea1-74c334583fbe admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:07.021241 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b49dc7-aede-4543-bea1-74c334583fbe admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:07.026053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b764e7b-f0eb-457d-a150-d335c32eaeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:07.026742 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b764e7b-f0eb-457d-a150-d335c32eaeb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:07.027018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b764e7b-f0eb-457d-a150-d335c32eaeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:07.029256 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b764e7b-f0eb-457d-a150-d335c32eaeb3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:07.029256 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b764e7b-f0eb-457d-a150-d335c32eaeb3 admin admin] RBAC: Adding query filter params (role.id=ca6edcc85e3841d9bebb1b58cecb96d3, user.id=1ea0b75437184459b5bf60dbc0752406, scope.system=all) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:07.029427 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 145/289] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:16:06 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:07.029498 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b764e7b-f0eb-457d-a150-d335c32eaeb3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:07.029571 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf1314-ae4d-41dd-8fb8-cae073cf263c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:07.030552 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b764e7b-f0eb-457d-a150-d335c32eaeb3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:07.039429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 145/290] 10.222.0.35 () {56 vars in 1329 bytes} [Sat Feb 12 04:16:07 2022] GET /identity/v3/role_assignments?user.id=1ea0b75437184459b5bf60dbc0752406&scope.system=all&role.id=ca6edcc85e3841d9bebb1b58cecb96d3 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:07.041902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf1314-ae4d-41dd-8fb8-cae073cf263c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:07.049184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033c4fb-8029-450b-8983-2457226ca563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:07.050176 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033c4fb-8029-450b-8983-2457226ca563 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:07.050453 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033c4fb-8029-450b-8983-2457226ca563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:07.050723 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c033c4fb-8029-450b-8983-2457226ca563 admin admin] PATH_INFO: `/v3/users/0b8b7415b13341e0bf0ec6e1a2c1eb8b` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:07.055285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033c4fb-8029-450b-8983-2457226ca563 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b8b7415b13341e0bf0ec6e1a2c1eb8b)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:07.055285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c033c4fb-8029-450b-8983-2457226ca563 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:07.058651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 146/291] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:07 2022] GET /identity/v3/users/0b8b7415b13341e0bf0ec6e1a2c1eb8b => generated 297 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:07.065863 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b764e7b-f0eb-457d-a150-d335c32eaeb3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:07.078180 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b764e7b-f0eb-457d-a150-d335c32eaeb3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:07.083892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8bfc82-0a58-4057-9935-31728ef8bbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:07.084975 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bfc82-0a58-4057-9935-31728ef8bbdc admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:07.085410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bfc82-0a58-4057-9935-31728ef8bbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:07.085786 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8bfc82-0a58-4057-9935-31728ef8bbdc admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:07.087367 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bfc82-0a58-4057-9935-31728ef8bbdc admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:07.089759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8bfc82-0a58-4057-9935-31728ef8bbdc admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:07.091813 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 146/292] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:07 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:07.098805 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033c4fb-8029-450b-8983-2457226ca563 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:07.111401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c033c4fb-8029-450b-8983-2457226ca563 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:07.116340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d873dec-0ef8-497e-9730-69f9b4f68006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:07.117251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d873dec-0ef8-497e-9730-69f9b4f68006 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:07.117526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d873dec-0ef8-497e-9730-69f9b4f68006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:07.117850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d873dec-0ef8-497e-9730-69f9b4f68006 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6/users/0b8b7415b13341e0bf0ec6e1a2c1eb8b/roles/6f527e6f2b2041689856666de79d95a3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:07.120073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d873dec-0ef8-497e-9730-69f9b4f68006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=438e35c51ae94615bf6eb31f94403eb6, user_id=0b8b7415b13341e0bf0ec6e1a2c1eb8b, role_id=6f527e6f2b2041689856666de79d95a3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:07.122913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d873dec-0ef8-497e-9730-69f9b4f68006 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:07.206153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 147/293] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:16:07 2022] PUT /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6/users/0b8b7415b13341e0bf0ec6e1a2c1eb8b/roles/6f527e6f2b2041689856666de79d95a3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:09.294226 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5b629-e11b-496a-92a4-d993f9fbb25c None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.294719 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5b629-e11b-496a-92a4-d993f9fbb25c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.294791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5b629-e11b-496a-92a4-d993f9fbb25c None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.296597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 147/294] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:09.302778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a114ce-cb27-484a-adba-2e57785a9722 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.303656 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a114ce-cb27-484a-adba-2e57785a9722 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.304129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a114ce-cb27-484a-adba-2e57785a9722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.322428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-30a114ce-cb27-484a-adba-2e57785a9722 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:09.323976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-30a114ce-cb27-484a-adba-2e57785a9722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:09.381846 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 148/295] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:09.405304 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5b629-e11b-496a-92a4-d993f9fbb25c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.418806 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5b629-e11b-496a-92a4-d993f9fbb25c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.423710 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1b616-fdf6-4ad1-92de-5a66d6a22890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.424752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1b616-fdf6-4ad1-92de-5a66d6a22890 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.425365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1b616-fdf6-4ad1-92de-5a66d6a22890 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.425827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1b616-fdf6-4ad1-92de-5a66d6a22890 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.438550 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d1b616-fdf6-4ad1-92de-5a66d6a22890 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:09.446011 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-23d1b616-fdf6-4ad1-92de-5a66d6a22890 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:16:09.447447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 148/296] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:09.460062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cf144-dae1-455a-ac8e-5e7762772ed0 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.460062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cf144-dae1-455a-ac8e-5e7762772ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.460062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cf144-dae1-455a-ac8e-5e7762772ed0 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.461171 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 149/297] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:09.461550 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1b616-fdf6-4ad1-92de-5a66d6a22890 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.466173 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a75ef2-71d8-42c7-a09d-aa3c6cb952b1 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.466455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a75ef2-71d8-42c7-a09d-aa3c6cb952b1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.466730 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a75ef2-71d8-42c7-a09d-aa3c6cb952b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.473671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1b616-fdf6-4ad1-92de-5a66d6a22890 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.477895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b402d6d-c7fd-4aff-8881-7add76a01d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.478574 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b402d6d-c7fd-4aff-8881-7add76a01d89 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.478852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b402d6d-c7fd-4aff-8881-7add76a01d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.479126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b402d6d-c7fd-4aff-8881-7add76a01d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.479912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b402d6d-c7fd-4aff-8881-7add76a01d89 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:09.480209 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b402d6d-c7fd-4aff-8881-7add76a01d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:09.481779 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b402d6d-c7fd-4aff-8881-7add76a01d89 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:09.485077 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-97a75ef2-71d8-42c7-a09d-aa3c6cb952b1 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:09.486238 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-97a75ef2-71d8-42c7-a09d-aa3c6cb952b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:09.490345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 149/298] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:09.491601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242534c-4618-45f9-be0b-53f16357b34a None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.491918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242534c-4618-45f9-be0b-53f16357b34a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.492143 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242534c-4618-45f9-be0b-53f16357b34a None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.493882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 150/299] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:09.494023 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 150/300] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:09.495891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a75ef2-71d8-42c7-a09d-aa3c6cb952b1 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.495995 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f98ddc-5655-48c6-aa14-e67383b59194 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.496188 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f98ddc-5655-48c6-aa14-e67383b59194 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.496466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f98ddc-5655-48c6-aa14-e67383b59194 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.498084 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 151/301] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:09.500444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc167691-bedb-46c3-b9df-0b449812b89f None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.500722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc167691-bedb-46c3-b9df-0b449812b89f None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.501000 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc167691-bedb-46c3-b9df-0b449812b89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.507258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a75ef2-71d8-42c7-a09d-aa3c6cb952b1 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.511801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5af7d4-b8b2-4ce3-a840-0e0f477abd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.512652 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5af7d4-b8b2-4ce3-a840-0e0f477abd3c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.512933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5af7d4-b8b2-4ce3-a840-0e0f477abd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.513205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5af7d4-b8b2-4ce3-a840-0e0f477abd3c admin admin] PATH_INFO: `/v3/users/1ea0b75437184459b5bf60dbc0752406` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.514404 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5af7d4-b8b2-4ce3-a840-0e0f477abd3c admin admin] RBAC: Authorizing `identity:get_user(user_id=1ea0b75437184459b5bf60dbc0752406)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:09.516642 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5af7d4-b8b2-4ce3-a840-0e0f477abd3c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:09.518237 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 151/302] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:09 2022] GET /identity/v3/users/1ea0b75437184459b5bf60dbc0752406 => generated 293 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:09.519990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e4c8e-bca0-4642-95f4-4fcefde22d6d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.520333 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e4c8e-bca0-4642-95f4-4fcefde22d6d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.520612 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e4c8e-bca0-4642-95f4-4fcefde22d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.524309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-fc167691-bedb-46c3-b9df-0b449812b89f None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:09.525496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-fc167691-bedb-46c3-b9df-0b449812b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:09.532928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 152/303] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:09.535507 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc167691-bedb-46c3-b9df-0b449812b89f None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.540365 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1f0e4c8e-bca0-4642-95f4-4fcefde22d6d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:09.541883 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1f0e4c8e-bca0-4642-95f4-4fcefde22d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:09.545820 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc167691-bedb-46c3-b9df-0b449812b89f None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.549097 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 152/304] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:09.550540 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e4c8e-bca0-4642-95f4-4fcefde22d6d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.558389 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dd774-29f9-4fa3-b003-f8a213dfd83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.559340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e4c8e-bca0-4642-95f4-4fcefde22d6d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.559667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dd774-29f9-4fa3-b003-f8a213dfd83d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.560079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dd774-29f9-4fa3-b003-f8a213dfd83d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.560446 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dd774-29f9-4fa3-b003-f8a213dfd83d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.561873 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dd774-29f9-4fa3-b003-f8a213dfd83d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:09.563555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d87ba-1e88-4b5d-b42c-4e7e0a34eed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.564317 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dd774-29f9-4fa3-b003-f8a213dfd83d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:09.564425 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d87ba-1e88-4b5d-b42c-4e7e0a34eed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.564636 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d87ba-1e88-4b5d-b42c-4e7e0a34eed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.564906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d87ba-1e88-4b5d-b42c-4e7e0a34eed0 admin admin] PATH_INFO: `/v3/system/users/1ea0b75437184459b5bf60dbc0752406/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.566353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 153/305] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:09.566859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dd774-29f9-4fa3-b003-f8a213dfd83d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.570888 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d87ba-1e88-4b5d-b42c-4e7e0a34eed0 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1ea0b75437184459b5bf60dbc0752406, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:09.572038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-203d87ba-1e88-4b5d-b42c-4e7e0a34eed0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:09.572038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:16:09.572038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:16:09.573055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d87ba-1e88-4b5d-b42c-4e7e0a34eed0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:09.576423 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dd774-29f9-4fa3-b003-f8a213dfd83d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.580671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46552e-7d69-4a93-974a-339e855d99dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.581990 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46552e-7d69-4a93-974a-339e855d99dd admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.582243 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46552e-7d69-4a93-974a-339e855d99dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.582507 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd46552e-7d69-4a93-974a-339e855d99dd admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.592733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd46552e-7d69-4a93-974a-339e855d99dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:09.600392 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-dd46552e-7d69-4a93-974a-339e855d99dd admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 04:16:09.601550 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 154/306] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:09.602339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46552e-7d69-4a93-974a-339e855d99dd admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.611456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd46552e-7d69-4a93-974a-339e855d99dd admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.616501 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6322c-31ce-4f74-9216-8bd5679d2dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.617100 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6322c-31ce-4f74-9216-8bd5679d2dee admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.617375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6322c-31ce-4f74-9216-8bd5679d2dee admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.617644 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e6322c-31ce-4f74-9216-8bd5679d2dee admin admin] PATH_INFO: `/v3/groups` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.618321 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6322c-31ce-4f74-9216-8bd5679d2dee admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:09.619368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-09e6322c-31ce-4f74-9216-8bd5679d2dee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:09.619368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:16:09.619368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:16:09.620531 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e6322c-31ce-4f74-9216-8bd5679d2dee admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:09.678275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 153/307] 10.222.0.35 () {58 vars in 1355 bytes} [Sat Feb 12 04:16:09 2022] PUT /identity/v3/system/users/1ea0b75437184459b5bf60dbc0752406/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:09.679124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d87ba-1e88-4b5d-b42c-4e7e0a34eed0 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.689664 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d87ba-1e88-4b5d-b42c-4e7e0a34eed0 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.695171 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477213d3-afee-4e40-9b5e-fd32edc361a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.696009 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477213d3-afee-4e40-9b5e-fd32edc361a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.696288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477213d3-afee-4e40-9b5e-fd32edc361a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.696557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477213d3-afee-4e40-9b5e-fd32edc361a2 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.708925 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477213d3-afee-4e40-9b5e-fd32edc361a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:09.712163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 155/308] 10.222.0.35 () {60 vars in 1155 bytes} [Sat Feb 12 04:16:09 2022] POST /identity/v3/groups => generated 229 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:09.712914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6322c-31ce-4f74-9216-8bd5679d2dee admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.716064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-477213d3-afee-4e40-9b5e-fd32edc361a2 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 04:16:09.717399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 154/309] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:09.723794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477213d3-afee-4e40-9b5e-fd32edc361a2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.728240 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e6322c-31ce-4f74-9216-8bd5679d2dee admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.735211 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477213d3-afee-4e40-9b5e-fd32edc361a2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.735649 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a6e3-0f5a-47cc-b1f9-aad52cbe0678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.736968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a6e3-0f5a-47cc-b1f9-aad52cbe0678 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.738601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a6e3-0f5a-47cc-b1f9-aad52cbe0678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.739402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2a6e3-0f5a-47cc-b1f9-aad52cbe0678 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.740822 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2a6e3-0f5a-47cc-b1f9-aad52cbe0678 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:09.741153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38a718-2f83-444f-b6ae-fb13bda5f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.741616 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2a6e3-0f5a-47cc-b1f9-aad52cbe0678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:09.741910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a718-2f83-444f-b6ae-fb13bda5f219 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.742193 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a718-2f83-444f-b6ae-fb13bda5f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.742518 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38a718-2f83-444f-b6ae-fb13bda5f219 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.743577 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38a718-2f83-444f-b6ae-fb13bda5f219 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:09.743885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38a718-2f83-444f-b6ae-fb13bda5f219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:09.752367 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2a6e3-0f5a-47cc-b1f9-aad52cbe0678 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:09.752524 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38a718-2f83-444f-b6ae-fb13bda5f219 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:09.756006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 155/310] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:09.762407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38a718-2f83-444f-b6ae-fb13bda5f219 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.763148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 156/311] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:09.764328 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a6e3-0f5a-47cc-b1f9-aad52cbe0678 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.773604 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38a718-2f83-444f-b6ae-fb13bda5f219 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.778527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2a6e3-0f5a-47cc-b1f9-aad52cbe0678 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.778904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3d8c3-84da-4cf2-addc-620f31c7fc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.780143 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3d8c3-84da-4cf2-addc-620f31c7fc20 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.780566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3d8c3-84da-4cf2-addc-620f31c7fc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.780954 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3d8c3-84da-4cf2-addc-620f31c7fc20 admin admin] PATH_INFO: `/v3/users/0b8b7415b13341e0bf0ec6e1a2c1eb8b` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.782504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3d8c3-84da-4cf2-addc-620f31c7fc20 admin admin] RBAC: Authorizing `identity:get_user(user_id=0b8b7415b13341e0bf0ec6e1a2c1eb8b)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:09.785660 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97773109-95d3-446f-b2a6-7e65b8ac82fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.786131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3d8c3-84da-4cf2-addc-620f31c7fc20 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:09.787027 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97773109-95d3-446f-b2a6-7e65b8ac82fe admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.787526 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97773109-95d3-446f-b2a6-7e65b8ac82fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.787948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97773109-95d3-446f-b2a6-7e65b8ac82fe admin admin] PATH_INFO: `/v3/users/01038d4309e14dc0bb33dcc4ff940dc8` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.793719 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 156/312] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:09 2022] GET /identity/v3/users/0b8b7415b13341e0bf0ec6e1a2c1eb8b => generated 297 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:09.794904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3d8c3-84da-4cf2-addc-620f31c7fc20 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.806798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3d8c3-84da-4cf2-addc-620f31c7fc20 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.808235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97773109-95d3-446f-b2a6-7e65b8ac82fe admin admin] RBAC: Authorizing `identity:get_user(user_id=01038d4309e14dc0bb33dcc4ff940dc8)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:09.811494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97773109-95d3-446f-b2a6-7e65b8ac82fe admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:09.812073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62042308-4d89-4be5-877b-ffc32a65cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.812901 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62042308-4d89-4be5-877b-ffc32a65cc98 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.813290 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62042308-4d89-4be5-877b-ffc32a65cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.813773 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62042308-4d89-4be5-877b-ffc32a65cc98 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.814313 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 157/313] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:09 2022] GET /identity/v3/users/01038d4309e14dc0bb33dcc4ff940dc8 => generated 293 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:09.821147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97773109-95d3-446f-b2a6-7e65b8ac82fe admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.828903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62042308-4d89-4be5-877b-ffc32a65cc98 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:09.831613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62042308-4d89-4be5-877b-ffc32a65cc98 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:09.833065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97773109-95d3-446f-b2a6-7e65b8ac82fe admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.838762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7e050-9f42-4f91-a523-18f30bea4936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.839493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7e050-9f42-4f91-a523-18f30bea4936 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.839781 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7e050-9f42-4f91-a523-18f30bea4936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.840064 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7e050-9f42-4f91-a523-18f30bea4936 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.841285 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7e050-9f42-4f91-a523-18f30bea4936 admin admin] RBAC: Adding query filter params (role.id=6f527e6f2b2041689856666de79d95a3, user.id=01038d4309e14dc0bb33dcc4ff940dc8, scope.system=all) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:09.841609 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7e050-9f42-4f91-a523-18f30bea4936 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:09.843572 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7e050-9f42-4f91-a523-18f30bea4936 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:09.844804 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 157/314] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:09.851607 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62042308-4d89-4be5-877b-ffc32a65cc98 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.855379 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 158/315] 10.222.0.35 () {56 vars in 1329 bytes} [Sat Feb 12 04:16:09 2022] GET /identity/v3/role_assignments?user.id=01038d4309e14dc0bb33dcc4ff940dc8&scope.system=all&role.id=6f527e6f2b2041689856666de79d95a3 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:09.863041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62042308-4d89-4be5-877b-ffc32a65cc98 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.868326 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb106818-5ac5-4fe8-948f-f4a869638a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.869667 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb106818-5ac5-4fe8-948f-f4a869638a0b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.870239 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb106818-5ac5-4fe8-948f-f4a869638a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.870722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb106818-5ac5-4fe8-948f-f4a869638a0b admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.872555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb106818-5ac5-4fe8-948f-f4a869638a0b admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:09.874939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb106818-5ac5-4fe8-948f-f4a869638a0b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:09.877122 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 158/316] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:09 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:09.883335 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7e050-9f42-4f91-a523-18f30bea4936 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:09.894503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7e050-9f42-4f91-a523-18f30bea4936 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:09.899200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c03aa-bb00-4b25-bdb0-1794878329e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:09.899964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c03aa-bb00-4b25-bdb0-1794878329e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:09.900309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c03aa-bb00-4b25-bdb0-1794878329e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:09.900591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c03aa-bb00-4b25-bdb0-1794878329e9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:09.901451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c03aa-bb00-4b25-bdb0-1794878329e9 admin admin] RBAC: Adding query filter params (role.id=6f527e6f2b2041689856666de79d95a3, scope.project.id=438e35c51ae94615bf6eb31f94403eb6, user.id=0b8b7415b13341e0bf0ec6e1a2c1eb8b) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:09.901763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c03aa-bb00-4b25-bdb0-1794878329e9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:09.903732 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c03aa-bb00-4b25-bdb0-1794878329e9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:09.910976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 159/317] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:09 2022] GET /identity/v3/role_assignments?user.id=0b8b7415b13341e0bf0ec6e1a2c1eb8b&scope.project.id=438e35c51ae94615bf6eb31f94403eb6&role.id=6f527e6f2b2041689856666de79d95a3 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:11.951869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fa6d6-893f-437f-96cf-6537c11a6660 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:11.952385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fa6d6-893f-437f-96cf-6537c11a6660 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:11.952488 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7fa6d6-893f-437f-96cf-6537c11a6660 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:11.954322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 159/318] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:11.960172 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97351aad-a6dd-444b-b3f2-418f60d4f12f None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:11.960615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97351aad-a6dd-444b-b3f2-418f60d4f12f None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:11.960756 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97351aad-a6dd-444b-b3f2-418f60d4f12f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:11.978615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-97351aad-a6dd-444b-b3f2-418f60d4f12f None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:11.979835 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-97351aad-a6dd-444b-b3f2-418f60d4f12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:11.987488 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 160/319] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:11.988211 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a024226-dc15-4e1b-9b31-30edb7f5412d None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:11.988626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a024226-dc15-4e1b-9b31-30edb7f5412d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:11.988976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a024226-dc15-4e1b-9b31-30edb7f5412d None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:11.990922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 160/320] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:11.995912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8313e-4428-44cc-8919-943988b60127 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:11.996203 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8313e-4428-44cc-8919-943988b60127 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:11.996481 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8313e-4428-44cc-8919-943988b60127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:12.014482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-86d8313e-4428-44cc-8919-943988b60127 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:12.015184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a024226-dc15-4e1b-9b31-30edb7f5412d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:12.015739 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-86d8313e-4428-44cc-8919-943988b60127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:12.024351 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 161/321] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:12.027872 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a024226-dc15-4e1b-9b31-30edb7f5412d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:12.032070 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f9c90-d697-42c3-a7f7-9ce7c8d10e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:12.032842 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f9c90-d697-42c3-a7f7-9ce7c8d10e8f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:12.033125 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f9c90-d697-42c3-a7f7-9ce7c8d10e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:12.033403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f9c90-d697-42c3-a7f7-9ce7c8d10e8f admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:12.043871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f9c90-d697-42c3-a7f7-9ce7c8d10e8f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:12.046977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8313e-4428-44cc-8919-943988b60127 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:12.051398 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-b92f9c90-d697-42c3-a7f7-9ce7c8d10e8f admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:16:12.052950 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 161/322] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:12.056456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8313e-4428-44cc-8919-943988b60127 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:12.058387 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f9c90-d697-42c3-a7f7-9ce7c8d10e8f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:12.061095 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc087b7-8434-42d6-89f7-d3ae1789c77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:12.061888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc087b7-8434-42d6-89f7-d3ae1789c77c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:12.062168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc087b7-8434-42d6-89f7-d3ae1789c77c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:12.062444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc087b7-8434-42d6-89f7-d3ae1789c77c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:12.063856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc087b7-8434-42d6-89f7-d3ae1789c77c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:12.066655 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc087b7-8434-42d6-89f7-d3ae1789c77c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:12.068599 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 162/323] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:12.069375 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f9c90-d697-42c3-a7f7-9ce7c8d10e8f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:12.073718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc087b7-8434-42d6-89f7-d3ae1789c77c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:12.073963 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9d43e-aeed-46cb-bb2f-d13239483a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:12.074609 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9d43e-aeed-46cb-bb2f-d13239483a89 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:12.074889 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9d43e-aeed-46cb-bb2f-d13239483a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:12.075166 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a9d43e-aeed-46cb-bb2f-d13239483a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:12.075956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9d43e-aeed-46cb-bb2f-d13239483a89 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:12.076257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9d43e-aeed-46cb-bb2f-d13239483a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:12.077829 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a9d43e-aeed-46cb-bb2f-d13239483a89 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:12.084723 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc087b7-8434-42d6-89f7-d3ae1789c77c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:12.089151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a352e-6e6c-46d5-9348-d7624ce4ad29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:12.089902 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a352e-6e6c-46d5-9348-d7624ce4ad29 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:12.090285 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a352e-6e6c-46d5-9348-d7624ce4ad29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:12.090661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0a352e-6e6c-46d5-9348-d7624ce4ad29 admin admin] PATH_INFO: `/v3/groups` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:12.091401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 162/324] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:12.091614 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a352e-6e6c-46d5-9348-d7624ce4ad29 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:12.092605 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9d43e-aeed-46cb-bb2f-d13239483a89 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:12.093593 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0a352e-6e6c-46d5-9348-d7624ce4ad29 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:12.102448 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a9d43e-aeed-46cb-bb2f-d13239483a89 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:12.106648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0dbfa-7433-47ee-b842-b41c7615582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:12.107529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0dbfa-7433-47ee-b842-b41c7615582d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:12.107811 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0dbfa-7433-47ee-b842-b41c7615582d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:12.108082 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0dbfa-7433-47ee-b842-b41c7615582d admin admin] PATH_INFO: `/v3/users/1ea0b75437184459b5bf60dbc0752406` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:12.109273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0dbfa-7433-47ee-b842-b41c7615582d admin admin] RBAC: Authorizing `identity:get_user(user_id=1ea0b75437184459b5bf60dbc0752406)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:12.111416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0dbfa-7433-47ee-b842-b41c7615582d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:12.113105 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 163/325] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:12 2022] GET /identity/v3/users/1ea0b75437184459b5bf60dbc0752406 => generated 293 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:12.114272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76ab06-8989-428f-89d3-e51c13d8a766 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:12.114566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76ab06-8989-428f-89d3-e51c13d8a766 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:12.118562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76ab06-8989-428f-89d3-e51c13d8a766 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:12.118562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 164/326] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:12.118562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76ab06-8989-428f-89d3-e51c13d8a766 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:12.130641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76ab06-8989-428f-89d3-e51c13d8a766 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:12.134724 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e4d95-1aaa-4d2a-9e36-a19382ff97c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:12.135322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e4d95-1aaa-4d2a-9e36-a19382ff97c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:12.135599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e4d95-1aaa-4d2a-9e36-a19382ff97c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:12.135867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e4d95-1aaa-4d2a-9e36-a19382ff97c3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:12.136677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e4d95-1aaa-4d2a-9e36-a19382ff97c3 admin admin] RBAC: Adding query filter params (role.id=ca6edcc85e3841d9bebb1b58cecb96d3, user.id=1ea0b75437184459b5bf60dbc0752406, scope.system=all) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:12.136977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e4d95-1aaa-4d2a-9e36-a19382ff97c3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:12.138723 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e4d95-1aaa-4d2a-9e36-a19382ff97c3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:12.156139 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 165/327] 10.222.0.35 () {56 vars in 1329 bytes} [Sat Feb 12 04:16:12 2022] GET /identity/v3/role_assignments?user.id=1ea0b75437184459b5bf60dbc0752406&scope.system=all&role.id=ca6edcc85e3841d9bebb1b58cecb96d3 => generated 510 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:12.157385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ddf23-a7c2-49d5-8a0b-e4c0aca6826f None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:12.157666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ddf23-a7c2-49d5-8a0b-e4c0aca6826f None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:12.157937 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5ddf23-a7c2-49d5-8a0b-e4c0aca6826f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:12.176705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1d5ddf23-a7c2-49d5-8a0b-e4c0aca6826f None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:12.177940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1d5ddf23-a7c2-49d5-8a0b-e4c0aca6826f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:12.185873 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 166/328] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:12.199960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 163/329] 10.222.0.35 () {60 vars in 1155 bytes} [Sat Feb 12 04:16:12 2022] POST /identity/v3/groups => generated 226 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:12.210307 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ddf23-a7c2-49d5-8a0b-e4c0aca6826f None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:12.220229 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5ddf23-a7c2-49d5-8a0b-e4c0aca6826f None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:12.225147 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d702fd-026e-4ca6-9798-91aae6c4e1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:12.225959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d702fd-026e-4ca6-9798-91aae6c4e1cc admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:12.226233 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d702fd-026e-4ca6-9798-91aae6c4e1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:12.226498 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d702fd-026e-4ca6-9798-91aae6c4e1cc admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:12.243502 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d702fd-026e-4ca6-9798-91aae6c4e1cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:12.250809 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-60d702fd-026e-4ca6-9798-91aae6c4e1cc admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 04:16:12.252174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 167/330] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:12.259115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a352e-6e6c-46d5-9348-d7624ce4ad29 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:12.270184 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0a352e-6e6c-46d5-9348-d7624ce4ad29 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:12.277344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdee941-f5a5-48b0-a7a1-dabda018e5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:12.277344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdee941-f5a5-48b0-a7a1-dabda018e5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:12.277344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdee941-f5a5-48b0-a7a1-dabda018e5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:12.277344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdee941-f5a5-48b0-a7a1-dabda018e5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:12.277711 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdee941-f5a5-48b0-a7a1-dabda018e5f0 admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:12.277711 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdee941-f5a5-48b0-a7a1-dabda018e5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:12.278733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdee941-f5a5-48b0-a7a1-dabda018e5f0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:12.291927 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 164/331] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:12.298186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d702fd-026e-4ca6-9798-91aae6c4e1cc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:12.309622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d702fd-026e-4ca6-9798-91aae6c4e1cc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:12.314257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2db67a-c6b7-4561-8706-c146f27803f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:12.315147 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2db67a-c6b7-4561-8706-c146f27803f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:12.316354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2db67a-c6b7-4561-8706-c146f27803f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:12.316632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2db67a-c6b7-4561-8706-c146f27803f9 admin admin] PATH_INFO: `/v3/users/01038d4309e14dc0bb33dcc4ff940dc8` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:12.318004 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2db67a-c6b7-4561-8706-c146f27803f9 admin admin] RBAC: Authorizing `identity:get_user(user_id=01038d4309e14dc0bb33dcc4ff940dc8)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:12.320279 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2db67a-c6b7-4561-8706-c146f27803f9 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:12.322197 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 168/332] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:12 2022] GET /identity/v3/users/01038d4309e14dc0bb33dcc4ff940dc8 => generated 293 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:12.328117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdee941-f5a5-48b0-a7a1-dabda018e5f0 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:12.338277 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdee941-f5a5-48b0-a7a1-dabda018e5f0 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:12.343681 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c32cc8-84e8-46dc-afbe-a4c7fdc3d152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:12.345387 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c32cc8-84e8-46dc-afbe-a4c7fdc3d152 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:12.345667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c32cc8-84e8-46dc-afbe-a4c7fdc3d152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:12.345945 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c32cc8-84e8-46dc-afbe-a4c7fdc3d152 admin admin] PATH_INFO: `/v3/system/users/01038d4309e14dc0bb33dcc4ff940dc8/roles/6f527e6f2b2041689856666de79d95a3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:12.347700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c32cc8-84e8-46dc-afbe-a4c7fdc3d152 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=01038d4309e14dc0bb33dcc4ff940dc8, role_id=6f527e6f2b2041689856666de79d95a3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:12.348736 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-12c32cc8-84e8-46dc-afbe-a4c7fdc3d152 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:12.348736 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:16:12.348736 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:16:12.349633 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c32cc8-84e8-46dc-afbe-a4c7fdc3d152 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:12.421448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 165/333] 10.222.0.35 () {58 vars in 1355 bytes} [Sat Feb 12 04:16:12 2022] PUT /identity/v3/system/users/01038d4309e14dc0bb33dcc4ff940dc8/roles/6f527e6f2b2041689856666de79d95a3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:14.904194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2d8b4-07de-4b49-8c51-925001762b74 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:14.905149 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2d8b4-07de-4b49-8c51-925001762b74 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:14.905654 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2d8b4-07de-4b49-8c51-925001762b74 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:14.907933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 169/334] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:14.913499 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971acdd3-e0d6-423f-8b90-47d51a05d46c None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:14.914309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971acdd3-e0d6-423f-8b90-47d51a05d46c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:14.914781 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971acdd3-e0d6-423f-8b90-47d51a05d46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:14.936787 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-971acdd3-e0d6-423f-8b90-47d51a05d46c None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:14.938360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-971acdd3-e0d6-423f-8b90-47d51a05d46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:14.952163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 166/335] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:15.005290 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2d8b4-07de-4b49-8c51-925001762b74 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.020606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2d8b4-07de-4b49-8c51-925001762b74 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.031858 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6a6e1-528e-4d3b-91dc-00084861df1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.032964 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6a6e1-528e-4d3b-91dc-00084861df1c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.033456 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6a6e1-528e-4d3b-91dc-00084861df1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.034443 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a6a6e1-528e-4d3b-91dc-00084861df1c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.053586 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a6a6e1-528e-4d3b-91dc-00084861df1c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:15.061101 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-b0a6a6e1-528e-4d3b-91dc-00084861df1c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:16:15.062540 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 170/336] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:15.068525 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971acdd3-e0d6-423f-8b90-47d51a05d46c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.077855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971acdd3-e0d6-423f-8b90-47d51a05d46c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.082935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe94dbb-2e99-4487-b7c9-15840f3091d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.083849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe94dbb-2e99-4487-b7c9-15840f3091d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.084349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe94dbb-2e99-4487-b7c9-15840f3091d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.084840 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe94dbb-2e99-4487-b7c9-15840f3091d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.085821 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe94dbb-2e99-4487-b7c9-15840f3091d5 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:15.086320 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe94dbb-2e99-4487-b7c9-15840f3091d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:15.088191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe94dbb-2e99-4487-b7c9-15840f3091d5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:15.103488 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 167/337] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:15.109045 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6a6e1-528e-4d3b-91dc-00084861df1c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.119379 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a6a6e1-528e-4d3b-91dc-00084861df1c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.130794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394732f-aba5-45ce-baff-0dc874ea5db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.131776 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394732f-aba5-45ce-baff-0dc874ea5db5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.132259 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394732f-aba5-45ce-baff-0dc874ea5db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.132759 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394732f-aba5-45ce-baff-0dc874ea5db5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.141553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394732f-aba5-45ce-baff-0dc874ea5db5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:15.143634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394732f-aba5-45ce-baff-0dc874ea5db5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:15.157666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 171/338] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:15.164203 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe94dbb-2e99-4487-b7c9-15840f3091d5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.174663 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe94dbb-2e99-4487-b7c9-15840f3091d5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.183490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee28ab-09db-4392-99b6-d8082e448409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.184620 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee28ab-09db-4392-99b6-d8082e448409 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.185121 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee28ab-09db-4392-99b6-d8082e448409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.185589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee28ab-09db-4392-99b6-d8082e448409 admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.187101 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee28ab-09db-4392-99b6-d8082e448409 admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:15.189367 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee28ab-09db-4392-99b6-d8082e448409 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:15.192133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 168/339] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:15.197164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394732f-aba5-45ce-baff-0dc874ea5db5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.206591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394732f-aba5-45ce-baff-0dc874ea5db5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.214364 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00254208-c4f1-4e58-b483-5949ff7f30ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.215526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00254208-c4f1-4e58-b483-5949ff7f30ca admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.216005 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00254208-c4f1-4e58-b483-5949ff7f30ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.216468 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00254208-c4f1-4e58-b483-5949ff7f30ca admin admin] PATH_INFO: `/v3/groups/76f9a328bbe04eaaa9912d1857df51c4` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.232975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00254208-c4f1-4e58-b483-5949ff7f30ca admin admin] RBAC: Authorizing `identity:get_group(group_id=76f9a328bbe04eaaa9912d1857df51c4)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:15.234345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-00254208-c4f1-4e58-b483-5949ff7f30ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:15.234345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:16:15.234345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:16:15.235914 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00254208-c4f1-4e58-b483-5949ff7f30ca admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:15.238195 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 172/340] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/groups/76f9a328bbe04eaaa9912d1857df51c4 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:15.244133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee28ab-09db-4392-99b6-d8082e448409 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.260490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee28ab-09db-4392-99b6-d8082e448409 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.271380 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe7ca7-a86b-4c00-b345-84d924cda8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.272039 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe7ca7-a86b-4c00-b345-84d924cda8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.272324 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe7ca7-a86b-4c00-b345-84d924cda8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.272601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe7ca7-a86b-4c00-b345-84d924cda8c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.273464 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe7ca7-a86b-4c00-b345-84d924cda8c9 admin admin] RBAC: Adding query filter params (group.id=76f9a328bbe04eaaa9912d1857df51c4, role.id=ca6edcc85e3841d9bebb1b58cecb96d3, scope.project.id=f4779a5fd09a4c01853830d4bee9d75e) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:15.273775 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe7ca7-a86b-4c00-b345-84d924cda8c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:15.277238 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe7ca7-a86b-4c00-b345-84d924cda8c9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:15.293583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 169/341] 10.222.0.35 () {56 vars in 1397 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/role_assignments?group.id=76f9a328bbe04eaaa9912d1857df51c4&scope.project.id=f4779a5fd09a4c01853830d4bee9d75e&role.id=ca6edcc85e3841d9bebb1b58cecb96d3 => generated 260 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:15.376006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5959b-d82f-4d84-ad38-fdb8ea3510c2 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.376628 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5959b-d82f-4d84-ad38-fdb8ea3510c2 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.377101 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5959b-d82f-4d84-ad38-fdb8ea3510c2 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.379432 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 173/342] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:15.385253 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ada682-5452-4dfd-8788-a0e3d4a85145 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.385535 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ada682-5452-4dfd-8788-a0e3d4a85145 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.385812 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ada682-5452-4dfd-8788-a0e3d4a85145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.411357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ad158-87e9-4a57-825b-d70e804639d6 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.411951 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ad158-87e9-4a57-825b-d70e804639d6 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.412434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ad158-87e9-4a57-825b-d70e804639d6 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.413778 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-b7ada682-5452-4dfd-8788-a0e3d4a85145 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:15.414812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 174/343] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:15.415126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b7ada682-5452-4dfd-8788-a0e3d4a85145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:15.422489 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ac18d-352c-4491-b7f2-7e71cf97fccf None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.423101 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ac18d-352c-4491-b7f2-7e71cf97fccf None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.423731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ac18d-352c-4491-b7f2-7e71cf97fccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.425060 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 170/344] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:15.443668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-3d4ac18d-352c-4491-b7f2-7e71cf97fccf None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:15.445280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3d4ac18d-352c-4491-b7f2-7e71cf97fccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:15.453980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 175/345] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:15.464093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ada682-5452-4dfd-8788-a0e3d4a85145 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.477311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ada682-5452-4dfd-8788-a0e3d4a85145 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.482929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ac18d-352c-4491-b7f2-7e71cf97fccf None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.487807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c80ff-91cc-46e8-9b4a-c49072ae1c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.488621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c80ff-91cc-46e8-9b4a-c49072ae1c85 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.488896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c80ff-91cc-46e8-9b4a-c49072ae1c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.489166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c80ff-91cc-46e8-9b4a-c49072ae1c85 admin admin] PATH_INFO: `/v3/roles/reader` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.495373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ac18d-352c-4491-b7f2-7e71cf97fccf None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.503845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e77054-4468-4d5a-9119-0adaa30482aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.505077 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e77054-4468-4d5a-9119-0adaa30482aa admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.505569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e77054-4468-4d5a-9119-0adaa30482aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.506046 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e77054-4468-4d5a-9119-0adaa30482aa admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.510502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c80ff-91cc-46e8-9b4a-c49072ae1c85 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:15.517959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-e07c80ff-91cc-46e8-9b4a-c49072ae1c85 admin admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Feb 12 04:16:15.519412 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e77054-4468-4d5a-9119-0adaa30482aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:15.519596 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 171/346] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:15.525034 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c80ff-91cc-46e8-9b4a-c49072ae1c85 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.528041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-c1e77054-4468-4d5a-9119-0adaa30482aa admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 04:16:15.535613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 176/347] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:15.536875 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e77054-4468-4d5a-9119-0adaa30482aa admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.540811 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c80ff-91cc-46e8-9b4a-c49072ae1c85 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.547689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e77054-4468-4d5a-9119-0adaa30482aa admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.552770 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571dd6a-df80-453c-8948-953f3cd073de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.553453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571dd6a-df80-453c-8948-953f3cd073de admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.553733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571dd6a-df80-453c-8948-953f3cd073de admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.554091 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571dd6a-df80-453c-8948-953f3cd073de admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.554861 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb7ab7-e184-49a7-b248-ab09664bcd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.554982 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571dd6a-df80-453c-8948-953f3cd073de admin admin] RBAC: Adding query filter params (name=reader) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:15.555164 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571dd6a-df80-453c-8948-953f3cd073de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:15.556325 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb7ab7-e184-49a7-b248-ab09664bcd9e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.556803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb7ab7-e184-49a7-b248-ab09664bcd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.557038 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571dd6a-df80-453c-8948-953f3cd073de admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:15.557464 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb7ab7-e184-49a7-b248-ab09664bcd9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.558443 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb7ab7-e184-49a7-b248-ab09664bcd9e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:15.558969 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb7ab7-e184-49a7-b248-ab09664bcd9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:15.560821 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb7ab7-e184-49a7-b248-ab09664bcd9e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:15.571383 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 177/348] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:15.576085 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 172/349] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:15.577278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb7ab7-e184-49a7-b248-ab09664bcd9e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.580204 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571dd6a-df80-453c-8948-953f3cd073de admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.588235 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb7ab7-e184-49a7-b248-ab09664bcd9e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.592773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571dd6a-df80-453c-8948-953f3cd073de admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.593260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e378a6e-fdc4-4cbf-9fe6-2dace5c9c747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.594230 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e378a6e-fdc4-4cbf-9fe6-2dace5c9c747 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.594720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e378a6e-fdc4-4cbf-9fe6-2dace5c9c747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.595188 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e378a6e-fdc4-4cbf-9fe6-2dace5c9c747 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.604620 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e378a6e-fdc4-4cbf-9fe6-2dace5c9c747 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:15.606655 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e378a6e-fdc4-4cbf-9fe6-2dace5c9c747 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:15.607943 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32381d-802f-4a9c-8e41-1a7ca8f2347f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.608828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32381d-802f-4a9c-8e41-1a7ca8f2347f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.609106 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32381d-802f-4a9c-8e41-1a7ca8f2347f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.609375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32381d-802f-4a9c-8e41-1a7ca8f2347f admin admin] PATH_INFO: `/v3/users/01038d4309e14dc0bb33dcc4ff940dc8` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.610645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32381d-802f-4a9c-8e41-1a7ca8f2347f admin admin] RBAC: Authorizing `identity:get_user(user_id=01038d4309e14dc0bb33dcc4ff940dc8)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:15.613394 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32381d-802f-4a9c-8e41-1a7ca8f2347f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:15.615366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 173/350] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/users/01038d4309e14dc0bb33dcc4ff940dc8 => generated 293 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:15.619056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 178/351] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:15.621404 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32381d-802f-4a9c-8e41-1a7ca8f2347f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.624804 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e378a6e-fdc4-4cbf-9fe6-2dace5c9c747 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.634532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e378a6e-fdc4-4cbf-9fe6-2dace5c9c747 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.638997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32381d-802f-4a9c-8e41-1a7ca8f2347f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.639623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fec68-4426-4315-9c00-325a88040775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.640819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fec68-4426-4315-9c00-325a88040775 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.641297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fec68-4426-4315-9c00-325a88040775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.641760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fec68-4426-4315-9c00-325a88040775 admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.643601 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fec68-4426-4315-9c00-325a88040775 admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:15.645909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fec68-4426-4315-9c00-325a88040775 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:15.647904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 179/352] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:15.654770 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fec68-4426-4315-9c00-325a88040775 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.655891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5ba14-f8ec-4854-851a-c2c8139c7080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.656548 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5ba14-f8ec-4854-851a-c2c8139c7080 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.656830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5ba14-f8ec-4854-851a-c2c8139c7080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.657099 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5ba14-f8ec-4854-851a-c2c8139c7080 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.657945 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5ba14-f8ec-4854-851a-c2c8139c7080 admin admin] RBAC: Adding query filter params (role.id=6f527e6f2b2041689856666de79d95a3, user.id=01038d4309e14dc0bb33dcc4ff940dc8, scope.system=all) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:15.658258 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5ba14-f8ec-4854-851a-c2c8139c7080 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:15.660169 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5ba14-f8ec-4854-851a-c2c8139c7080 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:15.666991 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fec68-4426-4315-9c00-325a88040775 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.671908 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2b6c4-c3b8-4dc4-bc57-fa93dd32c824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.673141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b6c4-c3b8-4dc4-bc57-fa93dd32c824 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.673648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b6c4-c3b8-4dc4-bc57-fa93dd32c824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.674156 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2b6c4-c3b8-4dc4-bc57-fa93dd32c824 admin admin] PATH_INFO: `/v3/groups/76f9a328bbe04eaaa9912d1857df51c4` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.676565 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2b6c4-c3b8-4dc4-bc57-fa93dd32c824 admin admin] RBAC: Authorizing `identity:get_group(group_id=76f9a328bbe04eaaa9912d1857df51c4)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:15.678781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2b6c4-c3b8-4dc4-bc57-fa93dd32c824 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:15.680688 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 180/353] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/groups/76f9a328bbe04eaaa9912d1857df51c4 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:15.686804 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2b6c4-c3b8-4dc4-bc57-fa93dd32c824 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:15.687026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 174/354] 10.222.0.35 () {56 vars in 1329 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/role_assignments?user.id=01038d4309e14dc0bb33dcc4ff940dc8&scope.system=all&role.id=6f527e6f2b2041689856666de79d95a3 => generated 510 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:15.698310 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2b6c4-c3b8-4dc4-bc57-fa93dd32c824 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:15.703612 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d269a-c40e-4f91-93d9-889098e8d175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:15.704511 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d269a-c40e-4f91-93d9-889098e8d175 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:15.705045 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d269a-c40e-4f91-93d9-889098e8d175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:15.705524 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d269a-c40e-4f91-93d9-889098e8d175 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:15.706913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d269a-c40e-4f91-93d9-889098e8d175 admin admin] RBAC: Adding query filter params (group.id=76f9a328bbe04eaaa9912d1857df51c4, role.id=b9252c31847f4513a49cd10bb4f9cdaa, scope.project.id=f4779a5fd09a4c01853830d4bee9d75e) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:15.707498 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d269a-c40e-4f91-93d9-889098e8d175 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:15.709650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d269a-c40e-4f91-93d9-889098e8d175 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:15.716999 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 181/355] 10.222.0.35 () {56 vars in 1397 bytes} [Sat Feb 12 04:16:15 2022] GET /identity/v3/role_assignments?group.id=76f9a328bbe04eaaa9912d1857df51c4&scope.project.id=f4779a5fd09a4c01853830d4bee9d75e&role.id=b9252c31847f4513a49cd10bb4f9cdaa => generated 260 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:16.059341 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e341-e804-4371-823c-b2e737b8c8b0 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.059829 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e341-e804-4371-823c-b2e737b8c8b0 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.059829 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716e341-e804-4371-823c-b2e737b8c8b0 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.061874 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 175/356] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:16.067940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c320056-eb86-4645-a725-b67aa8313952 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.068404 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c320056-eb86-4645-a725-b67aa8313952 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.068476 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c320056-eb86-4645-a725-b67aa8313952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.088359 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1c320056-eb86-4645-a725-b67aa8313952 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:16.089523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1c320056-eb86-4645-a725-b67aa8313952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:16.100398 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 182/357] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:16.125597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716e341-e804-4371-823c-b2e737b8c8b0 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:16.139198 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716e341-e804-4371-823c-b2e737b8c8b0 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:16.144164 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa5a33-7192-4e2f-a31f-01572825bc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:16.144940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa5a33-7192-4e2f-a31f-01572825bc7e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.145217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa5a33-7192-4e2f-a31f-01572825bc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.145483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa5a33-7192-4e2f-a31f-01572825bc7e admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.156354 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa5a33-7192-4e2f-a31f-01572825bc7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:16.166040 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-f2aa5a33-7192-4e2f-a31f-01572825bc7e admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:16:16.167569 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 176/358] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:16.173277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c320056-eb86-4645-a725-b67aa8313952 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:16.183097 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c320056-eb86-4645-a725-b67aa8313952 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:16.188639 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc53664-378b-43b6-8b36-72fdabf008b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:16.189297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53664-378b-43b6-8b36-72fdabf008b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.189572 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53664-378b-43b6-8b36-72fdabf008b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.189841 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53664-378b-43b6-8b36-72fdabf008b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.190726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc53664-378b-43b6-8b36-72fdabf008b3 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:16.191022 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc53664-378b-43b6-8b36-72fdabf008b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:16.192651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc53664-378b-43b6-8b36-72fdabf008b3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:16.203015 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 183/359] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:16.209074 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa5a33-7192-4e2f-a31f-01572825bc7e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:16.218742 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa5a33-7192-4e2f-a31f-01572825bc7e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:16.223773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a29c31-9ef1-4fa3-ac81-2c43665fecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:16.224461 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a29c31-9ef1-4fa3-ac81-2c43665fecd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.224743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a29c31-9ef1-4fa3-ac81-2c43665fecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.225016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a29c31-9ef1-4fa3-ac81-2c43665fecd9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.237922 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a29c31-9ef1-4fa3-ac81-2c43665fecd9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:16.239816 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a29c31-9ef1-4fa3-ac81-2c43665fecd9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:16.253207 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 177/360] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:16.258703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc53664-378b-43b6-8b36-72fdabf008b3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:16.269128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc53664-378b-43b6-8b36-72fdabf008b3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:16.277802 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51eca2-8813-434d-aa81-c1d38361b608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:16.278760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51eca2-8813-434d-aa81-c1d38361b608 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.279003 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51eca2-8813-434d-aa81-c1d38361b608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.279191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51eca2-8813-434d-aa81-c1d38361b608 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.283353 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51eca2-8813-434d-aa81-c1d38361b608 admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:16.283353 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e51eca2-8813-434d-aa81-c1d38361b608 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:16.284257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 184/361] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:16 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:16.289830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a29c31-9ef1-4fa3-ac81-2c43665fecd9 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:16.303351 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a29c31-9ef1-4fa3-ac81-2c43665fecd9 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:16.316394 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7411b798-3527-44a3-a9e3-7c3168298eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:16.317356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411b798-3527-44a3-a9e3-7c3168298eeb admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.317640 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411b798-3527-44a3-a9e3-7c3168298eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.317916 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7411b798-3527-44a3-a9e3-7c3168298eeb admin admin] PATH_INFO: `/v3/groups/76f9a328bbe04eaaa9912d1857df51c4` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.324171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411b798-3527-44a3-a9e3-7c3168298eeb admin admin] RBAC: Authorizing `identity:get_group(group_id=76f9a328bbe04eaaa9912d1857df51c4)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:16.325200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-7411b798-3527-44a3-a9e3-7c3168298eeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:16.325200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:16:16.325200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:16:16.326385 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7411b798-3527-44a3-a9e3-7c3168298eeb admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:16.328273 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 178/362] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:16 2022] GET /identity/v3/groups/76f9a328bbe04eaaa9912d1857df51c4 => generated 226 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:16.334096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51eca2-8813-434d-aa81-c1d38361b608 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:16.348520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51eca2-8813-434d-aa81-c1d38361b608 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:16.356684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a39dc5-6e35-4690-a3d5-8544f4a3a896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:16.357341 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39dc5-6e35-4690-a3d5-8544f4a3a896 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.357612 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39dc5-6e35-4690-a3d5-8544f4a3a896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.357880 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a39dc5-6e35-4690-a3d5-8544f4a3a896 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.358726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a39dc5-6e35-4690-a3d5-8544f4a3a896 admin admin] RBAC: Adding query filter params (group.id=76f9a328bbe04eaaa9912d1857df51c4, role.id=ca6edcc85e3841d9bebb1b58cecb96d3, scope.project.id=438e35c51ae94615bf6eb31f94403eb6) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:16.359029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a39dc5-6e35-4690-a3d5-8544f4a3a896 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:16.360886 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a39dc5-6e35-4690-a3d5-8544f4a3a896 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:16.371431 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 185/363] 10.222.0.35 () {56 vars in 1397 bytes} [Sat Feb 12 04:16:16 2022] GET /identity/v3/role_assignments?group.id=76f9a328bbe04eaaa9912d1857df51c4&scope.project.id=438e35c51ae94615bf6eb31f94403eb6&role.id=ca6edcc85e3841d9bebb1b58cecb96d3 => generated 260 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:16.464359 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c501a-c434-4555-be41-9046bc9ff429 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.464666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c501a-c434-4555-be41-9046bc9ff429 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.464912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2c501a-c434-4555-be41-9046bc9ff429 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.467056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 179/364] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:16.473541 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477d395-0b87-46f4-86a6-06af9540708c None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.473841 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477d395-0b87-46f4-86a6-06af9540708c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.474118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477d395-0b87-46f4-86a6-06af9540708c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.499671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-2477d395-0b87-46f4-86a6-06af9540708c None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:16.500869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2477d395-0b87-46f4-86a6-06af9540708c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:16.514286 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 186/365] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:16 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:16.550682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c501a-c434-4555-be41-9046bc9ff429 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:16.572636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2c501a-c434-4555-be41-9046bc9ff429 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:16.577263 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e58899-ed54-49ca-be16-dd0f35a7b420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:16.578077 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e58899-ed54-49ca-be16-dd0f35a7b420 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.578352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e58899-ed54-49ca-be16-dd0f35a7b420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.578626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e58899-ed54-49ca-be16-dd0f35a7b420 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.594558 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e58899-ed54-49ca-be16-dd0f35a7b420 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:16.602773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-39e58899-ed54-49ca-be16-dd0f35a7b420 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 04:16:16.604375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 180/366] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:16.609734 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477d395-0b87-46f4-86a6-06af9540708c None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:16.624739 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477d395-0b87-46f4-86a6-06af9540708c None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:16.635722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a24432-d391-4971-bcc9-c1004bcc200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:16.636416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a24432-d391-4971-bcc9-c1004bcc200a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.636699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a24432-d391-4971-bcc9-c1004bcc200a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.636977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a24432-d391-4971-bcc9-c1004bcc200a admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.637755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a24432-d391-4971-bcc9-c1004bcc200a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:16.638059 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a24432-d391-4971-bcc9-c1004bcc200a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:16.639829 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a24432-d391-4971-bcc9-c1004bcc200a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:16.655297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 187/367] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:16.660632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e58899-ed54-49ca-be16-dd0f35a7b420 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:16.674387 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e58899-ed54-49ca-be16-dd0f35a7b420 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:16.683473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232157b-36fc-44be-a0c0-cc978c3b6973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:16.684513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232157b-36fc-44be-a0c0-cc978c3b6973 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.685014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232157b-36fc-44be-a0c0-cc978c3b6973 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.685526 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7232157b-36fc-44be-a0c0-cc978c3b6973 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.697153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232157b-36fc-44be-a0c0-cc978c3b6973 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:16.698915 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7232157b-36fc-44be-a0c0-cc978c3b6973 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:16.709183 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 181/368] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:16.714900 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a24432-d391-4971-bcc9-c1004bcc200a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:16.726499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a24432-d391-4971-bcc9-c1004bcc200a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:16.731512 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12895be-3f44-438c-b6bb-062d3a2e895b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:16.732366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12895be-3f44-438c-b6bb-062d3a2e895b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.732648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12895be-3f44-438c-b6bb-062d3a2e895b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.732931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12895be-3f44-438c-b6bb-062d3a2e895b admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.734147 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12895be-3f44-438c-b6bb-062d3a2e895b admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:16.736220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12895be-3f44-438c-b6bb-062d3a2e895b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:16.738294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 188/369] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:16 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:16.743685 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232157b-36fc-44be-a0c0-cc978c3b6973 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:16.753371 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7232157b-36fc-44be-a0c0-cc978c3b6973 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:16.758797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e115e-4c14-4823-99c8-f16699fbc99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:16.759682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e115e-4c14-4823-99c8-f16699fbc99a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.759967 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e115e-4c14-4823-99c8-f16699fbc99a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.760293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e115e-4c14-4823-99c8-f16699fbc99a admin admin] PATH_INFO: `/v3/groups/76f9a328bbe04eaaa9912d1857df51c4` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.761567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e115e-4c14-4823-99c8-f16699fbc99a admin admin] RBAC: Authorizing `identity:get_group(group_id=76f9a328bbe04eaaa9912d1857df51c4)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:16.763554 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e115e-4c14-4823-99c8-f16699fbc99a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:16.765510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 182/370] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:16 2022] GET /identity/v3/groups/76f9a328bbe04eaaa9912d1857df51c4 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:16.771379 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12895be-3f44-438c-b6bb-062d3a2e895b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:16.781786 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12895be-3f44-438c-b6bb-062d3a2e895b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:16.787069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c71604-78d0-4353-ab4d-244474ecdad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:16.787853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c71604-78d0-4353-ab4d-244474ecdad9 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:16.788137 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c71604-78d0-4353-ab4d-244474ecdad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:16.788414 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c71604-78d0-4353-ab4d-244474ecdad9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:16.789373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c71604-78d0-4353-ab4d-244474ecdad9 admin admin] RBAC: Adding query filter params (group.id=76f9a328bbe04eaaa9912d1857df51c4, role.id=b9252c31847f4513a49cd10bb4f9cdaa, scope.project.id=438e35c51ae94615bf6eb31f94403eb6) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:16.789739 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c71604-78d0-4353-ab4d-244474ecdad9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:16.791666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c71604-78d0-4353-ab4d-244474ecdad9 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:16.798031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 189/371] 10.222.0.35 () {56 vars in 1397 bytes} [Sat Feb 12 04:16:16 2022] GET /identity/v3/role_assignments?group.id=76f9a328bbe04eaaa9912d1857df51c4&scope.project.id=438e35c51ae94615bf6eb31f94403eb6&role.id=b9252c31847f4513a49cd10bb4f9cdaa => generated 260 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:17.295738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adb770-88a3-476a-ba81-2b7342654d5d None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:17.296236 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adb770-88a3-476a-ba81-2b7342654d5d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:17.296485 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09adb770-88a3-476a-ba81-2b7342654d5d None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:17.298579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 183/372] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:17.304052 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be9ec1-1a3f-4c46-b520-ea638f58ad33 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:17.304497 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be9ec1-1a3f-4c46-b520-ea638f58ad33 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:17.304801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be9ec1-1a3f-4c46-b520-ea638f58ad33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:17.328563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c7be9ec1-1a3f-4c46-b520-ea638f58ad33 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:17.329740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c7be9ec1-1a3f-4c46-b520-ea638f58ad33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:17.345483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 190/373] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:17.396708 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09adb770-88a3-476a-ba81-2b7342654d5d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:17.413666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09adb770-88a3-476a-ba81-2b7342654d5d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:17.419116 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cd761-ea4f-4c1b-abe7-39790059cab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:17.419924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cd761-ea4f-4c1b-abe7-39790059cab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:17.420202 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cd761-ea4f-4c1b-abe7-39790059cab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:17.420473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cd761-ea4f-4c1b-abe7-39790059cab3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:17.436702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cd761-ea4f-4c1b-abe7-39790059cab3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:17.443583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-348cd761-ea4f-4c1b-abe7-39790059cab3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:16:17.445100 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 184/374] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:17.450578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be9ec1-1a3f-4c46-b520-ea638f58ad33 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:17.459827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be9ec1-1a3f-4c46-b520-ea638f58ad33 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:17.468702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7a683-0c9e-45ff-8fc7-fd9003aca0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:17.469365 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7a683-0c9e-45ff-8fc7-fd9003aca0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:17.469641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7a683-0c9e-45ff-8fc7-fd9003aca0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:17.469910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7a683-0c9e-45ff-8fc7-fd9003aca0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:17.470684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7a683-0c9e-45ff-8fc7-fd9003aca0d3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:17.470977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7a683-0c9e-45ff-8fc7-fd9003aca0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:17.473219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7a683-0c9e-45ff-8fc7-fd9003aca0d3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:17.487522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 191/375] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:17.492950 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cd761-ea4f-4c1b-abe7-39790059cab3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:17.508326 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cd761-ea4f-4c1b-abe7-39790059cab3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:17.515850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1391040-3b43-415d-9b73-a90d4a727d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:17.516500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1391040-3b43-415d-9b73-a90d4a727d2d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:17.516779 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1391040-3b43-415d-9b73-a90d4a727d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:17.517048 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1391040-3b43-415d-9b73-a90d4a727d2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:17.526102 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1391040-3b43-415d-9b73-a90d4a727d2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:17.527882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1391040-3b43-415d-9b73-a90d4a727d2d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:17.541072 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 185/376] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:17 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:17.546312 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7a683-0c9e-45ff-8fc7-fd9003aca0d3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:17.556550 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7a683-0c9e-45ff-8fc7-fd9003aca0d3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:17.567338 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a71e24-0368-481c-98cd-6a4fca8c0bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:17.568187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a71e24-0368-481c-98cd-6a4fca8c0bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:17.568466 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a71e24-0368-481c-98cd-6a4fca8c0bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:17.568737 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a71e24-0368-481c-98cd-6a4fca8c0bb0 admin admin] PATH_INFO: `/v3/projects/b029942a00eb466b8575ae912b6910ac` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:17.569927 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a71e24-0368-481c-98cd-6a4fca8c0bb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=b029942a00eb466b8575ae912b6910ac)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:17.571745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a71e24-0368-481c-98cd-6a4fca8c0bb0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:17.579766 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 192/377] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:17 2022] GET /identity/v3/projects/b029942a00eb466b8575ae912b6910ac => generated 344 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:17.585655 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1391040-3b43-415d-9b73-a90d4a727d2d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:17.594635 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1391040-3b43-415d-9b73-a90d4a727d2d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:17.602950 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e73a0-4b52-49c7-b0e9-5b0f961721d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:17.603822 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e73a0-4b52-49c7-b0e9-5b0f961721d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:17.604097 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e73a0-4b52-49c7-b0e9-5b0f961721d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:17.604365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e73a0-4b52-49c7-b0e9-5b0f961721d6 admin admin] PATH_INFO: `/v3/groups/2dfe8b2ce1f4456a9d89b33ac022ce4a` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:17.614503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e73a0-4b52-49c7-b0e9-5b0f961721d6 admin admin] RBAC: Authorizing `identity:get_group(group_id=2dfe8b2ce1f4456a9d89b33ac022ce4a)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:17.616421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e73a0-4b52-49c7-b0e9-5b0f961721d6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:17.618380 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 186/378] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:17 2022] GET /identity/v3/groups/2dfe8b2ce1f4456a9d89b33ac022ce4a => generated 229 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:17.623922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a71e24-0368-481c-98cd-6a4fca8c0bb0 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:17.634213 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a71e24-0368-481c-98cd-6a4fca8c0bb0 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:17.640700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbede420-2fd9-4da3-8391-6ca834eded23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:17.641345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbede420-2fd9-4da3-8391-6ca834eded23 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:17.641622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbede420-2fd9-4da3-8391-6ca834eded23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:17.641894 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbede420-2fd9-4da3-8391-6ca834eded23 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:17.642738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbede420-2fd9-4da3-8391-6ca834eded23 admin admin] RBAC: Adding query filter params (group.id=2dfe8b2ce1f4456a9d89b33ac022ce4a, role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=b029942a00eb466b8575ae912b6910ac) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:17.643626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbede420-2fd9-4da3-8391-6ca834eded23 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:17.645462 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbede420-2fd9-4da3-8391-6ca834eded23 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:17.652395 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 193/379] 10.222.0.35 () {56 vars in 1397 bytes} [Sat Feb 12 04:16:17 2022] GET /identity/v3/role_assignments?group.id=2dfe8b2ce1f4456a9d89b33ac022ce4a&scope.project.id=b029942a00eb466b8575ae912b6910ac&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:18.121705 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67075f-fa94-449c-9bbb-71d32474e42e None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:18.122067 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67075f-fa94-449c-9bbb-71d32474e42e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:18.122256 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67075f-fa94-449c-9bbb-71d32474e42e None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:18.124124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 187/380] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:18.136651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ba478-df57-4971-9448-a5585f24552d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:18.136934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ba478-df57-4971-9448-a5585f24552d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:18.137210 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ba478-df57-4971-9448-a5585f24552d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:18.159533 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-879ba478-df57-4971-9448-a5585f24552d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:18.160707 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-879ba478-df57-4971-9448-a5585f24552d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:18.173850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 194/381] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:18.210195 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67075f-fa94-449c-9bbb-71d32474e42e None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:18.226035 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67075f-fa94-449c-9bbb-71d32474e42e None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:18.238756 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1056897-1c30-4b39-bed8-40e2c956190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:18.239925 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1056897-1c30-4b39-bed8-40e2c956190c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:18.240353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1056897-1c30-4b39-bed8-40e2c956190c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:18.240727 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1056897-1c30-4b39-bed8-40e2c956190c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:18.256561 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1056897-1c30-4b39-bed8-40e2c956190c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:18.263474 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-f1056897-1c30-4b39-bed8-40e2c956190c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:16:18.264683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 188/382] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:18.271170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ba478-df57-4971-9448-a5585f24552d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:18.286035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ba478-df57-4971-9448-a5585f24552d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:18.290475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bbf6d-ce92-432c-bf44-52f90981c436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:18.291145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bbf6d-ce92-432c-bf44-52f90981c436 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:18.291456 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bbf6d-ce92-432c-bf44-52f90981c436 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:18.291726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bbf6d-ce92-432c-bf44-52f90981c436 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:18.292485 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bbf6d-ce92-432c-bf44-52f90981c436 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:18.292781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bbf6d-ce92-432c-bf44-52f90981c436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:18.294361 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9bbf6d-ce92-432c-bf44-52f90981c436 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:18.304102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 195/383] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:18.309935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1056897-1c30-4b39-bed8-40e2c956190c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:18.322419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1056897-1c30-4b39-bed8-40e2c956190c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:18.326931 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97c1e8-e18d-4084-8817-7667f81f2491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:18.327794 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97c1e8-e18d-4084-8817-7667f81f2491 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:18.328064 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97c1e8-e18d-4084-8817-7667f81f2491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:18.328331 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97c1e8-e18d-4084-8817-7667f81f2491 admin admin] PATH_INFO: `/v3/groups/76f9a328bbe04eaaa9912d1857df51c4` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:18.329520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97c1e8-e18d-4084-8817-7667f81f2491 admin admin] RBAC: Authorizing `identity:get_group(group_id=76f9a328bbe04eaaa9912d1857df51c4)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:18.332074 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97c1e8-e18d-4084-8817-7667f81f2491 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:18.334040 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 189/384] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:18 2022] GET /identity/v3/groups/76f9a328bbe04eaaa9912d1857df51c4 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:18.339526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bbf6d-ce92-432c-bf44-52f90981c436 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:18.351084 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bbf6d-ce92-432c-bf44-52f90981c436 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:18.357419 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dea5c-6128-4181-9186-7b7f71a9225a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:18.358292 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dea5c-6128-4181-9186-7b7f71a9225a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:18.358566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dea5c-6128-4181-9186-7b7f71a9225a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:18.358836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dea5c-6128-4181-9186-7b7f71a9225a admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:18.360116 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dea5c-6128-4181-9186-7b7f71a9225a admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:18.363012 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dea5c-6128-4181-9186-7b7f71a9225a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:18.365057 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 196/385] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:18 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:18.370833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97c1e8-e18d-4084-8817-7667f81f2491 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:18.384903 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97c1e8-e18d-4084-8817-7667f81f2491 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:18.391895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033987d7-bf9b-4867-9895-bbc3ce4b5a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:18.392822 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033987d7-bf9b-4867-9895-bbc3ce4b5a8a admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:18.393168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033987d7-bf9b-4867-9895-bbc3ce4b5a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:18.393489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033987d7-bf9b-4867-9895-bbc3ce4b5a8a admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e/groups/76f9a328bbe04eaaa9912d1857df51c4/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:18.395579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033987d7-bf9b-4867-9895-bbc3ce4b5a8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4779a5fd09a4c01853830d4bee9d75e, group_id=76f9a328bbe04eaaa9912d1857df51c4, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:18.398367 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033987d7-bf9b-4867-9895-bbc3ce4b5a8a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:18.491450 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 190/386] 10.222.0.35 () {58 vars in 1463 bytes} [Sat Feb 12 04:16:18 2022] PUT /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e/groups/76f9a328bbe04eaaa9912d1857df51c4/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:19.149651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98832054-fb4c-4398-8aa1-47520ba8f9e9 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.150041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98832054-fb4c-4398-8aa1-47520ba8f9e9 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.150211 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98832054-fb4c-4398-8aa1-47520ba8f9e9 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.151994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 197/387] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:19.157326 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795ef56-79c6-4dde-b182-bd0506d6c160 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.157606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795ef56-79c6-4dde-b182-bd0506d6c160 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.157877 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5795ef56-79c6-4dde-b182-bd0506d6c160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.182166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-5795ef56-79c6-4dde-b182-bd0506d6c160 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:19.183366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-5795ef56-79c6-4dde-b182-bd0506d6c160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:19.215993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79851c2-e77e-45c2-a3f8-6cd45e017deb None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.216297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79851c2-e77e-45c2-a3f8-6cd45e017deb None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.216544 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79851c2-e77e-45c2-a3f8-6cd45e017deb None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.218342 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 198/388] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:19.223927 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91674a0-e3af-4394-a715-77d2745bdbc0 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.224202 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91674a0-e3af-4394-a715-77d2745bdbc0 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.224474 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91674a0-e3af-4394-a715-77d2745bdbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.259183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-f91674a0-e3af-4394-a715-77d2745bdbc0 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:19.260390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f91674a0-e3af-4394-a715-77d2745bdbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:19.269422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 191/389] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:19.283248 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 199/390] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:19.296581 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795ef56-79c6-4dde-b182-bd0506d6c160 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:19.308757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5795ef56-79c6-4dde-b182-bd0506d6c160 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:19.319843 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fac1e-c515-47a5-b4d5-a89f4a3a4bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:19.320705 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fac1e-c515-47a5-b4d5-a89f4a3a4bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.321032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fac1e-c515-47a5-b4d5-a89f4a3a4bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.321304 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806fac1e-c515-47a5-b4d5-a89f4a3a4bc1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.322289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91674a0-e3af-4394-a715-77d2745bdbc0 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:19.334400 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91674a0-e3af-4394-a715-77d2745bdbc0 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:19.343429 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9391ef-2109-4f50-b2e3-d1914e2d47ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:19.344235 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9391ef-2109-4f50-b2e3-d1914e2d47ee admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.347434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9391ef-2109-4f50-b2e3-d1914e2d47ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.347720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9391ef-2109-4f50-b2e3-d1914e2d47ee admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.358152 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806fac1e-c515-47a5-b4d5-a89f4a3a4bc1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:19.365762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-806fac1e-c515-47a5-b4d5-a89f4a3a4bc1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:16:19.367286 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 192/391] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:19.371262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9391ef-2109-4f50-b2e3-d1914e2d47ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:19.372451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fac1e-c515-47a5-b4d5-a89f4a3a4bc1 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:19.377829 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-bb9391ef-2109-4f50-b2e3-d1914e2d47ee admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 04:16:19.379563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 200/392] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:19.382957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806fac1e-c515-47a5-b4d5-a89f4a3a4bc1 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:19.384982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9391ef-2109-4f50-b2e3-d1914e2d47ee admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:19.393831 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5b60b-0537-4171-bb54-3e2c7cc40f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:19.394726 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5b60b-0537-4171-bb54-3e2c7cc40f23 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.395161 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5b60b-0537-4171-bb54-3e2c7cc40f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.395630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b5b60b-0537-4171-bb54-3e2c7cc40f23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.396580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5b60b-0537-4171-bb54-3e2c7cc40f23 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:19.398094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5b60b-0537-4171-bb54-3e2c7cc40f23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:19.401202 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b5b60b-0537-4171-bb54-3e2c7cc40f23 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:19.403365 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9391ef-2109-4f50-b2e3-d1914e2d47ee admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:19.415404 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4c0bf-d3aa-4c15-8408-33eaa90ec616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:19.416576 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4c0bf-d3aa-4c15-8408-33eaa90ec616 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.417727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4c0bf-d3aa-4c15-8408-33eaa90ec616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.418135 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4c0bf-d3aa-4c15-8408-33eaa90ec616 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.421488 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 193/393] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:19.421750 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4c0bf-d3aa-4c15-8408-33eaa90ec616 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:19.422331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4c0bf-d3aa-4c15-8408-33eaa90ec616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:19.424233 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e4c0bf-d3aa-4c15-8408-33eaa90ec616 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:19.427449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5b60b-0537-4171-bb54-3e2c7cc40f23 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:19.437849 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 201/394] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:19.444061 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4c0bf-d3aa-4c15-8408-33eaa90ec616 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:19.448673 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b5b60b-0537-4171-bb54-3e2c7cc40f23 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:19.459650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4c0bf-d3aa-4c15-8408-33eaa90ec616 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:19.461326 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5cfee-5c12-4879-83b6-385a324d3116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:19.462440 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5cfee-5c12-4879-83b6-385a324d3116 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.463103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5cfee-5c12-4879-83b6-385a324d3116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.463929 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd5cfee-5c12-4879-83b6-385a324d3116 admin admin] PATH_INFO: `/v3/groups/76f9a328bbe04eaaa9912d1857df51c4` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.466490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5cfee-5c12-4879-83b6-385a324d3116 admin admin] RBAC: Authorizing `identity:get_group(group_id=76f9a328bbe04eaaa9912d1857df51c4)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:19.469940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd5cfee-5c12-4879-83b6-385a324d3116 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:19.471216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e51a15-88f5-4cd8-a202-44b42236de4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:19.473031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e51a15-88f5-4cd8-a202-44b42236de4e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.473551 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e51a15-88f5-4cd8-a202-44b42236de4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.474758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e51a15-88f5-4cd8-a202-44b42236de4e admin admin] PATH_INFO: `/v3/groups/76f9a328bbe04eaaa9912d1857df51c4` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.475905 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 194/395] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:19 2022] GET /identity/v3/groups/76f9a328bbe04eaaa9912d1857df51c4 => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:19.476421 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e51a15-88f5-4cd8-a202-44b42236de4e admin admin] RBAC: Authorizing `identity:get_group(group_id=76f9a328bbe04eaaa9912d1857df51c4)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:19.478648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e51a15-88f5-4cd8-a202-44b42236de4e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:19.480760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 202/396] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:19 2022] GET /identity/v3/groups/76f9a328bbe04eaaa9912d1857df51c4 => generated 226 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:19.481925 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5cfee-5c12-4879-83b6-385a324d3116 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:19.493473 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e51a15-88f5-4cd8-a202-44b42236de4e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:19.496072 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd5cfee-5c12-4879-83b6-385a324d3116 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:19.505899 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e51a15-88f5-4cd8-a202-44b42236de4e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:19.508757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f84de-9cc0-442f-9e09-685a867e6f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:19.509614 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f84de-9cc0-442f-9e09-685a867e6f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.509896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f84de-9cc0-442f-9e09-685a867e6f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.510181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f84de-9cc0-442f-9e09-685a867e6f68 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.511969 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5babd8a-70aa-403c-a473-45765374bbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:19.513108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5babd8a-70aa-403c-a473-45765374bbbc admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.513599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5babd8a-70aa-403c-a473-45765374bbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.514123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5babd8a-70aa-403c-a473-45765374bbbc admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.515555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5babd8a-70aa-403c-a473-45765374bbbc admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:19.516000 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f84de-9cc0-442f-9e09-685a867e6f68 admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:19.518629 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f84de-9cc0-442f-9e09-685a867e6f68 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:19.518869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5babd8a-70aa-403c-a473-45765374bbbc admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:19.520710 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 195/397] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:19 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:19.521217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 203/398] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:19 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:19.525882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f84de-9cc0-442f-9e09-685a867e6f68 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:19.528268 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5babd8a-70aa-403c-a473-45765374bbbc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:19.539114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5babd8a-70aa-403c-a473-45765374bbbc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:19.546160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bed62e-e95a-41cf-880e-53be45dc1682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:19.547217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bed62e-e95a-41cf-880e-53be45dc1682 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.547701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f84de-9cc0-442f-9e09-685a867e6f68 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:19.547910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bed62e-e95a-41cf-880e-53be45dc1682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.548481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bed62e-e95a-41cf-880e-53be45dc1682 admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e/groups/76f9a328bbe04eaaa9912d1857df51c4/roles/b9252c31847f4513a49cd10bb4f9cdaa` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.551103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bed62e-e95a-41cf-880e-53be45dc1682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4779a5fd09a4c01853830d4bee9d75e, group_id=76f9a328bbe04eaaa9912d1857df51c4, role_id=b9252c31847f4513a49cd10bb4f9cdaa)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:19.554410 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bed62e-e95a-41cf-880e-53be45dc1682 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:19.560747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82d14a-a529-4d94-93aa-5e1b6fdb8500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:19.561620 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82d14a-a529-4d94-93aa-5e1b6fdb8500 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.561897 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82d14a-a529-4d94-93aa-5e1b6fdb8500 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.562168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82d14a-a529-4d94-93aa-5e1b6fdb8500 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6/groups/76f9a328bbe04eaaa9912d1857df51c4/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.568571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82d14a-a529-4d94-93aa-5e1b6fdb8500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=438e35c51ae94615bf6eb31f94403eb6, group_id=76f9a328bbe04eaaa9912d1857df51c4, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:19.571334 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82d14a-a529-4d94-93aa-5e1b6fdb8500 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:19.639956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 204/399] 10.222.0.35 () {58 vars in 1463 bytes} [Sat Feb 12 04:16:19 2022] PUT /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e/groups/76f9a328bbe04eaaa9912d1857df51c4/roles/b9252c31847f4513a49cd10bb4f9cdaa => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:16:19.655522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdc094-e826-4959-8fee-b81dc53d5ca2 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.656086 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdc094-e826-4959-8fee-b81dc53d5ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.656529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cdc094-e826-4959-8fee-b81dc53d5ca2 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.659052 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 205/400] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:19.665193 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4917b6f-9a35-45a0-9ad5-e7ddb74e5168 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.665681 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4917b6f-9a35-45a0-9ad5-e7ddb74e5168 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.666115 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4917b6f-9a35-45a0-9ad5-e7ddb74e5168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.686651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c4917b6f-9a35-45a0-9ad5-e7ddb74e5168 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:19.688244 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c4917b6f-9a35-45a0-9ad5-e7ddb74e5168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:19.702872 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 196/401] 10.222.0.35 () {58 vars in 1463 bytes} [Sat Feb 12 04:16:19 2022] PUT /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6/groups/76f9a328bbe04eaaa9912d1857df51c4/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:16:19.762557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 206/402] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:19 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:19.788393 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82d14a-a529-4d94-93aa-5e1b6fdb8500 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:19.878989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82d14a-a529-4d94-93aa-5e1b6fdb8500 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:19.890818 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd40d47-ef72-4701-918d-02c915362fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:19.891668 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd40d47-ef72-4701-918d-02c915362fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.891946 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd40d47-ef72-4701-918d-02c915362fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.892218 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd40d47-ef72-4701-918d-02c915362fc2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.905960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd40d47-ef72-4701-918d-02c915362fc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:19.913484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-8bd40d47-ef72-4701-918d-02c915362fc2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 04:16:19.915005 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 197/403] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:19.925415 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4917b6f-9a35-45a0-9ad5-e7ddb74e5168 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:19.937151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4917b6f-9a35-45a0-9ad5-e7ddb74e5168 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:19.944812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83c125-8ee3-43e3-a189-0b8d356c668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:19.945900 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83c125-8ee3-43e3-a189-0b8d356c668b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:19.946399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83c125-8ee3-43e3-a189-0b8d356c668b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:19.946917 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b83c125-8ee3-43e3-a189-0b8d356c668b admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:19.947929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83c125-8ee3-43e3-a189-0b8d356c668b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:19.948465 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83c125-8ee3-43e3-a189-0b8d356c668b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:19.955208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b83c125-8ee3-43e3-a189-0b8d356c668b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:19.970779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 207/404] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:19.977774 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd40d47-ef72-4701-918d-02c915362fc2 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:19.989645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd40d47-ef72-4701-918d-02c915362fc2 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:20.000817 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62935466-39f3-4a2a-838b-1983d2d3cedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:20.001725 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62935466-39f3-4a2a-838b-1983d2d3cedd admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:20.002000 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62935466-39f3-4a2a-838b-1983d2d3cedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:20.002343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62935466-39f3-4a2a-838b-1983d2d3cedd admin admin] PATH_INFO: `/v3/groups/76f9a328bbe04eaaa9912d1857df51c4` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:20.004457 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62935466-39f3-4a2a-838b-1983d2d3cedd admin admin] RBAC: Authorizing `identity:get_group(group_id=76f9a328bbe04eaaa9912d1857df51c4)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:20.006347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62935466-39f3-4a2a-838b-1983d2d3cedd admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:20.012536 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 198/405] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:19 2022] GET /identity/v3/groups/76f9a328bbe04eaaa9912d1857df51c4 => generated 226 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:20.013881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83c125-8ee3-43e3-a189-0b8d356c668b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:20.031251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b83c125-8ee3-43e3-a189-0b8d356c668b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:20.040802 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af461c-6a34-4394-bb52-dbe4d47f5eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:20.041978 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af461c-6a34-4394-bb52-dbe4d47f5eaa admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:20.042461 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af461c-6a34-4394-bb52-dbe4d47f5eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:20.042932 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af461c-6a34-4394-bb52-dbe4d47f5eaa admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:20.044392 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af461c-6a34-4394-bb52-dbe4d47f5eaa admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:20.046631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af461c-6a34-4394-bb52-dbe4d47f5eaa admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:20.048552 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 208/406] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:20 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:20.055185 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62935466-39f3-4a2a-838b-1983d2d3cedd admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:20.068976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62935466-39f3-4a2a-838b-1983d2d3cedd admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:20.079680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b78fc-2433-486e-a726-df8e8af75b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:20.080772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b78fc-2433-486e-a726-df8e8af75b87 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:20.081091 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b78fc-2433-486e-a726-df8e8af75b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:20.081410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b78fc-2433-486e-a726-df8e8af75b87 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6/groups/76f9a328bbe04eaaa9912d1857df51c4/roles/b9252c31847f4513a49cd10bb4f9cdaa` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:20.085177 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b78fc-2433-486e-a726-df8e8af75b87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=438e35c51ae94615bf6eb31f94403eb6, group_id=76f9a328bbe04eaaa9912d1857df51c4, role_id=b9252c31847f4513a49cd10bb4f9cdaa)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:20.087987 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b78fc-2433-486e-a726-df8e8af75b87 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:20.161255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 199/407] 10.222.0.35 () {58 vars in 1463 bytes} [Sat Feb 12 04:16:20 2022] PUT /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6/groups/76f9a328bbe04eaaa9912d1857df51c4/roles/b9252c31847f4513a49cd10bb4f9cdaa => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:20.836476 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a01f80-2392-4067-ae46-33d5d0d16260 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:20.836988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a01f80-2392-4067-ae46-33d5d0d16260 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:20.836988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a01f80-2392-4067-ae46-33d5d0d16260 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:20.839071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 209/408] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:20.844172 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaf154-c7b7-494f-8ddd-438e2f2ba341 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:20.844599 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaf154-c7b7-494f-8ddd-438e2f2ba341 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:20.844770 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaf154-c7b7-494f-8ddd-438e2f2ba341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:20.866650 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-14aaf154-c7b7-494f-8ddd-438e2f2ba341 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:20.867868 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-14aaf154-c7b7-494f-8ddd-438e2f2ba341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:20.938150 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 200/409] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:20.973072 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a01f80-2392-4067-ae46-33d5d0d16260 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:20.985321 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a01f80-2392-4067-ae46-33d5d0d16260 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:20.992113 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef1e10-3325-4d4d-8ad9-37016188b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:20.992892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef1e10-3325-4d4d-8ad9-37016188b4ab admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:20.993168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef1e10-3325-4d4d-8ad9-37016188b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:20.993436 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef1e10-3325-4d4d-8ad9-37016188b4ab admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:21.006853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef1e10-3325-4d4d-8ad9-37016188b4ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:21.013717 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-eeef1e10-3325-4d4d-8ad9-37016188b4ab admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:16:21.014928 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 210/410] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:21.021423 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaf154-c7b7-494f-8ddd-438e2f2ba341 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:21.036682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaf154-c7b7-494f-8ddd-438e2f2ba341 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:21.047864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadb29a-be64-4390-86fc-5b6e22592593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:21.048795 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadb29a-be64-4390-86fc-5b6e22592593 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:21.049434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadb29a-be64-4390-86fc-5b6e22592593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:21.050223 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadb29a-be64-4390-86fc-5b6e22592593 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:21.051208 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadb29a-be64-4390-86fc-5b6e22592593 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:21.051737 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadb29a-be64-4390-86fc-5b6e22592593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:21.053538 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadb29a-be64-4390-86fc-5b6e22592593 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:21.063295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 201/411] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:21.068959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef1e10-3325-4d4d-8ad9-37016188b4ab admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:21.084663 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef1e10-3325-4d4d-8ad9-37016188b4ab admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:21.091676 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcaf35-152e-4617-a19c-ad6dcd3bcf32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:21.092453 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcaf35-152e-4617-a19c-ad6dcd3bcf32 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:21.092727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcaf35-152e-4617-a19c-ad6dcd3bcf32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:21.092996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcaf35-152e-4617-a19c-ad6dcd3bcf32 admin admin] PATH_INFO: `/v3/groups/2dfe8b2ce1f4456a9d89b33ac022ce4a` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:21.095713 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcaf35-152e-4617-a19c-ad6dcd3bcf32 admin admin] RBAC: Authorizing `identity:get_group(group_id=2dfe8b2ce1f4456a9d89b33ac022ce4a)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:21.098278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcaf35-152e-4617-a19c-ad6dcd3bcf32 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:21.100257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 211/412] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:21 2022] GET /identity/v3/groups/2dfe8b2ce1f4456a9d89b33ac022ce4a => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:21.105360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadb29a-be64-4390-86fc-5b6e22592593 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:21.117501 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadb29a-be64-4390-86fc-5b6e22592593 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:21.127183 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80ee26-f011-4529-959a-8407444042b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:21.128605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80ee26-f011-4529-959a-8407444042b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:21.128874 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80ee26-f011-4529-959a-8407444042b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:21.129142 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80ee26-f011-4529-959a-8407444042b4 admin admin] PATH_INFO: `/v3/projects/b029942a00eb466b8575ae912b6910ac` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:21.130354 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80ee26-f011-4529-959a-8407444042b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=b029942a00eb466b8575ae912b6910ac)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:21.132144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80ee26-f011-4529-959a-8407444042b4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:21.134081 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 202/413] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:21 2022] GET /identity/v3/projects/b029942a00eb466b8575ae912b6910ac => generated 344 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:21.139623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcaf35-152e-4617-a19c-ad6dcd3bcf32 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:21.151789 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcaf35-152e-4617-a19c-ad6dcd3bcf32 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:21.158230 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec7bfc-6cdc-40b2-9909-fb2391d13d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:21.159933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec7bfc-6cdc-40b2-9909-fb2391d13d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:21.160258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec7bfc-6cdc-40b2-9909-fb2391d13d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:21.160530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec7bfc-6cdc-40b2-9909-fb2391d13d5c admin admin] PATH_INFO: `/v3/projects/b029942a00eb466b8575ae912b6910ac/groups/2dfe8b2ce1f4456a9d89b33ac022ce4a/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:21.163755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec7bfc-6cdc-40b2-9909-fb2391d13d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b029942a00eb466b8575ae912b6910ac, group_id=2dfe8b2ce1f4456a9d89b33ac022ce4a, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:21.166501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec7bfc-6cdc-40b2-9909-fb2391d13d5c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:21.281565 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 212/414] 10.222.0.35 () {58 vars in 1463 bytes} [Sat Feb 12 04:16:21 2022] PUT /identity/v3/projects/b029942a00eb466b8575ae912b6910ac/groups/2dfe8b2ce1f4456a9d89b33ac022ce4a/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:21.678811 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb2cb1-dc33-41fd-bc2c-cdffb598f94c None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:21.679200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb2cb1-dc33-41fd-bc2c-cdffb598f94c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:21.679424 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb2cb1-dc33-41fd-bc2c-cdffb598f94c None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:21.681693 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 203/415] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:21.687826 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93150269-3a67-456c-9d34-1a87b097df47 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:21.688112 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93150269-3a67-456c-9d34-1a87b097df47 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:21.688387 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93150269-3a67-456c-9d34-1a87b097df47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:21.711734 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-93150269-3a67-456c-9d34-1a87b097df47 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:21.713215 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-93150269-3a67-456c-9d34-1a87b097df47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:21.790339 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 213/416] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:21.825783 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb2cb1-dc33-41fd-bc2c-cdffb598f94c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:21.841102 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb2cb1-dc33-41fd-bc2c-cdffb598f94c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:21.845684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62691dc-2816-4268-8731-9ddf6af66187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:21.847672 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62691dc-2816-4268-8731-9ddf6af66187 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:21.848147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62691dc-2816-4268-8731-9ddf6af66187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:21.848626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62691dc-2816-4268-8731-9ddf6af66187 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:21.864751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62691dc-2816-4268-8731-9ddf6af66187 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:21.871990 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-b62691dc-2816-4268-8731-9ddf6af66187 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:16:21.873700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 204/417] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:21.880448 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93150269-3a67-456c-9d34-1a87b097df47 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:21.890189 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93150269-3a67-456c-9d34-1a87b097df47 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:21.895042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84a604-218d-4198-9810-7a4930aa9a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:21.895983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84a604-218d-4198-9810-7a4930aa9a77 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:21.896459 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84a604-218d-4198-9810-7a4930aa9a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:21.896938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a84a604-218d-4198-9810-7a4930aa9a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:21.897911 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84a604-218d-4198-9810-7a4930aa9a77 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:21.898445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84a604-218d-4198-9810-7a4930aa9a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:21.900300 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a84a604-218d-4198-9810-7a4930aa9a77 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:21.917819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 214/418] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:21.923631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62691dc-2816-4268-8731-9ddf6af66187 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:21.941361 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62691dc-2816-4268-8731-9ddf6af66187 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:21.946126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc78aae-e1cd-4188-b773-90cacf5ec0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:21.947022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78aae-e1cd-4188-b773-90cacf5ec0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:21.947522 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78aae-e1cd-4188-b773-90cacf5ec0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:21.947995 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc78aae-e1cd-4188-b773-90cacf5ec0a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:21.961175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc78aae-e1cd-4188-b773-90cacf5ec0a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:21.963255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc78aae-e1cd-4188-b773-90cacf5ec0a2 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:21.977096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 205/419] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:21.982878 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84a604-218d-4198-9810-7a4930aa9a77 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:21.996327 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a84a604-218d-4198-9810-7a4930aa9a77 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:22.000998 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed61272-2701-498c-83e0-45e2098a4051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:22.002099 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61272-2701-498c-83e0-45e2098a4051 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.003171 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61272-2701-498c-83e0-45e2098a4051 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.003658 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61272-2701-498c-83e0-45e2098a4051 admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.005053 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed61272-2701-498c-83e0-45e2098a4051 admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:22.007289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed61272-2701-498c-83e0-45e2098a4051 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:22.009163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 215/420] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:21 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:22.014899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc78aae-e1cd-4188-b773-90cacf5ec0a2 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:22.024190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc78aae-e1cd-4188-b773-90cacf5ec0a2 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:22.028847 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b1be1-1504-44f3-baba-343c1eecedde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:22.029924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b1be1-1504-44f3-baba-343c1eecedde admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.030419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b1be1-1504-44f3-baba-343c1eecedde admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.030882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b1be1-1504-44f3-baba-343c1eecedde admin admin] PATH_INFO: `/v3/groups/76f9a328bbe04eaaa9912d1857df51c4` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.032287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b1be1-1504-44f3-baba-343c1eecedde admin admin] RBAC: Authorizing `identity:get_group(group_id=76f9a328bbe04eaaa9912d1857df51c4)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:22.034934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b1be1-1504-44f3-baba-343c1eecedde admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:22.039801 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 206/421] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:22 2022] GET /identity/v3/groups/76f9a328bbe04eaaa9912d1857df51c4 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:22.045711 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed61272-2701-498c-83e0-45e2098a4051 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:22.056044 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed61272-2701-498c-83e0-45e2098a4051 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:22.060623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cb29f-7330-427b-ab28-24835005c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:22.061500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cb29f-7330-427b-ab28-24835005c6ce admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.061992 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cb29f-7330-427b-ab28-24835005c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.062452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cb29f-7330-427b-ab28-24835005c6ce admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.063540 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cb29f-7330-427b-ab28-24835005c6ce admin admin] RBAC: Adding query filter params (group.id=76f9a328bbe04eaaa9912d1857df51c4, role.id=ca6edcc85e3841d9bebb1b58cecb96d3, scope.project.id=f4779a5fd09a4c01853830d4bee9d75e) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:22.064041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cb29f-7330-427b-ab28-24835005c6ce admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:22.068306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cb29f-7330-427b-ab28-24835005c6ce admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:22.075107 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 216/422] 10.222.0.35 () {56 vars in 1397 bytes} [Sat Feb 12 04:16:22 2022] GET /identity/v3/role_assignments?group.id=76f9a328bbe04eaaa9912d1857df51c4&scope.project.id=f4779a5fd09a4c01853830d4bee9d75e&role.id=ca6edcc85e3841d9bebb1b58cecb96d3 => generated 611 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:22.560669 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e9df4-a902-429a-be4c-ca48eae158f8 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.560887 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e9df4-a902-429a-be4c-ca48eae158f8 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.561252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e9df4-a902-429a-be4c-ca48eae158f8 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.563138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 207/423] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:22.569168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1574a-0777-48ca-9af8-4fbe5901248d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.569455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1574a-0777-48ca-9af8-4fbe5901248d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.569732 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1574a-0777-48ca-9af8-4fbe5901248d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.593457 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-faa1574a-0777-48ca-9af8-4fbe5901248d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:22.594643 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-faa1574a-0777-48ca-9af8-4fbe5901248d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:22.606739 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 217/424] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:22.633155 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e9df4-a902-429a-be4c-ca48eae158f8 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:22.646507 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e9df4-a902-429a-be4c-ca48eae158f8 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:22.651098 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18ce53-3d07-4819-8d5b-d1543566fb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:22.651957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18ce53-3d07-4819-8d5b-d1543566fb0c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.652233 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18ce53-3d07-4819-8d5b-d1543566fb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.652501 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18ce53-3d07-4819-8d5b-d1543566fb0c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.666015 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18ce53-3d07-4819-8d5b-d1543566fb0c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:22.673090 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-7a18ce53-3d07-4819-8d5b-d1543566fb0c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Feb 12 04:16:22.674334 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 208/425] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:22.681807 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1574a-0777-48ca-9af8-4fbe5901248d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:22.692701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1574a-0777-48ca-9af8-4fbe5901248d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:22.697402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305f19c-74f1-4530-a1ea-c2de3d9201d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:22.698111 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305f19c-74f1-4530-a1ea-c2de3d9201d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.698391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305f19c-74f1-4530-a1ea-c2de3d9201d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.698663 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305f19c-74f1-4530-a1ea-c2de3d9201d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.700086 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305f19c-74f1-4530-a1ea-c2de3d9201d1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:22.700411 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305f19c-74f1-4530-a1ea-c2de3d9201d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:22.701722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81e308-05f4-4026-aa54-747861516b47 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.702003 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81e308-05f4-4026-aa54-747861516b47 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.702103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305f19c-74f1-4530-a1ea-c2de3d9201d1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:22.702276 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f81e308-05f4-4026-aa54-747861516b47 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.704424 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 209/426] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:22.710999 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e51fb-e23c-487e-9956-0ecb1d986bca None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.711313 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e51fb-e23c-487e-9956-0ecb1d986bca None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.711584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e51fb-e23c-487e-9956-0ecb1d986bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.715525 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 218/427] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:16:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:22.722417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305f19c-74f1-4530-a1ea-c2de3d9201d1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:22.734350 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305f19c-74f1-4530-a1ea-c2de3d9201d1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:22.738693 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-2d8e51fb-e23c-487e-9956-0ecb1d986bca None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:22.740118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9f513-13da-4670-9bab-e8de16afd715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:22.740349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2d8e51fb-e23c-487e-9956-0ecb1d986bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:22.740866 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9f513-13da-4670-9bab-e8de16afd715 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.741153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9f513-13da-4670-9bab-e8de16afd715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.741505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9f513-13da-4670-9bab-e8de16afd715 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.749455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 210/428] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:22.751274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9f513-13da-4670-9bab-e8de16afd715 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:22.752058 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9f513-13da-4670-9bab-e8de16afd715 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:22.766230 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 219/429] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:22.767709 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e51fb-e23c-487e-9956-0ecb1d986bca None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:22.779862 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e51fb-e23c-487e-9956-0ecb1d986bca None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:22.782639 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9f513-13da-4670-9bab-e8de16afd715 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:22.788934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f921e2-ea04-4291-a030-cebf94da7659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:22.789800 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f921e2-ea04-4291-a030-cebf94da7659 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.790075 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f921e2-ea04-4291-a030-cebf94da7659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.790339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f921e2-ea04-4291-a030-cebf94da7659 admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.791567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f921e2-ea04-4291-a030-cebf94da7659 admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:22.793575 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f921e2-ea04-4291-a030-cebf94da7659 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:22.794358 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9f513-13da-4670-9bab-e8de16afd715 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:22.799673 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 211/430] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:22 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:22.801515 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cad3fb-5c52-4f28-83d0-0762e291d28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:22.803358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f921e2-ea04-4291-a030-cebf94da7659 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:22.804263 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cad3fb-5c52-4f28-83d0-0762e291d28a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.806879 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cad3fb-5c52-4f28-83d0-0762e291d28a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.807434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cad3fb-5c52-4f28-83d0-0762e291d28a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.815319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f921e2-ea04-4291-a030-cebf94da7659 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:22.820672 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e10446-7e20-4777-a034-907e64cb8921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:22.821081 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cad3fb-5c52-4f28-83d0-0762e291d28a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:22.821514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e10446-7e20-4777-a034-907e64cb8921 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.821844 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e10446-7e20-4777-a034-907e64cb8921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.822119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e10446-7e20-4777-a034-907e64cb8921 admin admin] PATH_INFO: `/v3/groups/76f9a328bbe04eaaa9912d1857df51c4` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.823335 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e10446-7e20-4777-a034-907e64cb8921 admin admin] RBAC: Authorizing `identity:get_group(group_id=76f9a328bbe04eaaa9912d1857df51c4)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:22.825214 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e10446-7e20-4777-a034-907e64cb8921 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:22.831844 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 212/431] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:22 2022] GET /identity/v3/groups/76f9a328bbe04eaaa9912d1857df51c4 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:22.832705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-58cad3fb-5c52-4f28-83d0-0762e291d28a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 04:16:22.833527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e10446-7e20-4777-a034-907e64cb8921 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:22.834665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 220/432] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:22.840369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cad3fb-5c52-4f28-83d0-0762e291d28a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:22.844805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e10446-7e20-4777-a034-907e64cb8921 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:22.853099 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c8c71-4ab2-4216-8418-0020cda2f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:22.854518 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8c71-4ab2-4216-8418-0020cda2f893 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.855401 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8c71-4ab2-4216-8418-0020cda2f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.856656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8c71-4ab2-4216-8418-0020cda2f893 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.857631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cad3fb-5c52-4f28-83d0-0762e291d28a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:22.858215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c8c71-4ab2-4216-8418-0020cda2f893 admin admin] RBAC: Adding query filter params (group.id=76f9a328bbe04eaaa9912d1857df51c4, role.id=ca6edcc85e3841d9bebb1b58cecb96d3, scope.project.id=438e35c51ae94615bf6eb31f94403eb6) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:22.859429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c8c71-4ab2-4216-8418-0020cda2f893 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:22.863192 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c8c71-4ab2-4216-8418-0020cda2f893 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:22.873701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 213/433] 10.222.0.35 () {56 vars in 1397 bytes} [Sat Feb 12 04:16:22 2022] GET /identity/v3/role_assignments?group.id=76f9a328bbe04eaaa9912d1857df51c4&scope.project.id=438e35c51ae94615bf6eb31f94403eb6&role.id=ca6edcc85e3841d9bebb1b58cecb96d3 => generated 611 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:22.879969 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d485632-4605-4160-a06b-dcf160c802a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:22.880658 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d485632-4605-4160-a06b-dcf160c802a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.881174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d485632-4605-4160-a06b-dcf160c802a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.881174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d485632-4605-4160-a06b-dcf160c802a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.881954 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d485632-4605-4160-a06b-dcf160c802a2 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:22.882256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d485632-4605-4160-a06b-dcf160c802a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:22.883933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d485632-4605-4160-a06b-dcf160c802a2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:22.893839 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 221/434] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:22.902110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c8c71-4ab2-4216-8418-0020cda2f893 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:22.916921 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c8c71-4ab2-4216-8418-0020cda2f893 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:22.922961 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763372d-4e75-4b7b-aa89-7ea4170d463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:22.924608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763372d-4e75-4b7b-aa89-7ea4170d463e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.925151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763372d-4e75-4b7b-aa89-7ea4170d463e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.925621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763372d-4e75-4b7b-aa89-7ea4170d463e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.936612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763372d-4e75-4b7b-aa89-7ea4170d463e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:22.938921 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763372d-4e75-4b7b-aa89-7ea4170d463e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:22.950022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 214/435] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:22.956599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d485632-4605-4160-a06b-dcf160c802a2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:22.969284 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d485632-4605-4160-a06b-dcf160c802a2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:22.979264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe01a5-92ad-46ba-b9ba-e70550099baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:22.980131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe01a5-92ad-46ba-b9ba-e70550099baa admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:22.980444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe01a5-92ad-46ba-b9ba-e70550099baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:22.980689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe01a5-92ad-46ba-b9ba-e70550099baa admin admin] PATH_INFO: `/v3/projects/f4779a5fd09a4c01853830d4bee9d75e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:22.981929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe01a5-92ad-46ba-b9ba-e70550099baa admin admin] RBAC: Authorizing `identity:get_project(project_id=f4779a5fd09a4c01853830d4bee9d75e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:22.984040 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe01a5-92ad-46ba-b9ba-e70550099baa admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:22.986135 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 222/436] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:22 2022] GET /identity/v3/projects/f4779a5fd09a4c01853830d4bee9d75e => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:22.992100 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763372d-4e75-4b7b-aa89-7ea4170d463e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:23.001807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763372d-4e75-4b7b-aa89-7ea4170d463e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:23.007866 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088a52d-5954-4dc2-b41f-51e1fe3e69fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:23.008963 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088a52d-5954-4dc2-b41f-51e1fe3e69fa admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:23.009414 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088a52d-5954-4dc2-b41f-51e1fe3e69fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:23.009825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088a52d-5954-4dc2-b41f-51e1fe3e69fa admin admin] PATH_INFO: `/v3/groups/76f9a328bbe04eaaa9912d1857df51c4` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:23.011200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088a52d-5954-4dc2-b41f-51e1fe3e69fa admin admin] RBAC: Authorizing `identity:get_group(group_id=76f9a328bbe04eaaa9912d1857df51c4)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:23.013259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088a52d-5954-4dc2-b41f-51e1fe3e69fa admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:23.015369 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 215/437] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:22 2022] GET /identity/v3/groups/76f9a328bbe04eaaa9912d1857df51c4 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:23.022182 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe01a5-92ad-46ba-b9ba-e70550099baa admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:23.034785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe01a5-92ad-46ba-b9ba-e70550099baa admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:23.041997 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc111d54-3117-4db7-96d2-2d2f2e36eb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:23.042929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc111d54-3117-4db7-96d2-2d2f2e36eb8b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:23.043425 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc111d54-3117-4db7-96d2-2d2f2e36eb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:23.043869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc111d54-3117-4db7-96d2-2d2f2e36eb8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:23.044903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc111d54-3117-4db7-96d2-2d2f2e36eb8b admin admin] RBAC: Adding query filter params (group.id=76f9a328bbe04eaaa9912d1857df51c4, role.id=b9252c31847f4513a49cd10bb4f9cdaa, scope.project.id=f4779a5fd09a4c01853830d4bee9d75e) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:23.045370 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc111d54-3117-4db7-96d2-2d2f2e36eb8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:23.047505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc111d54-3117-4db7-96d2-2d2f2e36eb8b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:23.059734 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 223/438] 10.222.0.35 () {56 vars in 1397 bytes} [Sat Feb 12 04:16:23 2022] GET /identity/v3/role_assignments?group.id=76f9a328bbe04eaaa9912d1857df51c4&scope.project.id=f4779a5fd09a4c01853830d4bee9d75e&role.id=b9252c31847f4513a49cd10bb4f9cdaa => generated 611 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:23.333751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c815a-041a-4e0e-9b11-971d269b18be None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:23.334093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c815a-041a-4e0e-9b11-971d269b18be None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:23.334305 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c815a-041a-4e0e-9b11-971d269b18be None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:23.336148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 216/439] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:23.341678 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ca46e-3ff5-4ad7-89d5-5bff8128173d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:23.341965 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ca46e-3ff5-4ad7-89d5-5bff8128173d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:23.342235 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ca46e-3ff5-4ad7-89d5-5bff8128173d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:23.360680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-8b4ca46e-3ff5-4ad7-89d5-5bff8128173d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:23.361915 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-8b4ca46e-3ff5-4ad7-89d5-5bff8128173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:23.369617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 224/440] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:23.396291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c815a-041a-4e0e-9b11-971d269b18be None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:23.409037 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c815a-041a-4e0e-9b11-971d269b18be None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:23.413507 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0e3ef-cb6e-422e-9808-db384cac7a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:23.414198 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0e3ef-cb6e-422e-9808-db384cac7a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:23.414476 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0e3ef-cb6e-422e-9808-db384cac7a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:23.414749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0e3ef-cb6e-422e-9808-db384cac7a00 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:23.425848 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0e3ef-cb6e-422e-9808-db384cac7a00 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:23.433288 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-6cb0e3ef-cb6e-422e-9808-db384cac7a00 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 04:16:23.434495 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 217/441] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:23.441038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ca46e-3ff5-4ad7-89d5-5bff8128173d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:23.451750 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ca46e-3ff5-4ad7-89d5-5bff8128173d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:23.456789 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc6b5d-4125-43b0-b736-181d7f981a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:23.457441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc6b5d-4125-43b0-b736-181d7f981a12 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:23.457719 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc6b5d-4125-43b0-b736-181d7f981a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:23.457996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc6b5d-4125-43b0-b736-181d7f981a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:23.458763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc6b5d-4125-43b0-b736-181d7f981a12 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:23.459080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc6b5d-4125-43b0-b736-181d7f981a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:23.460683 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc6b5d-4125-43b0-b736-181d7f981a12 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:23.469498 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 225/442] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:23.475575 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0e3ef-cb6e-422e-9808-db384cac7a00 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:23.486138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0e3ef-cb6e-422e-9808-db384cac7a00 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:23.491138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e533621-d62a-474e-8576-62045b79f971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:23.491804 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e533621-d62a-474e-8576-62045b79f971 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:23.492090 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e533621-d62a-474e-8576-62045b79f971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:23.492369 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e533621-d62a-474e-8576-62045b79f971 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:23.501610 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e533621-d62a-474e-8576-62045b79f971 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:23.503941 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e533621-d62a-474e-8576-62045b79f971 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:23.517861 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 218/443] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:23.520075 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc6b5d-4125-43b0-b736-181d7f981a12 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:23.530595 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc6b5d-4125-43b0-b736-181d7f981a12 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:23.535648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a2452-e959-49d3-81f0-3642733aef3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:23.536505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a2452-e959-49d3-81f0-3642733aef3f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:23.536792 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a2452-e959-49d3-81f0-3642733aef3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:23.537067 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a2452-e959-49d3-81f0-3642733aef3f admin admin] PATH_INFO: `/v3/projects/438e35c51ae94615bf6eb31f94403eb6` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:23.540021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a2452-e959-49d3-81f0-3642733aef3f admin admin] RBAC: Authorizing `identity:get_project(project_id=438e35c51ae94615bf6eb31f94403eb6)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:23.541892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a2452-e959-49d3-81f0-3642733aef3f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:23.543796 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 226/444] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:23 2022] GET /identity/v3/projects/438e35c51ae94615bf6eb31f94403eb6 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:23.549567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e533621-d62a-474e-8576-62045b79f971 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:23.560184 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e533621-d62a-474e-8576-62045b79f971 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:23.566063 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a029c4c-ea30-4c94-9524-73244da504e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:23.566964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029c4c-ea30-4c94-9524-73244da504e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:23.567259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029c4c-ea30-4c94-9524-73244da504e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:23.567542 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a029c4c-ea30-4c94-9524-73244da504e5 admin admin] PATH_INFO: `/v3/groups/76f9a328bbe04eaaa9912d1857df51c4` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:23.568765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a029c4c-ea30-4c94-9524-73244da504e5 admin admin] RBAC: Authorizing `identity:get_group(group_id=76f9a328bbe04eaaa9912d1857df51c4)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:23.570659 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a029c4c-ea30-4c94-9524-73244da504e5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:23.572501 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 219/445] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:23 2022] GET /identity/v3/groups/76f9a328bbe04eaaa9912d1857df51c4 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:23.578759 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a2452-e959-49d3-81f0-3642733aef3f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:23.589141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a2452-e959-49d3-81f0-3642733aef3f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:23.599473 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67adfdd0-aa4a-41f5-aeb8-5ccb501224a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:23.600137 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adfdd0-aa4a-41f5-aeb8-5ccb501224a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:23.600425 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adfdd0-aa4a-41f5-aeb8-5ccb501224a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:23.600702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67adfdd0-aa4a-41f5-aeb8-5ccb501224a8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:23.601580 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adfdd0-aa4a-41f5-aeb8-5ccb501224a8 admin admin] RBAC: Adding query filter params (group.id=76f9a328bbe04eaaa9912d1857df51c4, role.id=b9252c31847f4513a49cd10bb4f9cdaa, scope.project.id=438e35c51ae94615bf6eb31f94403eb6) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:23.601873 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adfdd0-aa4a-41f5-aeb8-5ccb501224a8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:23.603749 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67adfdd0-aa4a-41f5-aeb8-5ccb501224a8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:23.615522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 227/446] 10.222.0.35 () {56 vars in 1397 bytes} [Sat Feb 12 04:16:23 2022] GET /identity/v3/role_assignments?group.id=76f9a328bbe04eaaa9912d1857df51c4&scope.project.id=438e35c51ae94615bf6eb31f94403eb6&role.id=b9252c31847f4513a49cd10bb4f9cdaa => generated 611 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:24.093309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab71bb-6872-4fd4-a1e2-9aebc66f7f5b None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:24.093824 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab71bb-6872-4fd4-a1e2-9aebc66f7f5b None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:24.093824 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab71bb-6872-4fd4-a1e2-9aebc66f7f5b None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:24.095632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 220/447] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:24.100892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee231f-dac3-435a-b278-e6c03f5de6cb None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:24.101264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee231f-dac3-435a-b278-e6c03f5de6cb None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:24.101446 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee231f-dac3-435a-b278-e6c03f5de6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:24.118676 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-0dee231f-dac3-435a-b278-e6c03f5de6cb None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:24.119876 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-0dee231f-dac3-435a-b278-e6c03f5de6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:24.127631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 228/448] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:24.150791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab71bb-6872-4fd4-a1e2-9aebc66f7f5b None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:24.162849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab71bb-6872-4fd4-a1e2-9aebc66f7f5b None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:24.166988 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad22ade-f17f-468b-b7c6-c5d4fa90db2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:24.167778 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad22ade-f17f-468b-b7c6-c5d4fa90db2f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:24.168058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad22ade-f17f-468b-b7c6-c5d4fa90db2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:24.168333 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad22ade-f17f-468b-b7c6-c5d4fa90db2f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:24.178413 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad22ade-f17f-468b-b7c6-c5d4fa90db2f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:24.185433 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-2ad22ade-f17f-468b-b7c6-c5d4fa90db2f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:16:24.186568 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 221/449] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:24.192715 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee231f-dac3-435a-b278-e6c03f5de6cb None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:24.201418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee231f-dac3-435a-b278-e6c03f5de6cb None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:24.206233 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b1fa9-d819-4861-ae21-adbeec1ea9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:24.207036 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1fa9-d819-4861-ae21-adbeec1ea9ae admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:24.207346 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1fa9-d819-4861-ae21-adbeec1ea9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:24.207617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b1fa9-d819-4861-ae21-adbeec1ea9ae admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:24.208373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b1fa9-d819-4861-ae21-adbeec1ea9ae admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:24.208674 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b1fa9-d819-4861-ae21-adbeec1ea9ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:24.210247 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395b1fa9-d819-4861-ae21-adbeec1ea9ae admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:24.218090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 229/450] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:24.223315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad22ade-f17f-468b-b7c6-c5d4fa90db2f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:24.232543 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad22ade-f17f-468b-b7c6-c5d4fa90db2f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:24.236802 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cca228-c023-4c8b-863b-06d1a2c38c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:24.237496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cca228-c023-4c8b-863b-06d1a2c38c2a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:24.237772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cca228-c023-4c8b-863b-06d1a2c38c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:24.238042 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cca228-c023-4c8b-863b-06d1a2c38c2a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:24.246041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cca228-c023-4c8b-863b-06d1a2c38c2a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:24.247790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cca228-c023-4c8b-863b-06d1a2c38c2a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:24.256697 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 222/451] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:24.261865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b1fa9-d819-4861-ae21-adbeec1ea9ae admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:24.271725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b1fa9-d819-4861-ae21-adbeec1ea9ae admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:24.276020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4d67d-5338-46d3-8773-a2ee06d6c0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:24.276849 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4d67d-5338-46d3-8773-a2ee06d6c0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:24.277125 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4d67d-5338-46d3-8773-a2ee06d6c0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:24.277394 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4d67d-5338-46d3-8773-a2ee06d6c0b8 admin admin] PATH_INFO: `/v3/projects/b029942a00eb466b8575ae912b6910ac` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:24.278570 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4d67d-5338-46d3-8773-a2ee06d6c0b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=b029942a00eb466b8575ae912b6910ac)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:24.280352 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4d67d-5338-46d3-8773-a2ee06d6c0b8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:24.281969 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 230/452] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:16:24 2022] GET /identity/v3/projects/b029942a00eb466b8575ae912b6910ac => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:24.287060 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cca228-c023-4c8b-863b-06d1a2c38c2a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:24.295594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cca228-c023-4c8b-863b-06d1a2c38c2a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:24.300361 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8dc778-65d1-418a-8365-4eb226efb5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:24.301160 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dc778-65d1-418a-8365-4eb226efb5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:24.301439 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dc778-65d1-418a-8365-4eb226efb5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:24.301707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8dc778-65d1-418a-8365-4eb226efb5d9 admin admin] PATH_INFO: `/v3/groups/2dfe8b2ce1f4456a9d89b33ac022ce4a` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:24.302865 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dc778-65d1-418a-8365-4eb226efb5d9 admin admin] RBAC: Authorizing `identity:get_group(group_id=2dfe8b2ce1f4456a9d89b33ac022ce4a)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:24.304729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8dc778-65d1-418a-8365-4eb226efb5d9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:24.306521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 223/453] 10.222.0.35 () {56 vars in 1201 bytes} [Sat Feb 12 04:16:24 2022] GET /identity/v3/groups/2dfe8b2ce1f4456a9d89b33ac022ce4a => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:24.311752 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4d67d-5338-46d3-8773-a2ee06d6c0b8 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:24.321964 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4d67d-5338-46d3-8773-a2ee06d6c0b8 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:24.326236 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5e9f6-2bb6-4c35-8460-adf27d37f275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:24.326849 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5e9f6-2bb6-4c35-8460-adf27d37f275 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:24.327132 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5e9f6-2bb6-4c35-8460-adf27d37f275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:24.327441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5e9f6-2bb6-4c35-8460-adf27d37f275 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:24.328272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5e9f6-2bb6-4c35-8460-adf27d37f275 admin admin] RBAC: Adding query filter params (group.id=2dfe8b2ce1f4456a9d89b33ac022ce4a, role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=b029942a00eb466b8575ae912b6910ac) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:24.328585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5e9f6-2bb6-4c35-8460-adf27d37f275 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:24.330367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5e9f6-2bb6-4c35-8460-adf27d37f275 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:24.336288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 231/454] 10.222.0.35 () {56 vars in 1397 bytes} [Sat Feb 12 04:16:24 2022] GET /identity/v3/role_assignments?group.id=2dfe8b2ce1f4456a9d89b33ac022ce4a&scope.project.id=b029942a00eb466b8575ae912b6910ac&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 611 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:27.245232 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14da8e-b49f-41b3-99d9-a5c2340ac78f None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.245810 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14da8e-b49f-41b3-99d9-a5c2340ac78f None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.245810 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14da8e-b49f-41b3-99d9-a5c2340ac78f None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.247557 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 224/455] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:27.253729 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d6636-294b-4229-a2a9-993106f0f968 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.254235 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d6636-294b-4229-a2a9-993106f0f968 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.254235 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780d6636-294b-4229-a2a9-993106f0f968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.256203 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b52a-a3a5-4bef-ad62-fa868483be7e None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.256489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b52a-a3a5-4bef-ad62-fa868483be7e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.256765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a333b52a-a3a5-4bef-ad62-fa868483be7e None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.258546 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 225/456] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:27.273509 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd31e00-6a96-4a6a-ba70-e74c1278b214 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.273829 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd31e00-6a96-4a6a-ba70-e74c1278b214 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.274061 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd31e00-6a96-4a6a-ba70-e74c1278b214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.298065 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-780d6636-294b-4229-a2a9-993106f0f968 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:27.299411 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-780d6636-294b-4229-a2a9-993106f0f968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:27.328258 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-0cd31e00-6a96-4a6a-ba70-e74c1278b214 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:27.329472 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0cd31e00-6a96-4a6a-ba70-e74c1278b214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:27.333528 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 232/457] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:27.372315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 226/458] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:27.372501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d6636-294b-4229-a2a9-993106f0f968 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:27.386755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780d6636-294b-4229-a2a9-993106f0f968 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:27.408562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a5512-6175-4961-b49b-a8e5e06f0729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:27.415240 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a5512-6175-4961-b49b-a8e5e06f0729 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.415240 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a5512-6175-4961-b49b-a8e5e06f0729 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.415240 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a5512-6175-4961-b49b-a8e5e06f0729 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.430680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd31e00-6a96-4a6a-ba70-e74c1278b214 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:27.432374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a5512-6175-4961-b49b-a8e5e06f0729 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:27.434240 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a5512-6175-4961-b49b-a8e5e06f0729 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:27.447691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd31e00-6a96-4a6a-ba70-e74c1278b214 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:27.460896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15966baa-3706-4c09-acef-878de2977bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:27.461704 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15966baa-3706-4c09-acef-878de2977bff admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.461984 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15966baa-3706-4c09-acef-878de2977bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.467260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15966baa-3706-4c09-acef-878de2977bff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.470101 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-2c3a5512-6175-4961-b49b-a8e5e06f0729 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:27.490008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 233/459] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:27.496152 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18524e-84a8-4ddd-9d56-8cf4d33c1322 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.496741 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18524e-84a8-4ddd-9d56-8cf4d33c1322 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.497219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18524e-84a8-4ddd-9d56-8cf4d33c1322 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.498245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15966baa-3706-4c09-acef-878de2977bff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:27.500279 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 234/460] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:27.503068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15966baa-3706-4c09-acef-878de2977bff admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:27.504027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18524e-84a8-4ddd-9d56-8cf4d33c1322 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:27.532980 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-15966baa-3706-4c09-acef-878de2977bff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:27.536440 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18524e-84a8-4ddd-9d56-8cf4d33c1322 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:27.542251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f47db-1b68-4f96-80cc-03e1a6d8a409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:27.543179 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f47db-1b68-4f96-80cc-03e1a6d8a409 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.543702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f47db-1b68-4f96-80cc-03e1a6d8a409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.544170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f47db-1b68-4f96-80cc-03e1a6d8a409 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.545092 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f47db-1b68-4f96-80cc-03e1a6d8a409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:27.545588 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f47db-1b68-4f96-80cc-03e1a6d8a409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:27.546692 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 227/461] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:27.547694 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-a52f47db-1b68-4f96-80cc-03e1a6d8a409 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:27.547694 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:16:27.547694 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:16:27.548837 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a942cec-bc3b-4550-b865-f29f55c06b33 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.550450 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f47db-1b68-4f96-80cc-03e1a6d8a409 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:27.550933 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a942cec-bc3b-4550-b865-f29f55c06b33 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.553140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a942cec-bc3b-4550-b865-f29f55c06b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.575050 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 235/462] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:27.576279 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f47db-1b68-4f96-80cc-03e1a6d8a409 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:27.586678 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f47db-1b68-4f96-80cc-03e1a6d8a409 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:27.587054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-2a942cec-bc3b-4550-b865-f29f55c06b33 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:27.588403 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2a942cec-bc3b-4550-b865-f29f55c06b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:27.595423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd8b53-dc4b-4276-aa81-cbb8cfa1e98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:27.595423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8b53-dc4b-4276-aa81-cbb8cfa1e98e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.595423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8b53-dc4b-4276-aa81-cbb8cfa1e98e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.595423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8b53-dc4b-4276-aa81-cbb8cfa1e98e admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.595799 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd8b53-dc4b-4276-aa81-cbb8cfa1e98e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:27.596584 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd8b53-dc4b-4276-aa81-cbb8cfa1e98e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:27.600579 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd8b53-dc4b-4276-aa81-cbb8cfa1e98e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:27.605461 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 228/463] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:27.606481 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a942cec-bc3b-4550-b865-f29f55c06b33 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:27.626690 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 236/464] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:27.634731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a942cec-bc3b-4550-b865-f29f55c06b33 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:27.641603 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd8b53-dc4b-4276-aa81-cbb8cfa1e98e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:27.651359 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31187b4-2876-46d0-b78a-e89e52c87207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:27.652361 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31187b4-2876-46d0-b78a-e89e52c87207 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.652845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31187b4-2876-46d0-b78a-e89e52c87207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.653303 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31187b4-2876-46d0-b78a-e89e52c87207 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.654239 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31187b4-2876-46d0-b78a-e89e52c87207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:27.654876 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd8b53-dc4b-4276-aa81-cbb8cfa1e98e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:27.656593 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31187b4-2876-46d0-b78a-e89e52c87207 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:27.665754 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3c2e0-1153-4413-8113-5bd8c1222e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:27.666432 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3c2e0-1153-4413-8113-5bd8c1222e23 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.667049 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3c2e0-1153-4413-8113-5bd8c1222e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.667829 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3c2e0-1153-4413-8113-5bd8c1222e23 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.668906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3c2e0-1153-4413-8113-5bd8c1222e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:27.671025 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3c2e0-1153-4413-8113-5bd8c1222e23 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:27.741154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 229/465] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:16:27 2022] POST /identity/v3/users => generated 248 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:27.742313 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31187b4-2876-46d0-b78a-e89e52c87207 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:27.753268 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31187b4-2876-46d0-b78a-e89e52c87207 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:27.758589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef45f6d-90ab-45f0-b4cd-676037c01f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:27.759841 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef45f6d-90ab-45f0-b4cd-676037c01f78 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.760332 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef45f6d-90ab-45f0-b4cd-676037c01f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.760821 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef45f6d-90ab-45f0-b4cd-676037c01f78 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.772665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 237/466] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:16:27 2022] POST /identity/v3/users => generated 248 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:16:27.773384 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef45f6d-90ab-45f0-b4cd-676037c01f78 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:27.776208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb19269-2a49-4887-bbcd-4f177bd85ef7 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.776208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb19269-2a49-4887-bbcd-4f177bd85ef7 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.776208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb19269-2a49-4887-bbcd-4f177bd85ef7 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.776441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef45f6d-90ab-45f0-b4cd-676037c01f78 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:27.777847 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 238/467] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:27.798862 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e5976-34c1-4fff-9438-a7be09ea4e40 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.800222 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e5976-34c1-4fff-9438-a7be09ea4e40 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.800732 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e5976-34c1-4fff-9438-a7be09ea4e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.820793 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-fef45f6d-90ab-45f0-b4cd-676037c01f78 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:27.822426 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 230/468] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:27.828747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef45f6d-90ab-45f0-b4cd-676037c01f78 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:27.831747 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1a8e5976-34c1-4fff-9438-a7be09ea4e40 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:27.833039 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1a8e5976-34c1-4fff-9438-a7be09ea4e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:27.842269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef45f6d-90ab-45f0-b4cd-676037c01f78 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:27.852217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df771fa-ca80-424c-9ba5-2ec926e42e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:27.854260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df771fa-ca80-424c-9ba5-2ec926e42e05 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.856067 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df771fa-ca80-424c-9ba5-2ec926e42e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.856562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df771fa-ca80-424c-9ba5-2ec926e42e05 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.857869 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df771fa-ca80-424c-9ba5-2ec926e42e05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:27.858080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 239/469] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:27.858571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df771fa-ca80-424c-9ba5-2ec926e42e05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:27.860413 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df771fa-ca80-424c-9ba5-2ec926e42e05 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:27.875448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 231/470] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:27.880752 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e5976-34c1-4fff-9438-a7be09ea4e40 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:27.891594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df771fa-ca80-424c-9ba5-2ec926e42e05 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:27.896342 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8e5976-34c1-4fff-9438-a7be09ea4e40 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:27.908200 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cd632-7ff1-44ad-9d7e-5903c1b1f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:27.910603 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cd632-7ff1-44ad-9d7e-5903c1b1f9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.911119 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cd632-7ff1-44ad-9d7e-5903c1b1f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.911646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3cd632-7ff1-44ad-9d7e-5903c1b1f9b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.912717 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cd632-7ff1-44ad-9d7e-5903c1b1f9b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:27.915071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3cd632-7ff1-44ad-9d7e-5903c1b1f9b4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:27.917788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df771fa-ca80-424c-9ba5-2ec926e42e05 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:27.932245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dc7f6-4b98-4b98-9c67-de66acb7ec79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:27.936376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dc7f6-4b98-4b98-9c67-de66acb7ec79 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.936376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dc7f6-4b98-4b98-9c67-de66acb7ec79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.936376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dc7f6-4b98-4b98-9c67-de66acb7ec79 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.949445 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dc7f6-4b98-4b98-9c67-de66acb7ec79 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:27.952192 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2dc7f6-4b98-4b98-9c67-de66acb7ec79 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:27.972765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-df2dc7f6-4b98-4b98-9c67-de66acb7ec79 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:27.974393 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 232/471] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:27.980698 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dc7f6-4b98-4b98-9c67-de66acb7ec79 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:27.992081 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dc7f6-4b98-4b98-9c67-de66acb7ec79 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:27.996976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc582d56-1571-4254-936b-08d133a7a5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:27.997873 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc582d56-1571-4254-936b-08d133a7a5ca admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:27.998150 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc582d56-1571-4254-936b-08d133a7a5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:27.998422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc582d56-1571-4254-936b-08d133a7a5ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:27.999168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc582d56-1571-4254-936b-08d133a7a5ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:27.999506 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc582d56-1571-4254-936b-08d133a7a5ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:28.001324 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc582d56-1571-4254-936b-08d133a7a5ca admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:28.010897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 240/472] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:16:27 2022] POST /identity/v3/users => generated 246 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:28.020592 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 233/473] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:28.027176 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cd632-7ff1-44ad-9d7e-5903c1b1f9b4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:28.039924 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3cd632-7ff1-44ad-9d7e-5903c1b1f9b4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:28.045303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec582d5e-a12a-4197-b15b-e22992b7d912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:28.046362 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec582d5e-a12a-4197-b15b-e22992b7d912 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:28.046802 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec582d5e-a12a-4197-b15b-e22992b7d912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:28.047251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec582d5e-a12a-4197-b15b-e22992b7d912 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:28.048376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec582d5e-a12a-4197-b15b-e22992b7d912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:28.051742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec582d5e-a12a-4197-b15b-e22992b7d912 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:28.125486 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 241/474] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:16:28 2022] POST /identity/v3/users => generated 249 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:28.477344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cef183-12b5-4f80-94d8-0c4328494796 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:28.477882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cef183-12b5-4f80-94d8-0c4328494796 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:28.477882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cef183-12b5-4f80-94d8-0c4328494796 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:28.479916 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 234/475] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:28.485321 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b0904-8755-4820-8f32-ae67804660d9 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:28.485703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b0904-8755-4820-8f32-ae67804660d9 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:28.485873 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b0904-8755-4820-8f32-ae67804660d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:28.505886 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-f30b0904-8755-4820-8f32-ae67804660d9 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:28.507063 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f30b0904-8755-4820-8f32-ae67804660d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:28.515049 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 242/476] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:28 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:28.538135 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cef183-12b5-4f80-94d8-0c4328494796 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:28.550906 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cef183-12b5-4f80-94d8-0c4328494796 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:28.555610 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1f4b7-4cd3-42ff-8c77-2c4b53910814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:28.556263 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1f4b7-4cd3-42ff-8c77-2c4b53910814 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:28.556544 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1f4b7-4cd3-42ff-8c77-2c4b53910814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:28.556818 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b1f4b7-4cd3-42ff-8c77-2c4b53910814 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:28.557646 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1f4b7-4cd3-42ff-8c77-2c4b53910814 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:28.559315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b1f4b7-4cd3-42ff-8c77-2c4b53910814 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:28.622265 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.sql.core [None req-d4b1f4b7-4cd3-42ff-8c77-2c4b53910814 admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Feb 12 04:16:28.622265 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Feb 12 04:16:28.622265 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [parameters: {'id': 'd744bbd704fd49c695a30004fe8e8078', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Feb 12 04:16:28.622265 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79267) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 12 04:16:28.639761 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-d4b1f4b7-4cd3-42ff-8c77-2c4b53910814 admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Feb 12 04:16:28.641451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 235/477] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:16:28 2022] POST /identity/v3/roles => generated 144 bytes in 104 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:28.647964 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b0904-8755-4820-8f32-ae67804660d9 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:28.657404 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b0904-8755-4820-8f32-ae67804660d9 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:28.663739 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dfd42-06bb-41f6-9db2-8e87586ef3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:28.664530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dfd42-06bb-41f6-9db2-8e87586ef3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:28.664808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dfd42-06bb-41f6-9db2-8e87586ef3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:28.665079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dfd42-06bb-41f6-9db2-8e87586ef3a3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:28.681971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dfd42-06bb-41f6-9db2-8e87586ef3a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:28.689398 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-c37dfd42-06bb-41f6-9db2-8e87586ef3a3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Feb 12 04:16:28.691465 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 243/478] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:28.697085 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1f4b7-4cd3-42ff-8c77-2c4b53910814 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:28.707573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b1f4b7-4cd3-42ff-8c77-2c4b53910814 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:28.717789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5882848e-c184-4106-b435-9503f5662197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:28.718465 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882848e-c184-4106-b435-9503f5662197 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:28.718743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882848e-c184-4106-b435-9503f5662197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:28.719015 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5882848e-c184-4106-b435-9503f5662197 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:28.719818 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882848e-c184-4106-b435-9503f5662197 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:28.720175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882848e-c184-4106-b435-9503f5662197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:28.722581 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5882848e-c184-4106-b435-9503f5662197 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:28.733136 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 236/479] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:30.388521 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb744ea-e3a6-4134-976c-dcb29af73d3e None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.389131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb744ea-e3a6-4134-976c-dcb29af73d3e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.389131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb744ea-e3a6-4134-976c-dcb29af73d3e None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.396673 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 244/480] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:30.404775 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92402-c815-4acc-b429-3d4c244a0d02 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.405356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92402-c815-4acc-b429-3d4c244a0d02 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.405356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee92402-c815-4acc-b429-3d4c244a0d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.430989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-fee92402-c815-4acc-b429-3d4c244a0d02 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:30.432247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-fee92402-c815-4acc-b429-3d4c244a0d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:30.440176 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 237/481] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:30.476485 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb744ea-e3a6-4134-976c-dcb29af73d3e None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:30.492825 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb744ea-e3a6-4134-976c-dcb29af73d3e None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:30.497446 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fb2a5-7012-4148-8336-a0a8f7de1638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:30.498234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fb2a5-7012-4148-8336-a0a8f7de1638 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.498513 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fb2a5-7012-4148-8336-a0a8f7de1638 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.498784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fb2a5-7012-4148-8336-a0a8f7de1638 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.514422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2fb2a5-7012-4148-8336-a0a8f7de1638 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:30.521428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-3d2fb2a5-7012-4148-8336-a0a8f7de1638 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:30.522942 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 245/482] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:30.528319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92402-c815-4acc-b429-3d4c244a0d02 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:30.537572 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee92402-c815-4acc-b429-3d4c244a0d02 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:30.542048 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76c2ea-1f1c-4408-95bb-7f3e6c8bd3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:30.542705 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76c2ea-1f1c-4408-95bb-7f3e6c8bd3ca admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.542986 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76c2ea-1f1c-4408-95bb-7f3e6c8bd3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.543293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da76c2ea-1f1c-4408-95bb-7f3e6c8bd3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.544060 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76c2ea-1f1c-4408-95bb-7f3e6c8bd3ca admin admin] RBAC: Adding query filter params (name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:30.544361 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76c2ea-1f1c-4408-95bb-7f3e6c8bd3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:30.545953 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da76c2ea-1f1c-4408-95bb-7f3e6c8bd3ca admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:30.555863 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 238/483] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:30.565169 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fb2a5-7012-4148-8336-a0a8f7de1638 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:30.578748 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2fb2a5-7012-4148-8336-a0a8f7de1638 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:30.583444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c115e1-6fb0-43ed-a1ba-acdc45c7f20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:30.584225 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c115e1-6fb0-43ed-a1ba-acdc45c7f20a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.584505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c115e1-6fb0-43ed-a1ba-acdc45c7f20a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.584778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c115e1-6fb0-43ed-a1ba-acdc45c7f20a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.602059 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c115e1-6fb0-43ed-a1ba-acdc45c7f20a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:30.603960 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c115e1-6fb0-43ed-a1ba-acdc45c7f20a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:30.624927 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-78c115e1-6fb0-43ed-a1ba-acdc45c7f20a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:30.626504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 246/484] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:30.632530 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76c2ea-1f1c-4408-95bb-7f3e6c8bd3ca admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:30.645560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da76c2ea-1f1c-4408-95bb-7f3e6c8bd3ca admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:30.652501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e56fdc-2611-414c-b82f-df4f4b879c7a None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.652871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e56fdc-2611-414c-b82f-df4f4b879c7a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.653099 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e56fdc-2611-414c-b82f-df4f4b879c7a None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.655145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 247/485] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:30.660789 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fdb80-49a9-4408-9fd1-b1f0d3ec96b2 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.661036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864899bd-85da-4043-b089-b24446428f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:30.661215 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fdb80-49a9-4408-9fd1-b1f0d3ec96b2 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.661377 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0fdb80-49a9-4408-9fd1-b1f0d3ec96b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.661592 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864899bd-85da-4043-b089-b24446428f81 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.661872 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864899bd-85da-4043-b089-b24446428f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.662144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864899bd-85da-4043-b089-b24446428f81 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.662881 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864899bd-85da-4043-b089-b24446428f81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:30.663182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864899bd-85da-4043-b089-b24446428f81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:30.664781 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864899bd-85da-4043-b089-b24446428f81 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:30.686591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 239/486] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:30.695048 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864899bd-85da-4043-b089-b24446428f81 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:30.695618 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1c0fdb80-49a9-4408-9fd1-b1f0d3ec96b2 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:30.696797 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1c0fdb80-49a9-4408-9fd1-b1f0d3ec96b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:30.711363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864899bd-85da-4043-b089-b24446428f81 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:30.714387 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 248/487] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:30.726970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1ca8d-9de3-4dbc-b90e-176275a7f237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:30.727803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1ca8d-9de3-4dbc-b90e-176275a7f237 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.728080 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1ca8d-9de3-4dbc-b90e-176275a7f237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.728354 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1ca8d-9de3-4dbc-b90e-176275a7f237 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.740222 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1ca8d-9de3-4dbc-b90e-176275a7f237 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:30.740747 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fdb80-49a9-4408-9fd1-b1f0d3ec96b2 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:30.742231 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1ca8d-9de3-4dbc-b90e-176275a7f237 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:30.750695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0fdb80-49a9-4408-9fd1-b1f0d3ec96b2 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:30.756155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135dd23-741e-4a29-a9ed-7aaceb2de796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:30.756999 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135dd23-741e-4a29-a9ed-7aaceb2de796 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.757278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135dd23-741e-4a29-a9ed-7aaceb2de796 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.757600 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135dd23-741e-4a29-a9ed-7aaceb2de796 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.766701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-31f1ca8d-9de3-4dbc-b90e-176275a7f237 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 12 04:16:30.768100 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 240/488] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:30.769175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135dd23-741e-4a29-a9ed-7aaceb2de796 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:30.779259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1ca8d-9de3-4dbc-b90e-176275a7f237 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:30.779390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-5135dd23-741e-4a29-a9ed-7aaceb2de796 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:30.780404 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 249/489] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:30.786617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135dd23-741e-4a29-a9ed-7aaceb2de796 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:30.796771 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1ca8d-9de3-4dbc-b90e-176275a7f237 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:30.804557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135dd23-741e-4a29-a9ed-7aaceb2de796 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:30.806386 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963eeeac-93ae-463a-9c22-086211ef9927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:30.807539 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eeeac-93ae-463a-9c22-086211ef9927 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.808837 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eeeac-93ae-463a-9c22-086211ef9927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.809796 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963eeeac-93ae-463a-9c22-086211ef9927 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.811307 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963eeeac-93ae-463a-9c22-086211ef9927 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:30.812329 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963eeeac-93ae-463a-9c22-086211ef9927 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:30.814058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-963eeeac-93ae-463a-9c22-086211ef9927 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:30.814058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:16:30.814058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:16:30.817163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f832dd1-6653-4cfa-8435-202826436104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:30.818281 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963eeeac-93ae-463a-9c22-086211ef9927 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:30.819179 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f832dd1-6653-4cfa-8435-202826436104 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.820535 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f832dd1-6653-4cfa-8435-202826436104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.821072 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f832dd1-6653-4cfa-8435-202826436104 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.823557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f832dd1-6653-4cfa-8435-202826436104 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:30.824080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f832dd1-6653-4cfa-8435-202826436104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:30.828108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f832dd1-6653-4cfa-8435-202826436104 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:30.848566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 250/490] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:30.855891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f832dd1-6653-4cfa-8435-202826436104 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:30.872702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f832dd1-6653-4cfa-8435-202826436104 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:30.884142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc402a-1d4d-4d60-938d-2543dff11411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:30.885276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc402a-1d4d-4d60-938d-2543dff11411 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.885804 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc402a-1d4d-4d60-938d-2543dff11411 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.886292 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc402a-1d4d-4d60-938d-2543dff11411 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.902883 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc402a-1d4d-4d60-938d-2543dff11411 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:30.905151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc402a-1d4d-4d60-938d-2543dff11411 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:30.909827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 241/491] 10.222.0.35 () {56 vars in 1158 bytes} [Sat Feb 12 04:16:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:30.915101 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963eeeac-93ae-463a-9c22-086211ef9927 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:30.923907 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-91bc402a-1d4d-4d60-938d-2543dff11411 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:30.925645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 251/492] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:30.931758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc402a-1d4d-4d60-938d-2543dff11411 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:30.937638 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963eeeac-93ae-463a-9c22-086211ef9927 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:30.943656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe5bab-bafe-4030-bdd6-6b908fea4589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:30.944298 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe5bab-bafe-4030-bdd6-6b908fea4589 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.944579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe5bab-bafe-4030-bdd6-6b908fea4589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.944854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe5bab-bafe-4030-bdd6-6b908fea4589 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.945264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc402a-1d4d-4d60-938d-2543dff11411 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:30.950072 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ef327-7d07-4a5a-9978-77674533dd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:30.951004 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ef327-7d07-4a5a-9978-77674533dd02 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.951526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ef327-7d07-4a5a-9978-77674533dd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.952055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ef327-7d07-4a5a-9978-77674533dd02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.953004 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe5bab-bafe-4030-bdd6-6b908fea4589 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:30.953253 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ef327-7d07-4a5a-9978-77674533dd02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:30.953756 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ef327-7d07-4a5a-9978-77674533dd02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:30.954759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe5bab-bafe-4030-bdd6-6b908fea4589 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:30.956639 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25ef327-7d07-4a5a-9978-77674533dd02 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:30.966568 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 242/493] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 04:16:30.968103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f342fd9-6d28-4033-bb16-194d36506580 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.968388 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f342fd9-6d28-4033-bb16-194d36506580 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.968662 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f342fd9-6d28-4033-bb16-194d36506580 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.969881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 252/494] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:30.974419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 243/495] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:30.975808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ef327-7d07-4a5a-9978-77674533dd02 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:30.976086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f342fd9-6d28-4033-bb16-194d36506580 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:30.989063 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ef327-7d07-4a5a-9978-77674533dd02 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:30.993182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f342fd9-6d28-4033-bb16-194d36506580 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:30.995635 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f10eaa-6594-48e0-a54b-ec66a12658df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:30.996524 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10eaa-6594-48e0-a54b-ec66a12658df admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:30.996816 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10eaa-6594-48e0-a54b-ec66a12658df admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:30.997073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10eaa-6594-48e0-a54b-ec66a12658df admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:30.999049 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4db95d-40b0-4944-bab5-4b165df9cdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.000062 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db95d-40b0-4944-bab5-4b165df9cdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.000582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db95d-40b0-4944-bab5-4b165df9cdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.001078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4db95d-40b0-4944-bab5-4b165df9cdd2 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.009809 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4db95d-40b0-4944-bab5-4b165df9cdd2 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.010594 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f10eaa-6594-48e0-a54b-ec66a12658df admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.012446 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f10eaa-6594-48e0-a54b-ec66a12658df admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.012691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4db95d-40b0-4944-bab5-4b165df9cdd2 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.029383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-3d4db95d-40b0-4944-bab5-4b165df9cdd2 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 12 04:16:31.030203 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-77f10eaa-6594-48e0-a54b-ec66a12658df admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:31.030698 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 244/496] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:31.031757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11465a-8e51-4172-9329-7468172e2dfe None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.031862 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 253/497] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:31.032036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11465a-8e51-4172-9329-7468172e2dfe None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.032309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11465a-8e51-4172-9329-7468172e2dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.033058 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c972f30-5b6d-474a-b759-c5db7d236390 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.034650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c972f30-5b6d-474a-b759-c5db7d236390 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.034650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c972f30-5b6d-474a-b759-c5db7d236390 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.036307 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 254/498] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:31.040993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c972f30-5b6d-474a-b759-c5db7d236390 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.051171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-1b11465a-8e51-4172-9329-7468172e2dfe None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:31.052312 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-1b11465a-8e51-4172-9329-7468172e2dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:31.053511 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c972f30-5b6d-474a-b759-c5db7d236390 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.057967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694da98-6558-4af5-b1c9-15ee02f6423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.058596 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694da98-6558-4af5-b1c9-15ee02f6423c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.058879 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694da98-6558-4af5-b1c9-15ee02f6423c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.059151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694da98-6558-4af5-b1c9-15ee02f6423c admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.060067 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694da98-6558-4af5-b1c9-15ee02f6423c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.060532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 245/499] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:31.060646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694da98-6558-4af5-b1c9-15ee02f6423c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.061611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a4a05-06f0-4bd4-944e-b5cab9a7ee95 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.061899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a4a05-06f0-4bd4-944e-b5cab9a7ee95 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.062170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a4a05-06f0-4bd4-944e-b5cab9a7ee95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.070052 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694da98-6558-4af5-b1c9-15ee02f6423c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.080469 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-889a4a05-06f0-4bd4-944e-b5cab9a7ee95 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:31.081924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-889a4a05-06f0-4bd4-944e-b5cab9a7ee95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:31.087145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 255/500] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.088035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694da98-6558-4af5-b1c9-15ee02f6423c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.091883 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 246/501] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:31.092592 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a4a05-06f0-4bd4-944e-b5cab9a7ee95 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.099452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694da98-6558-4af5-b1c9-15ee02f6423c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.101694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a4a05-06f0-4bd4-944e-b5cab9a7ee95 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.104224 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3d72e-f38d-423b-b540-2262bd31919a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.105100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3d72e-f38d-423b-b540-2262bd31919a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.105575 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3d72e-f38d-423b-b540-2262bd31919a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.105995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3d72e-f38d-423b-b540-2262bd31919a admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.106114 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20307ac4-e529-4f41-b5dc-7941f95467d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.106784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20307ac4-e529-4f41-b5dc-7941f95467d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.107063 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20307ac4-e529-4f41-b5dc-7941f95467d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.107365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20307ac4-e529-4f41-b5dc-7941f95467d2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.107749 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3d72e-f38d-423b-b540-2262bd31919a admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.108243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3d72e-f38d-423b-b540-2262bd31919a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.109479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-bbe3d72e-f38d-423b-b540-2262bd31919a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:31.109479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:16:31.109479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:16:31.111006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe3d72e-f38d-423b-b540-2262bd31919a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.118751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20307ac4-e529-4f41-b5dc-7941f95467d2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:31.125728 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-20307ac4-e529-4f41-b5dc-7941f95467d2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:31.127647 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 247/502] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:31.128701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20307ac4-e529-4f41-b5dc-7941f95467d2 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.137901 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20307ac4-e529-4f41-b5dc-7941f95467d2 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.147289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2194a30-a37e-43d0-864a-ae264b9a889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.148064 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2194a30-a37e-43d0-864a-ae264b9a889b admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.148346 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2194a30-a37e-43d0-864a-ae264b9a889b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.148623 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2194a30-a37e-43d0-864a-ae264b9a889b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.154285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 256/503] 10.222.0.35 () {56 vars in 1158 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.154285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3d72e-f38d-423b-b540-2262bd31919a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.156441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2194a30-a37e-43d0-864a-ae264b9a889b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.158410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2194a30-a37e-43d0-864a-ae264b9a889b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.165342 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe3d72e-f38d-423b-b540-2262bd31919a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.169569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b39452-127d-42a9-b1fc-557fb13ebc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.170321 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b39452-127d-42a9-b1fc-557fb13ebc6f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.170597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b39452-127d-42a9-b1fc-557fb13ebc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.170866 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b39452-127d-42a9-b1fc-557fb13ebc6f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.172733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-a2194a30-a37e-43d0-864a-ae264b9a889b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:31.174416 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 248/504] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:31.175175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2194a30-a37e-43d0-864a-ae264b9a889b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.185003 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2194a30-a37e-43d0-864a-ae264b9a889b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.186850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b39452-127d-42a9-b1fc-557fb13ebc6f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:31.189352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd510e-a4a0-40e4-bb86-bd36134181f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.190518 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd510e-a4a0-40e4-bb86-bd36134181f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.190804 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd510e-a4a0-40e4-bb86-bd36134181f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.191069 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cd510e-a4a0-40e4-bb86-bd36134181f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.191850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd510e-a4a0-40e4-bb86-bd36134181f5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.192153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd510e-a4a0-40e4-bb86-bd36134181f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.193699 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cd510e-a4a0-40e4-bb86-bd36134181f5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.194294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-d7b39452-127d-42a9-b1fc-557fb13ebc6f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:31.195660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 257/505] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:31.196238 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b39452-127d-42a9-b1fc-557fb13ebc6f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.205354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b39452-127d-42a9-b1fc-557fb13ebc6f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.207323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 249/506] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.211755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11807bd1-a503-45b6-8368-557700fe0d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.211755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11807bd1-a503-45b6-8368-557700fe0d5f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.211755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11807bd1-a503-45b6-8368-557700fe0d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.211755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11807bd1-a503-45b6-8368-557700fe0d5f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.212355 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd510e-a4a0-40e4-bb86-bd36134181f5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.219860 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11807bd1-a503-45b6-8368-557700fe0d5f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.221737 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11807bd1-a503-45b6-8368-557700fe0d5f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.221837 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cd510e-a4a0-40e4-bb86-bd36134181f5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.226163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4308bb-acb3-4859-acad-3e65fa7684ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.226843 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4308bb-acb3-4859-acad-3e65fa7684ca admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.227081 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4308bb-acb3-4859-acad-3e65fa7684ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.227388 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4308bb-acb3-4859-acad-3e65fa7684ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.228186 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4308bb-acb3-4859-acad-3e65fa7684ca admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.228514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4308bb-acb3-4859-acad-3e65fa7684ca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.229486 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-9d4308bb-acb3-4859-acad-3e65fa7684ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:31.229486 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:16:31.229486 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:16:31.230505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 258/507] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:31.231297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11807bd1-a503-45b6-8368-557700fe0d5f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.234932 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4308bb-acb3-4859-acad-3e65fa7684ca admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.240694 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11807bd1-a503-45b6-8368-557700fe0d5f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.245037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ea15d-5965-43c5-8eea-cd633968a9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.245674 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ea15d-5965-43c5-8eea-cd633968a9fc admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.245949 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ea15d-5965-43c5-8eea-cd633968a9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.246217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ea15d-5965-43c5-8eea-cd633968a9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.246970 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ea15d-5965-43c5-8eea-cd633968a9fc admin admin] RBAC: Adding query filter params (name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.247274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ea15d-5965-43c5-8eea-cd633968a9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.248840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791ea15d-5965-43c5-8eea-cd633968a9fc admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.258621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 250/508] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.258621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4308bb-acb3-4859-acad-3e65fa7684ca admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.266523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 259/509] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.266523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ea15d-5965-43c5-8eea-cd633968a9fc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.269151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4308bb-acb3-4859-acad-3e65fa7684ca admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.273725 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423a81-0128-411e-a0b6-1e29fc8c5332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.274513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423a81-0128-411e-a0b6-1e29fc8c5332 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.274795 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423a81-0128-411e-a0b6-1e29fc8c5332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.275073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423a81-0128-411e-a0b6-1e29fc8c5332 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.281269 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ea15d-5965-43c5-8eea-cd633968a9fc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.286361 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c30c-1dec-4ae3-afc1-848eed8229a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.286861 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f423a81-0128-411e-a0b6-1e29fc8c5332 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.287134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c30c-1dec-4ae3-afc1-848eed8229a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.287439 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c30c-1dec-4ae3-afc1-848eed8229a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.287713 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70c30c-1dec-4ae3-afc1-848eed8229a7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.288725 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f423a81-0128-411e-a0b6-1e29fc8c5332 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.298391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70c30c-1dec-4ae3-afc1-848eed8229a7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.300596 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70c30c-1dec-4ae3-afc1-848eed8229a7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.306659 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-4f423a81-0128-411e-a0b6-1e29fc8c5332 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:31.312717 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 251/510] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:31.312717 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423a81-0128-411e-a0b6-1e29fc8c5332 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.317525 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-ec70c30c-1dec-4ae3-afc1-848eed8229a7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:31.322806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 260/511] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:31.322806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c30c-1dec-4ae3-afc1-848eed8229a7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.325571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423a81-0128-411e-a0b6-1e29fc8c5332 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.329530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70c30c-1dec-4ae3-afc1-848eed8229a7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.331966 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb426b3-f5a2-4d00-b22c-60daddfc8fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.332596 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb426b3-f5a2-4d00-b22c-60daddfc8fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.332890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb426b3-f5a2-4d00-b22c-60daddfc8fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.333149 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb426b3-f5a2-4d00-b22c-60daddfc8fa2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.333996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb426b3-f5a2-4d00-b22c-60daddfc8fa2 admin admin] RBAC: Adding query filter params (role.id=f9ebfff2487e4c75854f6c174dcebf56, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=e3df18302cd84e6eae6a1a60b0a8b2dc) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.334301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb426b3-f5a2-4d00-b22c-60daddfc8fa2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.334818 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5009a9-0c0e-40ea-a37d-6f705190d681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.335685 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5009a9-0c0e-40ea-a37d-6f705190d681 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.336035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5009a9-0c0e-40ea-a37d-6f705190d681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.336169 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb426b3-f5a2-4d00-b22c-60daddfc8fa2 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.336428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5009a9-0c0e-40ea-a37d-6f705190d681 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.342383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 252/512] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/role_assignments?user.id=e3df18302cd84e6eae6a1a60b0a8b2dc&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=f9ebfff2487e4c75854f6c174dcebf56 => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.342980 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb426b3-f5a2-4d00-b22c-60daddfc8fa2 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.353377 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb426b3-f5a2-4d00-b22c-60daddfc8fa2 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.359467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f69fc4-019b-4d7a-9816-3c235986b100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.360141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f69fc4-019b-4d7a-9816-3c235986b100 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.360421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f69fc4-019b-4d7a-9816-3c235986b100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.360691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f69fc4-019b-4d7a-9816-3c235986b100 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.361314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5009a9-0c0e-40ea-a37d-6f705190d681 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.361651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f69fc4-019b-4d7a-9816-3c235986b100 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.361947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f69fc4-019b-4d7a-9816-3c235986b100 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.363796 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f69fc4-019b-4d7a-9816-3c235986b100 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.364440 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5009a9-0c0e-40ea-a37d-6f705190d681 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.378598 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 253/513] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.378598 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f69fc4-019b-4d7a-9816-3c235986b100 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.391705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-9b5009a9-0c0e-40ea-a37d-6f705190d681 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:31.393800 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f69fc4-019b-4d7a-9816-3c235986b100 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.395020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 261/514] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:31.396373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5009a9-0c0e-40ea-a37d-6f705190d681 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.398726 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ccb1-f60c-4119-b672-9dc3f0658535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.399552 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ccb1-f60c-4119-b672-9dc3f0658535 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.399867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ccb1-f60c-4119-b672-9dc3f0658535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.400151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4ccb1-f60c-4119-b672-9dc3f0658535 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.400996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4ccb1-f60c-4119-b672-9dc3f0658535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.401490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4ccb1-f60c-4119-b672-9dc3f0658535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.403148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4ccb1-f60c-4119-b672-9dc3f0658535 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.410217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5009a9-0c0e-40ea-a37d-6f705190d681 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.417196 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd163531-fad0-4bd6-a575-0b12ad4150b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.418369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd163531-fad0-4bd6-a575-0b12ad4150b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.418930 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 254/515] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.419553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd163531-fad0-4bd6-a575-0b12ad4150b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.419953 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ccb1-f60c-4119-b672-9dc3f0658535 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.420232 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd163531-fad0-4bd6-a575-0b12ad4150b5 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.431610 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd163531-fad0-4bd6-a575-0b12ad4150b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.432404 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4ccb1-f60c-4119-b672-9dc3f0658535 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.434799 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd163531-fad0-4bd6-a575-0b12ad4150b5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.437545 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f48ee7-3dc2-4d00-8500-665b23fcedba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.438267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f48ee7-3dc2-4d00-8500-665b23fcedba admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.438605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f48ee7-3dc2-4d00-8500-665b23fcedba admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.438912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f48ee7-3dc2-4d00-8500-665b23fcedba admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.441068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f48ee7-3dc2-4d00-8500-665b23fcedba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.441379 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f48ee7-3dc2-4d00-8500-665b23fcedba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.443023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f48ee7-3dc2-4d00-8500-665b23fcedba admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.456058 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-cd163531-fad0-4bd6-a575-0b12ad4150b5 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 12 04:16:31.456729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 255/516] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.457576 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f48ee7-3dc2-4d00-8500-665b23fcedba admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.458225 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 262/517] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:31.462222 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd163531-fad0-4bd6-a575-0b12ad4150b5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.474105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f48ee7-3dc2-4d00-8500-665b23fcedba admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.475641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd163531-fad0-4bd6-a575-0b12ad4150b5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.479025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409d60c-adf2-44aa-b9d4-ec519aec8a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.479981 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409d60c-adf2-44aa-b9d4-ec519aec8a6a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.480223 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409d60c-adf2-44aa-b9d4-ec519aec8a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.480488 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409d60c-adf2-44aa-b9d4-ec519aec8a6a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.482295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd8e7e-fdfb-4aa3-a773-aa8b929c011e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.484103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd8e7e-fdfb-4aa3-a773-aa8b929c011e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.487508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd8e7e-fdfb-4aa3-a773-aa8b929c011e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.487508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdd8e7e-fdfb-4aa3-a773-aa8b929c011e admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.489817 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409d60c-adf2-44aa-b9d4-ec519aec8a6a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.491985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409d60c-adf2-44aa-b9d4-ec519aec8a6a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.496361 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd8e7e-fdfb-4aa3-a773-aa8b929c011e admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.498735 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdd8e7e-fdfb-4aa3-a773-aa8b929c011e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.509626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-d409d60c-adf2-44aa-b9d4-ec519aec8a6a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:31.510906 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 256/518] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:31.511903 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409d60c-adf2-44aa-b9d4-ec519aec8a6a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.516489 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-bfdd8e7e-fdfb-4aa3-a773-aa8b929c011e admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 04:16:31.519047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 263/519] 10.222.0.35 () {56 vars in 1114 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:31.520290 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd8e7e-fdfb-4aa3-a773-aa8b929c011e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.525872 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409d60c-adf2-44aa-b9d4-ec519aec8a6a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.531184 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9263255-6259-478b-8c41-766ef8cfe75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.532305 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9263255-6259-478b-8c41-766ef8cfe75a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.532432 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdd8e7e-fdfb-4aa3-a773-aa8b929c011e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.532914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9263255-6259-478b-8c41-766ef8cfe75a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.534018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9263255-6259-478b-8c41-766ef8cfe75a admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.535480 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9263255-6259-478b-8c41-766ef8cfe75a admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.536086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9263255-6259-478b-8c41-766ef8cfe75a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.537824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74187a3e-f3c2-4188-9b24-454d05eaeceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.538570 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74187a3e-f3c2-4188-9b24-454d05eaeceb admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.538924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9263255-6259-478b-8c41-766ef8cfe75a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.539028 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74187a3e-f3c2-4188-9b24-454d05eaeceb admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.539327 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74187a3e-f3c2-4188-9b24-454d05eaeceb admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.540670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74187a3e-f3c2-4188-9b24-454d05eaeceb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.540900 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74187a3e-f3c2-4188-9b24-454d05eaeceb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.542216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-74187a3e-f3c2-4188-9b24-454d05eaeceb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:31.542216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:16:31.542216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:16:31.543253 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74187a3e-f3c2-4188-9b24-454d05eaeceb admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.560111 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 257/520] 10.222.0.35 () {56 vars in 1160 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.560868 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9263255-6259-478b-8c41-766ef8cfe75a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.573994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 264/521] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.573994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74187a3e-f3c2-4188-9b24-454d05eaeceb admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.578366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9263255-6259-478b-8c41-766ef8cfe75a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.581147 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74187a3e-f3c2-4188-9b24-454d05eaeceb admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.583938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6596e4-8861-4724-9875-0fa97af039d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.584679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6596e4-8861-4724-9875-0fa97af039d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.585041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6596e4-8861-4724-9875-0fa97af039d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.585357 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6596e4-8861-4724-9875-0fa97af039d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.586284 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6596e4-8861-4724-9875-0fa97af039d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.586436 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa234d5-0a80-4308-9086-59c8b9a0593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.586710 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6596e4-8861-4724-9875-0fa97af039d5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.587187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa234d5-0a80-4308-9086-59c8b9a0593e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.587601 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa234d5-0a80-4308-9086-59c8b9a0593e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.587934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa234d5-0a80-4308-9086-59c8b9a0593e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.588859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6596e4-8861-4724-9875-0fa97af039d5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.596971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa234d5-0a80-4308-9086-59c8b9a0593e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.599074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa234d5-0a80-4308-9086-59c8b9a0593e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.608354 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 258/522] 10.222.0.35 () {56 vars in 1154 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.612950 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 265/523] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:31.613844 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6596e4-8861-4724-9875-0fa97af039d5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.613977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa234d5-0a80-4308-9086-59c8b9a0593e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.623507 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa234d5-0a80-4308-9086-59c8b9a0593e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.625259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6596e4-8861-4724-9875-0fa97af039d5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.628784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba61a4-db38-4cbb-b32a-a3e2106039fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.629553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba61a4-db38-4cbb-b32a-a3e2106039fc admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.629827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba61a4-db38-4cbb-b32a-a3e2106039fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.630102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba61a4-db38-4cbb-b32a-a3e2106039fc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.630852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f25c23-53e2-4366-bd4e-28e51f649cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.631671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f25c23-53e2-4366-bd4e-28e51f649cae admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.632147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f25c23-53e2-4366-bd4e-28e51f649cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.632562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f25c23-53e2-4366-bd4e-28e51f649cae admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.633636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f25c23-53e2-4366-bd4e-28e51f649cae admin admin] RBAC: Adding query filter params (role.id=f9ebfff2487e4c75854f6c174dcebf56, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=df25b09762ab4130a1c656cd499d5fb2) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.634115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f25c23-53e2-4366-bd4e-28e51f649cae admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.636341 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f25c23-53e2-4366-bd4e-28e51f649cae admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.641734 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba61a4-db38-4cbb-b32a-a3e2106039fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.651309 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba61a4-db38-4cbb-b32a-a3e2106039fc admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.651502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 259/524] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/role_assignments?user.id=df25b09762ab4130a1c656cd499d5fb2&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=f9ebfff2487e4c75854f6c174dcebf56 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.651502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f25c23-53e2-4366-bd4e-28e51f649cae admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.671769 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f25c23-53e2-4366-bd4e-28e51f649cae admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.683064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-d0ba61a4-db38-4cbb-b32a-a3e2106039fc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:31.684344 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 266/525] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:31.687925 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb778dcf-c6be-46e4-8f03-fff40c6a144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.688558 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb778dcf-c6be-46e4-8f03-fff40c6a144c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.688835 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb778dcf-c6be-46e4-8f03-fff40c6a144c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.689106 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb778dcf-c6be-46e4-8f03-fff40c6a144c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.697976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb778dcf-c6be-46e4-8f03-fff40c6a144c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.699878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb778dcf-c6be-46e4-8f03-fff40c6a144c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.704680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba61a4-db38-4cbb-b32a-a3e2106039fc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.717614 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba61a4-db38-4cbb-b32a-a3e2106039fc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.723678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 260/526] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:31.726117 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0750c4-38b8-4c83-8013-ee861f984d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.726774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0750c4-38b8-4c83-8013-ee861f984d82 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.727055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0750c4-38b8-4c83-8013-ee861f984d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.727356 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0750c4-38b8-4c83-8013-ee861f984d82 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.728095 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0750c4-38b8-4c83-8013-ee861f984d82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.728395 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0750c4-38b8-4c83-8013-ee861f984d82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.730330 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb778dcf-c6be-46e4-8f03-fff40c6a144c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.735407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0750c4-38b8-4c83-8013-ee861f984d82 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.743717 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb778dcf-c6be-46e4-8f03-fff40c6a144c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.754829 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 267/527] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:31.755983 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f66dde-3ecd-4f00-a0d6-bfe7b657974b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.757024 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f66dde-3ecd-4f00-a0d6-bfe7b657974b admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.757516 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f66dde-3ecd-4f00-a0d6-bfe7b657974b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.758017 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f66dde-3ecd-4f00-a0d6-bfe7b657974b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.760524 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0750c4-38b8-4c83-8013-ee861f984d82 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.782346 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0750c4-38b8-4c83-8013-ee861f984d82 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.784115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f66dde-3ecd-4f00-a0d6-bfe7b657974b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.786967 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f66dde-3ecd-4f00-a0d6-bfe7b657974b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.793931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0603e4-466e-4124-8d9e-ae58b28b5d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.795141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0603e4-466e-4124-8d9e-ae58b28b5d55 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.797668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0603e4-466e-4124-8d9e-ae58b28b5d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.798255 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0603e4-466e-4124-8d9e-ae58b28b5d55 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.816294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0603e4-466e-4124-8d9e-ae58b28b5d55 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.818223 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0603e4-466e-4124-8d9e-ae58b28b5d55 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.820618 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-86f66dde-3ecd-4f00-a0d6-bfe7b657974b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:31.822115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 261/528] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:31.828116 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170e4c6-ecd5-4da9-aa57-5b0bf5331116 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.828663 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170e4c6-ecd5-4da9-aa57-5b0bf5331116 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.829136 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170e4c6-ecd5-4da9-aa57-5b0bf5331116 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.832666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 262/529] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:31.833597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170e4c6-ecd5-4da9-aa57-5b0bf5331116 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.838303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-5c0603e4-466e-4124-8d9e-ae58b28b5d55 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:31.839809 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 268/530] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:31.841059 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d348a22-f9a5-4229-9853-b83ee61c5569 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.841345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d348a22-f9a5-4229-9853-b83ee61c5569 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.841627 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d348a22-f9a5-4229-9853-b83ee61c5569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.849373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7170e4c6-ecd5-4da9-aa57-5b0bf5331116 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.854191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0d0ff-3685-4685-9ad4-ff4f8d4aeee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.854937 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0d0ff-3685-4685-9ad4-ff4f8d4aeee7 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.855239 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0d0ff-3685-4685-9ad4-ff4f8d4aeee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.855540 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0d0ff-3685-4685-9ad4-ff4f8d4aeee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.856278 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0d0ff-3685-4685-9ad4-ff4f8d4aeee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.856582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0d0ff-3685-4685-9ad4-ff4f8d4aeee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.858145 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0d0ff-3685-4685-9ad4-ff4f8d4aeee7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.864622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-6d348a22-f9a5-4229-9853-b83ee61c5569 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:31.865806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-6d348a22-f9a5-4229-9853-b83ee61c5569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:31.873764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 269/531] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:31.874317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d348a22-f9a5-4229-9853-b83ee61c5569 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.879978 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 263/532] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.881525 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0d0ff-3685-4685-9ad4-ff4f8d4aeee7 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.891884 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0d0ff-3685-4685-9ad4-ff4f8d4aeee7 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.897626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d348a22-f9a5-4229-9853-b83ee61c5569 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.898310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7e88d-18ff-416a-8176-0d0713c0edec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.899269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7e88d-18ff-416a-8176-0d0713c0edec admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.899835 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7e88d-18ff-416a-8176-0d0713c0edec admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.900311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b7e88d-18ff-416a-8176-0d0713c0edec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.908101 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7e88d-18ff-416a-8176-0d0713c0edec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.911020 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b7e88d-18ff-416a-8176-0d0713c0edec admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.912433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19fdc6-a162-4dd0-b6fc-6687c253af0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.913095 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19fdc6-a162-4dd0-b6fc-6687c253af0b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.913373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19fdc6-a162-4dd0-b6fc-6687c253af0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.913638 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19fdc6-a162-4dd0-b6fc-6687c253af0b admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.914493 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19fdc6-a162-4dd0-b6fc-6687c253af0b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.914797 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19fdc6-a162-4dd0-b6fc-6687c253af0b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.916635 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19fdc6-a162-4dd0-b6fc-6687c253af0b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.929335 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 270/533] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.929955 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19fdc6-a162-4dd0-b6fc-6687c253af0b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.935239 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-e4b7e88d-18ff-416a-8176-0d0713c0edec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:31.941392 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 264/534] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:31.942961 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7e88d-18ff-416a-8176-0d0713c0edec admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.946315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19fdc6-a162-4dd0-b6fc-6687c253af0b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.950741 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0172796-beda-4aa6-9bca-9f87d962c867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.951550 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0172796-beda-4aa6-9bca-9f87d962c867 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.951832 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0172796-beda-4aa6-9bca-9f87d962c867 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.952103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0172796-beda-4aa6-9bca-9f87d962c867 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.956452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b7e88d-18ff-416a-8176-0d0713c0edec admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.962146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa094e-1084-46f5-acdb-f817db86a1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.963343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa094e-1084-46f5-acdb-f817db86a1fa admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.963781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0172796-beda-4aa6-9bca-9f87d962c867 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.964004 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa094e-1084-46f5-acdb-f817db86a1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.964420 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa094e-1084-46f5-acdb-f817db86a1fa admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.965491 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa094e-1084-46f5-acdb-f817db86a1fa admin admin] RBAC: Adding query filter params (role.id=f9ebfff2487e4c75854f6c174dcebf56, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=d9c5541a29cf42f6ab394133baa05fae) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.965606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0172796-beda-4aa6-9bca-9f87d962c867 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.966342 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa094e-1084-46f5-acdb-f817db86a1fa admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.969018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa094e-1084-46f5-acdb-f817db86a1fa admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.977154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 265/535] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/role_assignments?user.id=d9c5541a29cf42f6ab394133baa05fae&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=f9ebfff2487e4c75854f6c174dcebf56 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:31.978098 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa094e-1084-46f5-acdb-f817db86a1fa admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:31.988521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa094e-1084-46f5-acdb-f817db86a1fa admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:31.991959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-f0172796-beda-4aa6-9bca-9f87d962c867 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:31.993462 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b42ff-07d5-479f-b5e7-d863e6eb914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:31.993656 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 271/536] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:31.994424 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b42ff-07d5-479f-b5e7-d863e6eb914d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:31.994911 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b42ff-07d5-479f-b5e7-d863e6eb914d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:31.995377 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b42ff-07d5-479f-b5e7-d863e6eb914d admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:31.996337 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b42ff-07d5-479f-b5e7-d863e6eb914d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:31.996784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b42ff-07d5-479f-b5e7-d863e6eb914d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:31.998930 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b42ff-07d5-479f-b5e7-d863e6eb914d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:31.999658 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0172796-beda-4aa6-9bca-9f87d962c867 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:32.015613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0172796-beda-4aa6-9bca-9f87d962c867 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:32.018760 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 266/537] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:32.026408 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b42ff-07d5-479f-b5e7-d863e6eb914d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:32.037369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad430b-95e3-4dd6-9f6d-41ed34a7f775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:32.038296 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad430b-95e3-4dd6-9f6d-41ed34a7f775 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:32.038752 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad430b-95e3-4dd6-9f6d-41ed34a7f775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:32.039163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad430b-95e3-4dd6-9f6d-41ed34a7f775 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:32.040074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad430b-95e3-4dd6-9f6d-41ed34a7f775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:32.040517 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad430b-95e3-4dd6-9f6d-41ed34a7f775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:32.042295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ad430b-95e3-4dd6-9f6d-41ed34a7f775 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:32.049409 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b42ff-07d5-479f-b5e7-d863e6eb914d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:32.062277 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e1a8d-528a-4fe4-8cde-d04a01030959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:32.065892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e1a8d-528a-4fe4-8cde-d04a01030959 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:32.066510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e1a8d-528a-4fe4-8cde-d04a01030959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:32.067270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e1a8d-528a-4fe4-8cde-d04a01030959 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:32.068633 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e1a8d-528a-4fe4-8cde-d04a01030959 admin admin] RBAC: Adding query filter params (role.id=f9ebfff2487e4c75854f6c174dcebf56, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=362ab4aeb88746d8b8a14a238c877a53) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:32.069946 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e1a8d-528a-4fe4-8cde-d04a01030959 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:32.072026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 272/538] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:32.073402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e1a8d-528a-4fe4-8cde-d04a01030959 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:32.083268 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad430b-95e3-4dd6-9f6d-41ed34a7f775 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:32.099413 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 267/539] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:32 2022] GET /identity/v3/role_assignments?user.id=362ab4aeb88746d8b8a14a238c877a53&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=f9ebfff2487e4c75854f6c174dcebf56 => generated 259 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:32.102970 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ad430b-95e3-4dd6-9f6d-41ed34a7f775 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:32.108128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa373ab-79dc-46d3-8f7a-8d49779f4849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:32.109099 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa373ab-79dc-46d3-8f7a-8d49779f4849 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:32.109541 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa373ab-79dc-46d3-8f7a-8d49779f4849 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:32.109999 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa373ab-79dc-46d3-8f7a-8d49779f4849 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:32.110872 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa373ab-79dc-46d3-8f7a-8d49779f4849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:32.113691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa373ab-79dc-46d3-8f7a-8d49779f4849 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:32.222681 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 273/540] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:16:32 2022] POST /identity/v3/users => generated 247 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:16:33.903856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9b488-6c31-4a22-8bee-8b532980439b None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:33.904867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9b488-6c31-4a22-8bee-8b532980439b None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:33.905348 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9b488-6c31-4a22-8bee-8b532980439b None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:33.907591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 268/541] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:33.916326 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c90b-e49b-4654-8be3-aee32cdeea82 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:33.917128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c90b-e49b-4654-8be3-aee32cdeea82 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:33.917599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594c90b-e49b-4654-8be3-aee32cdeea82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:33.940764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1594c90b-e49b-4654-8be3-aee32cdeea82 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:33.942317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1594c90b-e49b-4654-8be3-aee32cdeea82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:33.953382 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 274/542] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:34.001430 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9b488-6c31-4a22-8bee-8b532980439b None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.017229 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9b488-6c31-4a22-8bee-8b532980439b None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.028116 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49033749-3c25-466a-940f-6812c16da4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.029301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49033749-3c25-466a-940f-6812c16da4af admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.029807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49033749-3c25-466a-940f-6812c16da4af admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.030278 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49033749-3c25-466a-940f-6812c16da4af admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.043109 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49033749-3c25-466a-940f-6812c16da4af admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:34.050923 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-49033749-3c25-466a-940f-6812c16da4af admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:34.052375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 269/543] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:34.058279 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594c90b-e49b-4654-8be3-aee32cdeea82 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.067852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594c90b-e49b-4654-8be3-aee32cdeea82 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.075212 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c8cd4-a0a4-4494-bf5c-d79140adf8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.076135 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c8cd4-a0a4-4494-bf5c-d79140adf8ba admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.076611 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c8cd4-a0a4-4494-bf5c-d79140adf8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.077098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76c8cd4-a0a4-4494-bf5c-d79140adf8ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.078049 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c8cd4-a0a4-4494-bf5c-d79140adf8ba admin admin] RBAC: Adding query filter params (name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:34.078546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c8cd4-a0a4-4494-bf5c-d79140adf8ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.080913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76c8cd4-a0a4-4494-bf5c-d79140adf8ba admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.090303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 275/544] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:34.095498 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49033749-3c25-466a-940f-6812c16da4af admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.109772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49033749-3c25-466a-940f-6812c16da4af admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.119822 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f6b0e-b042-4f3d-ad8f-08e5c8806364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.120881 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f6b0e-b042-4f3d-ad8f-08e5c8806364 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.121360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f6b0e-b042-4f3d-ad8f-08e5c8806364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.121842 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f6b0e-b042-4f3d-ad8f-08e5c8806364 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.132997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f6b0e-b042-4f3d-ad8f-08e5c8806364 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.135061 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208f6b0e-b042-4f3d-ad8f-08e5c8806364 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.156509 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-208f6b0e-b042-4f3d-ad8f-08e5c8806364 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:34.158920 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 270/545] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:34.164127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c8cd4-a0a4-4494-bf5c-d79140adf8ba admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.174779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76c8cd4-a0a4-4494-bf5c-d79140adf8ba admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.183514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306cfef-6a3e-4094-b58f-a9051345d556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.184405 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306cfef-6a3e-4094-b58f-a9051345d556 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.184902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306cfef-6a3e-4094-b58f-a9051345d556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.185441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8306cfef-6a3e-4094-b58f-a9051345d556 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.186374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306cfef-6a3e-4094-b58f-a9051345d556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:34.186872 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306cfef-6a3e-4094-b58f-a9051345d556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.188677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8306cfef-6a3e-4094-b58f-a9051345d556 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.206628 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 276/546] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:34.211564 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f6b0e-b042-4f3d-ad8f-08e5c8806364 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.222264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208f6b0e-b042-4f3d-ad8f-08e5c8806364 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.230423 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533b273-e8d3-4688-b6c2-1e7d439143b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.231689 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533b273-e8d3-4688-b6c2-1e7d439143b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.232175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533b273-e8d3-4688-b6c2-1e7d439143b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.232673 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533b273-e8d3-4688-b6c2-1e7d439143b3 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.245895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533b273-e8d3-4688-b6c2-1e7d439143b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.248306 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533b273-e8d3-4688-b6c2-1e7d439143b3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.266117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-8533b273-e8d3-4688-b6c2-1e7d439143b3 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 12 04:16:34.268166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 271/547] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:34.273953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306cfef-6a3e-4094-b58f-a9051345d556 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.284901 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8306cfef-6a3e-4094-b58f-a9051345d556 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.295316 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2bbc9-c969-477c-8014-bd5d3c24c4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.295981 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2bbc9-c969-477c-8014-bd5d3c24c4bd admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.296260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2bbc9-c969-477c-8014-bd5d3c24c4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.296535 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2bbc9-c969-477c-8014-bd5d3c24c4bd admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.297393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2bbc9-c969-477c-8014-bd5d3c24c4bd admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:34.297699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2bbc9-c969-477c-8014-bd5d3c24c4bd admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.299622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2bbc9-c969-477c-8014-bd5d3c24c4bd admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.324878 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 277/548] 10.222.0.35 () {56 vars in 1158 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:34.329153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533b273-e8d3-4688-b6c2-1e7d439143b3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.344211 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533b273-e8d3-4688-b6c2-1e7d439143b3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.351376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b80e2-12a0-4818-85e7-d5e22c8b0733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.353758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc48f2-df76-47cd-a4bf-8c656faf9cd6 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.354038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc48f2-df76-47cd-a4bf-8c656faf9cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.354310 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc48f2-df76-47cd-a4bf-8c656faf9cd6 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.355326 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b80e2-12a0-4818-85e7-d5e22c8b0733 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.355654 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b80e2-12a0-4818-85e7-d5e22c8b0733 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.355936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b80e2-12a0-4818-85e7-d5e22c8b0733 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.356376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 278/549] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:34.362369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9321b21-479c-418c-b042-8953b3503fac None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.362649 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9321b21-479c-418c-b042-8953b3503fac None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.362918 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9321b21-479c-418c-b042-8953b3503fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.377446 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b80e2-12a0-4818-85e7-d5e22c8b0733 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.379276 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b80e2-12a0-4818-85e7-d5e22c8b0733 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.407032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-a9321b21-479c-418c-b042-8953b3503fac None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:34.408295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a9321b21-479c-418c-b042-8953b3503fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:34.411771 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-209b80e2-12a0-4818-85e7-d5e22c8b0733 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:34.413389 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 272/550] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:34.420194 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b80e2-12a0-4818-85e7-d5e22c8b0733 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.428830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 279/551] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:34.435962 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b80e2-12a0-4818-85e7-d5e22c8b0733 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.440838 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0d1be-6628-415e-8a87-89819438352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.441479 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0d1be-6628-415e-8a87-89819438352f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.441757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0d1be-6628-415e-8a87-89819438352f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.442073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0d1be-6628-415e-8a87-89819438352f admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.442807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0d1be-6628-415e-8a87-89819438352f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:34.443100 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0d1be-6628-415e-8a87-89819438352f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.444839 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0d1be-6628-415e-8a87-89819438352f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.460264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9321b21-479c-418c-b042-8953b3503fac None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.471498 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9321b21-479c-418c-b042-8953b3503fac None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.475083 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 273/552] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:34.480457 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0d1be-6628-415e-8a87-89819438352f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.480590 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1527d9-89fb-452c-a18f-7afeb43dd06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.481354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1527d9-89fb-452c-a18f-7afeb43dd06b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.481628 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1527d9-89fb-452c-a18f-7afeb43dd06b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.481896 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1527d9-89fb-452c-a18f-7afeb43dd06b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.490815 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0d1be-6628-415e-8a87-89819438352f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.494943 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1527d9-89fb-452c-a18f-7afeb43dd06b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:34.501886 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-5c1527d9-89fb-452c-a18f-7afeb43dd06b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:34.505095 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 280/553] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:34.511127 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e8824-4cd0-461e-9d86-1ae18e9aca29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.511985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e8824-4cd0-461e-9d86-1ae18e9aca29 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.512262 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e8824-4cd0-461e-9d86-1ae18e9aca29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.512528 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52e8824-4cd0-461e-9d86-1ae18e9aca29 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.520146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1527d9-89fb-452c-a18f-7afeb43dd06b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.521621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e8824-4cd0-461e-9d86-1ae18e9aca29 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.523589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52e8824-4cd0-461e-9d86-1ae18e9aca29 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.544785 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-a52e8824-4cd0-461e-9d86-1ae18e9aca29 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:34.545692 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1527d9-89fb-452c-a18f-7afeb43dd06b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.546255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 274/554] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:34.556239 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e8824-4cd0-461e-9d86-1ae18e9aca29 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.557568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0769614-4023-48b8-bc71-9f5aca70d5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.559980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769614-4023-48b8-bc71-9f5aca70d5ad admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.560430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769614-4023-48b8-bc71-9f5aca70d5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.560890 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0769614-4023-48b8-bc71-9f5aca70d5ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.561860 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0769614-4023-48b8-bc71-9f5aca70d5ad admin admin] RBAC: Adding query filter params (name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:34.562314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0769614-4023-48b8-bc71-9f5aca70d5ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.564160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0769614-4023-48b8-bc71-9f5aca70d5ad admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.568080 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52e8824-4cd0-461e-9d86-1ae18e9aca29 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.573395 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b062810-9ff5-4c02-8a48-1aa5f5c7b972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.574155 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b062810-9ff5-4c02-8a48-1aa5f5c7b972 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.574536 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b062810-9ff5-4c02-8a48-1aa5f5c7b972 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.574933 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b062810-9ff5-4c02-8a48-1aa5f5c7b972 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.575171 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 281/555] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:34.576120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b062810-9ff5-4c02-8a48-1aa5f5c7b972 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:34.576528 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b062810-9ff5-4c02-8a48-1aa5f5c7b972 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.577019 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35295ef5-0926-4449-88f7-4cd280de9d14 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.577484 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35295ef5-0926-4449-88f7-4cd280de9d14 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.577957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35295ef5-0926-4449-88f7-4cd280de9d14 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.578738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b062810-9ff5-4c02-8a48-1aa5f5c7b972 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.580371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 282/556] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:34.581493 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35295ef5-0926-4449-88f7-4cd280de9d14 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.601706 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35295ef5-0926-4449-88f7-4cd280de9d14 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.601970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 275/557] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:34.607436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64803c-0fde-4075-822e-5476a2174a66 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.607436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64803c-0fde-4075-822e-5476a2174a66 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.607436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c64803c-0fde-4075-822e-5476a2174a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.614108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384d3b6-30bc-4a0d-bb61-ecbb141dcff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.614901 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384d3b6-30bc-4a0d-bb61-ecbb141dcff9 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.615189 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384d3b6-30bc-4a0d-bb61-ecbb141dcff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.615540 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0384d3b6-30bc-4a0d-bb61-ecbb141dcff9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.630445 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-8c64803c-0fde-4075-822e-5476a2174a66 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:34.631664 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8c64803c-0fde-4075-822e-5476a2174a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:34.633922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384d3b6-30bc-4a0d-bb61-ecbb141dcff9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.636447 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0384d3b6-30bc-4a0d-bb61-ecbb141dcff9 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.640004 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 276/558] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:34.647792 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64803c-0fde-4075-822e-5476a2174a66 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.656967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-0384d3b6-30bc-4a0d-bb61-ecbb141dcff9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:34.659073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 283/559] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:34.663362 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c64803c-0fde-4075-822e-5476a2174a66 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.664493 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384d3b6-30bc-4a0d-bb61-ecbb141dcff9 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.676761 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f5b8b-5804-4580-a02f-7d5b427689e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.677643 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0384d3b6-30bc-4a0d-bb61-ecbb141dcff9 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.677786 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5b8b-5804-4580-a02f-7d5b427689e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.677926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5b8b-5804-4580-a02f-7d5b427689e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.678204 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f5b8b-5804-4580-a02f-7d5b427689e0 admin admin] PATH_INFO: `/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/e3df18302cd84e6eae6a1a60b0a8b2dc/roles/f9ebfff2487e4c75854f6c174dcebf56` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.684031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3bd0b-13dc-45a0-8c62-1474ff9f69d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.684886 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3bd0b-13dc-45a0-8c62-1474ff9f69d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.685305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3bd0b-13dc-45a0-8c62-1474ff9f69d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.685794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3bd0b-13dc-45a0-8c62-1474ff9f69d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.686745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3bd0b-13dc-45a0-8c62-1474ff9f69d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:34.687201 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3bd0b-13dc-45a0-8c62-1474ff9f69d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.688920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3bd0b-13dc-45a0-8c62-1474ff9f69d2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.694820 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f5b8b-5804-4580-a02f-7d5b427689e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e546ab571490aa0b23c0b22a35c4f, user_id=e3df18302cd84e6eae6a1a60b0a8b2dc, role_id=f9ebfff2487e4c75854f6c174dcebf56)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.697683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f5b8b-5804-4580-a02f-7d5b427689e0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.702972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 284/560] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:34.707343 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3bd0b-13dc-45a0-8c62-1474ff9f69d2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.717111 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3bd0b-13dc-45a0-8c62-1474ff9f69d2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.722310 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04d50d-9e7d-4f15-8102-05c66a37a279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.723376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04d50d-9e7d-4f15-8102-05c66a37a279 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.723647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04d50d-9e7d-4f15-8102-05c66a37a279 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.723913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04d50d-9e7d-4f15-8102-05c66a37a279 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.737561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd04d50d-9e7d-4f15-8102-05c66a37a279 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:34.744565 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-dd04d50d-9e7d-4f15-8102-05c66a37a279 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:34.750353 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 285/561] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:34.750353 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04d50d-9e7d-4f15-8102-05c66a37a279 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.756441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04d50d-9e7d-4f15-8102-05c66a37a279 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.761549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9931aa8-e31a-4476-995b-e71fa9f9556b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.762302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9931aa8-e31a-4476-995b-e71fa9f9556b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.762579 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9931aa8-e31a-4476-995b-e71fa9f9556b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.762865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9931aa8-e31a-4476-995b-e71fa9f9556b admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.767340 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 277/562] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:16:34 2022] PUT /identity/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/e3df18302cd84e6eae6a1a60b0a8b2dc/roles/f9ebfff2487e4c75854f6c174dcebf56 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:34.770924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f5b8b-5804-4580-a02f-7d5b427689e0 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.771393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9931aa8-e31a-4476-995b-e71fa9f9556b admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.773740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9931aa8-e31a-4476-995b-e71fa9f9556b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.793138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-d9931aa8-e31a-4476-995b-e71fa9f9556b admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 12 04:16:34.794634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 286/563] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:34.801749 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9931aa8-e31a-4476-995b-e71fa9f9556b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.814619 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9931aa8-e31a-4476-995b-e71fa9f9556b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.867769 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f5b8b-5804-4580-a02f-7d5b427689e0 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.881606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aef044-60b0-4c92-b957-0686ce0bd4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.882309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aef044-60b0-4c92-b957-0686ce0bd4b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.882591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aef044-60b0-4c92-b957-0686ce0bd4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.882937 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aef044-60b0-4c92-b957-0686ce0bd4b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.884079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aef044-60b0-4c92-b957-0686ce0bd4b8 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:34.884476 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aef044-60b0-4c92-b957-0686ce0bd4b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.886922 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aef044-60b0-4c92-b957-0686ce0bd4b8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.898278 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 278/564] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:34.900093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ecb49-2a37-4751-b969-081335b9e2f5 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.900459 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ecb49-2a37-4751-b969-081335b9e2f5 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.900993 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ecb49-2a37-4751-b969-081335b9e2f5 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.906939 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 279/565] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:34.910089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86579267-c7fb-4c80-a3d3-ca0477f7361d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.910299 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86579267-c7fb-4c80-a3d3-ca0477f7361d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.910567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86579267-c7fb-4c80-a3d3-ca0477f7361d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.922303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e57f63-a214-4f39-8fb0-e71b30b5fa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.924311 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e57f63-a214-4f39-8fb0-e71b30b5fa80 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.924935 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e57f63-a214-4f39-8fb0-e71b30b5fa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.925428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e57f63-a214-4f39-8fb0-e71b30b5fa80 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.926595 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e57f63-a214-4f39-8fb0-e71b30b5fa80 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:34.927114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e57f63-a214-4f39-8fb0-e71b30b5fa80 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.929458 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e57f63-a214-4f39-8fb0-e71b30b5fa80 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.934581 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-86579267-c7fb-4c80-a3d3-ca0477f7361d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:34.935827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-86579267-c7fb-4c80-a3d3-ca0477f7361d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:34.947291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 280/566] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:34.947291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86579267-c7fb-4c80-a3d3-ca0477f7361d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.957240 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86579267-c7fb-4c80-a3d3-ca0477f7361d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.962029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 287/567] 10.222.0.35 () {56 vars in 1158 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:34.962250 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366124c-5e31-47a0-8fa3-5fcaa0043cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.963138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366124c-5e31-47a0-8fa3-5fcaa0043cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.963449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366124c-5e31-47a0-8fa3-5fcaa0043cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.963722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366124c-5e31-47a0-8fa3-5fcaa0043cb6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.968312 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e57f63-a214-4f39-8fb0-e71b30b5fa80 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:34.976453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366124c-5e31-47a0-8fa3-5fcaa0043cb6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:34.978309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366124c-5e31-47a0-8fa3-5fcaa0043cb6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:34.984933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e57f63-a214-4f39-8fb0-e71b30b5fa80 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:34.990362 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78c906-ed96-49a4-b7db-589453b4cb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:34.991141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78c906-ed96-49a4-b7db-589453b4cb7d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:34.991452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78c906-ed96-49a4-b7db-589453b4cb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:34.991729 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78c906-ed96-49a4-b7db-589453b4cb7d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:34.998009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-d366124c-5e31-47a0-8fa3-5fcaa0043cb6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:34.999701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 281/568] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:35.000641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366124c-5e31-47a0-8fa3-5fcaa0043cb6 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.002701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78c906-ed96-49a4-b7db-589453b4cb7d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.004841 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78c906-ed96-49a4-b7db-589453b4cb7d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.011438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366124c-5e31-47a0-8fa3-5fcaa0043cb6 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.016383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad39f77-75f7-4a68-9943-08387f087f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.017162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad39f77-75f7-4a68-9943-08387f087f3f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.018097 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad39f77-75f7-4a68-9943-08387f087f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.018533 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad39f77-75f7-4a68-9943-08387f087f3f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.025341 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-2b78c906-ed96-49a4-b7db-589453b4cb7d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:35.027027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 288/569] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:35.027989 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78c906-ed96-49a4-b7db-589453b4cb7d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.029148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad39f77-75f7-4a68-9943-08387f087f3f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:35.036747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-cad39f77-75f7-4a68-9943-08387f087f3f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:35.037938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 282/570] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:35.038674 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78c906-ed96-49a4-b7db-589453b4cb7d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.043949 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad39f77-75f7-4a68-9943-08387f087f3f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.048134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c9bbb-aca9-4c57-a2ed-c26cb7178882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.049116 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9bbb-aca9-4c57-a2ed-c26cb7178882 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.049659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9bbb-aca9-4c57-a2ed-c26cb7178882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.050148 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c9bbb-aca9-4c57-a2ed-c26cb7178882 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.051109 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c9bbb-aca9-4c57-a2ed-c26cb7178882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:35.051645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c9bbb-aca9-4c57-a2ed-c26cb7178882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.053451 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c9bbb-aca9-4c57-a2ed-c26cb7178882 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.056076 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad39f77-75f7-4a68-9943-08387f087f3f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.061049 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e692b6-a4fb-4020-98ad-7a0d4f92849a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.061690 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e692b6-a4fb-4020-98ad-7a0d4f92849a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.062466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e692b6-a4fb-4020-98ad-7a0d4f92849a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.062735 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e692b6-a4fb-4020-98ad-7a0d4f92849a admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.063499 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e692b6-a4fb-4020-98ad-7a0d4f92849a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:35.063798 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e692b6-a4fb-4020-98ad-7a0d4f92849a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.066186 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e692b6-a4fb-4020-98ad-7a0d4f92849a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.068781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 289/571] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:35.069813 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c9bbb-aca9-4c57-a2ed-c26cb7178882 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.086713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 283/572] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:35.089011 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c9bbb-aca9-4c57-a2ed-c26cb7178882 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.090069 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e692b6-a4fb-4020-98ad-7a0d4f92849a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.096312 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bee52-4139-4851-9887-f42e0a2debc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.097189 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bee52-4139-4851-9887-f42e0a2debc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.097472 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bee52-4139-4851-9887-f42e0a2debc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.097742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3bee52-4139-4851-9887-f42e0a2debc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.098501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bee52-4139-4851-9887-f42e0a2debc2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:35.098800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bee52-4139-4851-9887-f42e0a2debc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.101275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3bee52-4139-4851-9887-f42e0a2debc2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.103255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e692b6-a4fb-4020-98ad-7a0d4f92849a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.108264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a375a-582f-4b64-a95a-cf9b1b30faf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.109374 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a375a-582f-4b64-a95a-cf9b1b30faf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.109858 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a375a-582f-4b64-a95a-cf9b1b30faf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.110288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 290/573] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:35.110583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a375a-582f-4b64-a95a-cf9b1b30faf0 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.111113 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bee52-4139-4851-9887-f42e0a2debc2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.126908 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3bee52-4139-4851-9887-f42e0a2debc2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.127154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a375a-582f-4b64-a95a-cf9b1b30faf0 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.129312 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3a375a-582f-4b64-a95a-cf9b1b30faf0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.132794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ca366-cdec-46d6-b8a6-efde6ae8e9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.133925 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca366-cdec-46d6-b8a6-efde6ae8e9af admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.134434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca366-cdec-46d6-b8a6-efde6ae8e9af admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.134920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ca366-cdec-46d6-b8a6-efde6ae8e9af admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.144707 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ca366-cdec-46d6-b8a6-efde6ae8e9af admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.147266 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ca366-cdec-46d6-b8a6-efde6ae8e9af admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.147552 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-0c3a375a-582f-4b64-a95a-cf9b1b30faf0 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 12 04:16:35.151300 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 284/574] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/users/neutron => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:35.152450 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a375a-582f-4b64-a95a-cf9b1b30faf0 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.164201 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a375a-582f-4b64-a95a-cf9b1b30faf0 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.167384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-737ca366-cdec-46d6-b8a6-efde6ae8e9af admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:35.168674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cdc91-128d-4eb1-bddd-eb903c02d220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.169461 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cdc91-128d-4eb1-bddd-eb903c02d220 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.169676 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 291/575] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:35.169772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cdc91-128d-4eb1-bddd-eb903c02d220 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.169976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cdc91-128d-4eb1-bddd-eb903c02d220 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.170905 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ca366-cdec-46d6-b8a6-efde6ae8e9af admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.185315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ca366-cdec-46d6-b8a6-efde6ae8e9af admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.188062 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cdc91-128d-4eb1-bddd-eb903c02d220 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.191021 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cdc91-128d-4eb1-bddd-eb903c02d220 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.191828 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7964b2-16ac-40be-9bf6-2bfe449a5e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.193231 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7964b2-16ac-40be-9bf6-2bfe449a5e10 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.193956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7964b2-16ac-40be-9bf6-2bfe449a5e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.194654 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7964b2-16ac-40be-9bf6-2bfe449a5e10 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.196003 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7964b2-16ac-40be-9bf6-2bfe449a5e10 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:35.196512 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7964b2-16ac-40be-9bf6-2bfe449a5e10 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.198683 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7964b2-16ac-40be-9bf6-2bfe449a5e10 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.210490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-a05cdc91-128d-4eb1-bddd-eb903c02d220 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:35.211899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 285/576] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:35.212497 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cdc91-128d-4eb1-bddd-eb903c02d220 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.224476 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 292/577] 10.222.0.35 () {56 vars in 1160 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:35.225305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7964b2-16ac-40be-9bf6-2bfe449a5e10 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.225827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cdc91-128d-4eb1-bddd-eb903c02d220 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.237762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5819-628c-4daa-a57a-e89a36f0e774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.238818 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5819-628c-4daa-a57a-e89a36f0e774 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.239333 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5819-628c-4daa-a57a-e89a36f0e774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.239855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57c5819-628c-4daa-a57a-e89a36f0e774 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.240890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5819-628c-4daa-a57a-e89a36f0e774 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:35.241428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5819-628c-4daa-a57a-e89a36f0e774 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.241672 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7964b2-16ac-40be-9bf6-2bfe449a5e10 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.244680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57c5819-628c-4daa-a57a-e89a36f0e774 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.246222 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3e0fd-e583-4915-a1cb-094ac0fc8f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.246854 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3e0fd-e583-4915-a1cb-094ac0fc8f26 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.247136 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3e0fd-e583-4915-a1cb-094ac0fc8f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.247436 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c3e0fd-e583-4915-a1cb-094ac0fc8f26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.248165 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3e0fd-e583-4915-a1cb-094ac0fc8f26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:35.248463 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3e0fd-e583-4915-a1cb-094ac0fc8f26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.250712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c3e0fd-e583-4915-a1cb-094ac0fc8f26 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.260675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 286/578] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:35.261766 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5819-628c-4daa-a57a-e89a36f0e774 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.269231 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 293/579] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:35.270317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3e0fd-e583-4915-a1cb-094ac0fc8f26 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.272795 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57c5819-628c-4daa-a57a-e89a36f0e774 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.285073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce07cc-0656-4dc5-8499-5a6d2f4723f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.285299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c3e0fd-e583-4915-a1cb-094ac0fc8f26 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.286276 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce07cc-0656-4dc5-8499-5a6d2f4723f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.286820 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce07cc-0656-4dc5-8499-5a6d2f4723f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.287433 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce07cc-0656-4dc5-8499-5a6d2f4723f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.290377 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de427d-8da3-4945-bdc1-e7dcb7a06bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.291637 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de427d-8da3-4945-bdc1-e7dcb7a06bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.291915 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de427d-8da3-4945-bdc1-e7dcb7a06bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.292231 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de427d-8da3-4945-bdc1-e7dcb7a06bb6 admin admin] PATH_INFO: `/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/df25b09762ab4130a1c656cd499d5fb2/roles/f9ebfff2487e4c75854f6c174dcebf56` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.300669 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce07cc-0656-4dc5-8499-5a6d2f4723f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.302880 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce07cc-0656-4dc5-8499-5a6d2f4723f8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.309842 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de427d-8da3-4945-bdc1-e7dcb7a06bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e546ab571490aa0b23c0b22a35c4f, user_id=df25b09762ab4130a1c656cd499d5fb2, role_id=f9ebfff2487e4c75854f6c174dcebf56)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.313673 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de427d-8da3-4945-bdc1-e7dcb7a06bb6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.321508 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-76ce07cc-0656-4dc5-8499-5a6d2f4723f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:35.322920 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 287/580] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:35.323905 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce07cc-0656-4dc5-8499-5a6d2f4723f8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.335558 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce07cc-0656-4dc5-8499-5a6d2f4723f8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.340386 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748d23e-c5f6-4b76-9336-57401d0b6be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.341149 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748d23e-c5f6-4b76-9336-57401d0b6be5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.341436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748d23e-c5f6-4b76-9336-57401d0b6be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.341713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748d23e-c5f6-4b76-9336-57401d0b6be5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.350821 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748d23e-c5f6-4b76-9336-57401d0b6be5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.352832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748d23e-c5f6-4b76-9336-57401d0b6be5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.367011 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-1748d23e-c5f6-4b76-9336-57401d0b6be5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 04:16:35.372777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 288/581] 10.222.0.35 () {56 vars in 1114 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:35.372777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748d23e-c5f6-4b76-9336-57401d0b6be5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.379758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748d23e-c5f6-4b76-9336-57401d0b6be5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.384334 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d92d1-765d-4f6e-bf40-e13d47c19d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.384977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d92d1-765d-4f6e-bf40-e13d47c19d33 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.385262 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d92d1-765d-4f6e-bf40-e13d47c19d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.385536 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d92d1-765d-4f6e-bf40-e13d47c19d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.386327 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d92d1-765d-4f6e-bf40-e13d47c19d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:35.386675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d92d1-765d-4f6e-bf40-e13d47c19d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.388322 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d92d1-765d-4f6e-bf40-e13d47c19d33 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.403291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 289/583] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:35.403291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d92d1-765d-4f6e-bf40-e13d47c19d33 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.403740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 294/583] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:16:35 2022] PUT /identity/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/df25b09762ab4130a1c656cd499d5fb2/roles/f9ebfff2487e4c75854f6c174dcebf56 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:35.408758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da581621-d12a-4832-a5af-08ac49fedf24 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.408758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da581621-d12a-4832-a5af-08ac49fedf24 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.408758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da581621-d12a-4832-a5af-08ac49fedf24 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.409711 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 295/584] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:35.413874 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d92d1-765d-4f6e-bf40-e13d47c19d33 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.426693 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da581621-d12a-4832-a5af-08ac49fedf24 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.490075 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da581621-d12a-4832-a5af-08ac49fedf24 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.492371 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7955db-ba8f-44c1-b3a3-88a6112b0b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.493447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7955db-ba8f-44c1-b3a3-88a6112b0b3a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.493881 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7955db-ba8f-44c1-b3a3-88a6112b0b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.494344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7955db-ba8f-44c1-b3a3-88a6112b0b3a admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.495163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f5ea0-6005-488a-8d51-ac01e78045df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.495674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7955db-ba8f-44c1-b3a3-88a6112b0b3a admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:35.496041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f5ea0-6005-488a-8d51-ac01e78045df admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.496300 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7955db-ba8f-44c1-b3a3-88a6112b0b3a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.496426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f5ea0-6005-488a-8d51-ac01e78045df admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.496582 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02f5ea0-6005-488a-8d51-ac01e78045df admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.499028 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7955db-ba8f-44c1-b3a3-88a6112b0b3a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.504831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f5ea0-6005-488a-8d51-ac01e78045df admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.507094 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02f5ea0-6005-488a-8d51-ac01e78045df admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.521699 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 290/585] 10.222.0.35 () {56 vars in 1154 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:35.522009 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-d02f5ea0-6005-488a-8d51-ac01e78045df admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:35.523391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84408e-a850-4b12-ba30-839af74f4358 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.523702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 296/586] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:35.524058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84408e-a850-4b12-ba30-839af74f4358 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.524346 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84408e-a850-4b12-ba30-839af74f4358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.535265 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f5ea0-6005-488a-8d51-ac01e78045df admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.545733 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02f5ea0-6005-488a-8d51-ac01e78045df admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.551210 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-2d84408e-a850-4b12-ba30-839af74f4358 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:35.552164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7a9f2-63e1-4d65-941a-38dbb0d886e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.552606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2d84408e-a850-4b12-ba30-839af74f4358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:35.552832 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7a9f2-63e1-4d65-941a-38dbb0d886e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.553118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7a9f2-63e1-4d65-941a-38dbb0d886e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.553396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7a9f2-63e1-4d65-941a-38dbb0d886e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.554329 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7a9f2-63e1-4d65-941a-38dbb0d886e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:35.554647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7a9f2-63e1-4d65-941a-38dbb0d886e6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.557169 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7a9f2-63e1-4d65-941a-38dbb0d886e6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.562007 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 291/587] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:35.562978 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84408e-a850-4b12-ba30-839af74f4358 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.571381 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 297/588] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:35.578458 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84408e-a850-4b12-ba30-839af74f4358 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.581226 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7a9f2-63e1-4d65-941a-38dbb0d886e6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.588806 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9ff82-cfb2-43fd-b2fc-7cef88571269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.591933 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9ff82-cfb2-43fd-b2fc-7cef88571269 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.592503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9ff82-cfb2-43fd-b2fc-7cef88571269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.593107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9ff82-cfb2-43fd-b2fc-7cef88571269 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.598196 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7a9f2-63e1-4d65-941a-38dbb0d886e6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.603112 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a970f-1c6f-4ea0-9134-c15c7eee5ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.604102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a970f-1c6f-4ea0-9134-c15c7eee5ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.604451 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a970f-1c6f-4ea0-9134-c15c7eee5ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.604793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a970f-1c6f-4ea0-9134-c15c7eee5ab2 admin admin] PATH_INFO: `/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/d9c5541a29cf42f6ab394133baa05fae/roles/f9ebfff2487e4c75854f6c174dcebf56` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.608744 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9ff82-cfb2-43fd-b2fc-7cef88571269 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.610774 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9ff82-cfb2-43fd-b2fc-7cef88571269 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.623702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a970f-1c6f-4ea0-9134-c15c7eee5ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e546ab571490aa0b23c0b22a35c4f, user_id=d9c5541a29cf42f6ab394133baa05fae, role_id=f9ebfff2487e4c75854f6c174dcebf56)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.626571 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a970f-1c6f-4ea0-9134-c15c7eee5ab2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.630990 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-59d9ff82-cfb2-43fd-b2fc-7cef88571269 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:35.632654 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 292/589] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:35.634407 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9ff82-cfb2-43fd-b2fc-7cef88571269 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.644156 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9ff82-cfb2-43fd-b2fc-7cef88571269 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.648633 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73bcda-a8ad-4649-bf75-76e243fc9103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.649410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73bcda-a8ad-4649-bf75-76e243fc9103 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.649695 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73bcda-a8ad-4649-bf75-76e243fc9103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.649966 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a73bcda-a8ad-4649-bf75-76e243fc9103 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.660803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a73bcda-a8ad-4649-bf75-76e243fc9103 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:35.668004 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-3a73bcda-a8ad-4649-bf75-76e243fc9103 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:35.669375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 293/590] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:35.669956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73bcda-a8ad-4649-bf75-76e243fc9103 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.680569 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a73bcda-a8ad-4649-bf75-76e243fc9103 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.684916 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd96f0-cb43-4082-90a2-daa314745c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.685542 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd96f0-cb43-4082-90a2-daa314745c57 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.685821 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd96f0-cb43-4082-90a2-daa314745c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.686095 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dd96f0-cb43-4082-90a2-daa314745c57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.686818 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd96f0-cb43-4082-90a2-daa314745c57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:35.687116 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd96f0-cb43-4082-90a2-daa314745c57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.688752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dd96f0-cb43-4082-90a2-daa314745c57 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.701806 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 294/591] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:35.702421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd96f0-cb43-4082-90a2-daa314745c57 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.713967 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dd96f0-cb43-4082-90a2-daa314745c57 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.717941 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 298/592] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:16:35 2022] PUT /identity/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/d9c5541a29cf42f6ab394133baa05fae/roles/f9ebfff2487e4c75854f6c174dcebf56 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:35.719030 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a970f-1c6f-4ea0-9134-c15c7eee5ab2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.813886 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30337c8-7a34-4180-a3c1-7a556919db0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.815455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30337c8-7a34-4180-a3c1-7a556919db0a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.815956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30337c8-7a34-4180-a3c1-7a556919db0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.816436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30337c8-7a34-4180-a3c1-7a556919db0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.817496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30337c8-7a34-4180-a3c1-7a556919db0a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:35.818014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30337c8-7a34-4180-a3c1-7a556919db0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.819996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30337c8-7a34-4180-a3c1-7a556919db0a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.831504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a970f-1c6f-4ea0-9134-c15c7eee5ab2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.835426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21865d88-6595-4ac0-a809-a89b32ec4892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.836230 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21865d88-6595-4ac0-a809-a89b32ec4892 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.836510 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21865d88-6595-4ac0-a809-a89b32ec4892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.836785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21865d88-6595-4ac0-a809-a89b32ec4892 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.838531 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 295/593] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:35.843737 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30337c8-7a34-4180-a3c1-7a556919db0a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.845124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21865d88-6595-4ac0-a809-a89b32ec4892 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.847188 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21865d88-6595-4ac0-a809-a89b32ec4892 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.863317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-21865d88-6595-4ac0-a809-a89b32ec4892 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:35.863698 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 299/594] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:35.864566 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30337c8-7a34-4180-a3c1-7a556919db0a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.871356 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21865d88-6595-4ac0-a809-a89b32ec4892 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.880143 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21865d88-6595-4ac0-a809-a89b32ec4892 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.892019 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6413b7-f948-406a-a1c4-28a33bbcafd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.892775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6413b7-f948-406a-a1c4-28a33bbcafd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.893051 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6413b7-f948-406a-a1c4-28a33bbcafd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.893322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6413b7-f948-406a-a1c4-28a33bbcafd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.894743 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6413b7-f948-406a-a1c4-28a33bbcafd6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:35.895054 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6413b7-f948-406a-a1c4-28a33bbcafd6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.896911 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3350d3-2e07-41dc-8c9d-579c7702cd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.897688 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6413b7-f948-406a-a1c4-28a33bbcafd6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.897805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3350d3-2e07-41dc-8c9d-579c7702cd3a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.897979 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3350d3-2e07-41dc-8c9d-579c7702cd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.898254 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3350d3-2e07-41dc-8c9d-579c7702cd3a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.913321 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 300/595] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:35.915313 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3350d3-2e07-41dc-8c9d-579c7702cd3a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.917171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3350d3-2e07-41dc-8c9d-579c7702cd3a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.918972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6413b7-f948-406a-a1c4-28a33bbcafd6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.931542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6413b7-f948-406a-a1c4-28a33bbcafd6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.940555 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-2e3350d3-2e07-41dc-8c9d-579c7702cd3a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:35.942079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 296/596] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:35.943696 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0a66d-f9c2-4d42-a6fb-f7dc4bde62d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.944591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0a66d-f9c2-4d42-a6fb-f7dc4bde62d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.944874 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0a66d-f9c2-4d42-a6fb-f7dc4bde62d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.945151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0a66d-f9c2-4d42-a6fb-f7dc4bde62d1 admin admin] PATH_INFO: `/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/362ab4aeb88746d8b8a14a238c877a53/roles/f9ebfff2487e4c75854f6c174dcebf56` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.952899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3350d3-2e07-41dc-8c9d-579c7702cd3a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:35.967878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3350d3-2e07-41dc-8c9d-579c7702cd3a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:35.977289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0a66d-f9c2-4d42-a6fb-f7dc4bde62d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e546ab571490aa0b23c0b22a35c4f, user_id=362ab4aeb88746d8b8a14a238c877a53, role_id=f9ebfff2487e4c75854f6c174dcebf56)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.979207 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5177205-9839-489b-a38b-ea375518ff31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:35.980170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5177205-9839-489b-a38b-ea375518ff31 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:35.981007 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5177205-9839-489b-a38b-ea375518ff31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:35.982511 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5177205-9839-489b-a38b-ea375518ff31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:35.983551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5177205-9839-489b-a38b-ea375518ff31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:35.984166 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0a66d-f9c2-4d42-a6fb-f7dc4bde62d1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:35.984638 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5177205-9839-489b-a38b-ea375518ff31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:35.986724 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5177205-9839-489b-a38b-ea375518ff31 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:36.003041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 297/597] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:36.008905 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5177205-9839-489b-a38b-ea375518ff31 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:36.020189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5177205-9839-489b-a38b-ea375518ff31 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:36.026975 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fed59d-8563-4a1e-a0c1-61b7e584544d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:36.028763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed59d-8563-4a1e-a0c1-61b7e584544d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:36.029220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed59d-8563-4a1e-a0c1-61b7e584544d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:36.034573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fed59d-8563-4a1e-a0c1-61b7e584544d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:36.040918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fed59d-8563-4a1e-a0c1-61b7e584544d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:36.043188 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fed59d-8563-4a1e-a0c1-61b7e584544d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:36.058364 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-d7fed59d-8563-4a1e-a0c1-61b7e584544d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 12 04:16:36.060033 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 298/598] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:36.066283 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 301/599] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:16:35 2022] PUT /identity/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/362ab4aeb88746d8b8a14a238c877a53/roles/f9ebfff2487e4c75854f6c174dcebf56 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:16:36.066502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fed59d-8563-4a1e-a0c1-61b7e584544d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:36.081612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fed59d-8563-4a1e-a0c1-61b7e584544d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:36.159956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd737f-60fd-4895-acac-76ed58a65472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:36.160606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd737f-60fd-4895-acac-76ed58a65472 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:36.160886 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd737f-60fd-4895-acac-76ed58a65472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:36.161158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bd737f-60fd-4895-acac-76ed58a65472 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:36.162012 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd737f-60fd-4895-acac-76ed58a65472 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:36.162319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd737f-60fd-4895-acac-76ed58a65472 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:36.164281 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bd737f-60fd-4895-acac-76ed58a65472 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:36.187305 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 299/600] 10.222.0.35 () {56 vars in 1156 bytes} [Sat Feb 12 04:16:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:36.193252 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0a66d-f9c2-4d42-a6fb-f7dc4bde62d1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:36.216379 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0a66d-f9c2-4d42-a6fb-f7dc4bde62d1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:36.233630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83b272-b85e-4487-af33-792bcda312b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:36.233630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83b272-b85e-4487-af33-792bcda312b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:36.233630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83b272-b85e-4487-af33-792bcda312b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:36.233946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d83b272-b85e-4487-af33-792bcda312b6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:36.251246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83b272-b85e-4487-af33-792bcda312b6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:36.253561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d83b272-b85e-4487-af33-792bcda312b6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:36.269401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 302/601] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:36.278580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd737f-60fd-4895-acac-76ed58a65472 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:36.290045 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bd737f-60fd-4895-acac-76ed58a65472 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:36.295368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d9f21-455c-404c-94c7-203d00b3792c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:36.296144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d9f21-455c-404c-94c7-203d00b3792c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:36.296420 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d9f21-455c-404c-94c7-203d00b3792c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:36.296689 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d9f21-455c-404c-94c7-203d00b3792c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:36.310621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d9f21-455c-404c-94c7-203d00b3792c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:36.312510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d9f21-455c-404c-94c7-203d00b3792c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:36.330914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-bc1d9f21-455c-404c-94c7-203d00b3792c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:36.332648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 300/602] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:36.338220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83b272-b85e-4487-af33-792bcda312b6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:36.348078 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d83b272-b85e-4487-af33-792bcda312b6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:36.352572 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886216dd-2c65-4dc8-a109-abd311861e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:36.353265 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886216dd-2c65-4dc8-a109-abd311861e5e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:36.353542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886216dd-2c65-4dc8-a109-abd311861e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:36.353859 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886216dd-2c65-4dc8-a109-abd311861e5e admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:36.354593 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886216dd-2c65-4dc8-a109-abd311861e5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:36.354889 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886216dd-2c65-4dc8-a109-abd311861e5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:36.356592 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886216dd-2c65-4dc8-a109-abd311861e5e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:36.368750 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 303/603] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:36.374186 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d9f21-455c-404c-94c7-203d00b3792c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:36.384685 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d9f21-455c-404c-94c7-203d00b3792c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:36.391119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b283b1-4dce-46fc-a0d7-d6f4a5b86478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:36.391119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b283b1-4dce-46fc-a0d7-d6f4a5b86478 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:36.391119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b283b1-4dce-46fc-a0d7-d6f4a5b86478 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:36.391119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b283b1-4dce-46fc-a0d7-d6f4a5b86478 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:36.398771 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b283b1-4dce-46fc-a0d7-d6f4a5b86478 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:36.400944 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b283b1-4dce-46fc-a0d7-d6f4a5b86478 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:36.414600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-61b283b1-4dce-46fc-a0d7-d6f4a5b86478 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:36.416446 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 301/604] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:36.422306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886216dd-2c65-4dc8-a109-abd311861e5e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:36.434298 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886216dd-2c65-4dc8-a109-abd311861e5e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:36.443502 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a86d0c-19a5-45a7-a1e0-619214e64d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:36.444103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a86d0c-19a5-45a7-a1e0-619214e64d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:36.444385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a86d0c-19a5-45a7-a1e0-619214e64d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:36.444660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a86d0c-19a5-45a7-a1e0-619214e64d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:36.445463 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a86d0c-19a5-45a7-a1e0-619214e64d53 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:36.445775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a86d0c-19a5-45a7-a1e0-619214e64d53 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:36.447665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a86d0c-19a5-45a7-a1e0-619214e64d53 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:36.468212 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 304/605] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:36.474441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b283b1-4dce-46fc-a0d7-d6f4a5b86478 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:36.492251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b283b1-4dce-46fc-a0d7-d6f4a5b86478 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:36.497196 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ea3d2-a429-49ab-853d-31bd20142a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:36.497989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ea3d2-a429-49ab-853d-31bd20142a22 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:36.498447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ea3d2-a429-49ab-853d-31bd20142a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:36.498855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ea3d2-a429-49ab-853d-31bd20142a22 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:36.499858 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ea3d2-a429-49ab-853d-31bd20142a22 admin admin] RBAC: Adding query filter params (role.id=f9ebfff2487e4c75854f6c174dcebf56, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=3b37a10e3b5e404db7aad72e1772a2de) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:36.500320 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ea3d2-a429-49ab-853d-31bd20142a22 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:36.502976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ea3d2-a429-49ab-853d-31bd20142a22 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:36.514108 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 302/606] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:36 2022] GET /identity/v3/role_assignments?user.id=3b37a10e3b5e404db7aad72e1772a2de&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=f9ebfff2487e4c75854f6c174dcebf56 => generated 259 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:37.429385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d040-c051-4846-838e-1c102bac1459 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:37.430680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d040-c051-4846-838e-1c102bac1459 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:37.431143 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748d040-c051-4846-838e-1c102bac1459 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:37.433336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 305/607] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:37.438961 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb0b9d-f206-4e67-893a-68b54b986a27 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:37.440317 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb0b9d-f206-4e67-893a-68b54b986a27 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:37.445690 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb0b9d-f206-4e67-893a-68b54b986a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:37.466859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-bbbb0b9d-f206-4e67-893a-68b54b986a27 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:37.468065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-bbbb0b9d-f206-4e67-893a-68b54b986a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:37.478576 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 303/608] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:37.514130 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d040-c051-4846-838e-1c102bac1459 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:37.533459 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748d040-c051-4846-838e-1c102bac1459 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:37.537888 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964aa33d-b9a8-460d-89d3-6756d8874b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:37.538677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964aa33d-b9a8-460d-89d3-6756d8874b90 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:37.538951 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964aa33d-b9a8-460d-89d3-6756d8874b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:37.539217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964aa33d-b9a8-460d-89d3-6756d8874b90 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:37.556391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964aa33d-b9a8-460d-89d3-6756d8874b90 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:37.563372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-964aa33d-b9a8-460d-89d3-6756d8874b90 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:37.564980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 306/609] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:37.570559 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb0b9d-f206-4e67-893a-68b54b986a27 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:37.584762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb0b9d-f206-4e67-893a-68b54b986a27 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:37.599977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2a9ee-0c58-4ac1-a365-a336c6b2d62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:37.600668 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2a9ee-0c58-4ac1-a365-a336c6b2d62c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:37.600944 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2a9ee-0c58-4ac1-a365-a336c6b2d62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:37.601214 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2a9ee-0c58-4ac1-a365-a336c6b2d62c admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:37.601985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2a9ee-0c58-4ac1-a365-a336c6b2d62c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:37.602349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2a9ee-0c58-4ac1-a365-a336c6b2d62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:37.604023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e2a9ee-0c58-4ac1-a365-a336c6b2d62c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:37.613994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 304/610] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:37.619457 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964aa33d-b9a8-460d-89d3-6756d8874b90 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:37.632177 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964aa33d-b9a8-460d-89d3-6756d8874b90 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:37.639308 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47b62b-27ec-4997-b2de-0ee5ef0538ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:37.640095 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47b62b-27ec-4997-b2de-0ee5ef0538ab admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:37.640384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47b62b-27ec-4997-b2de-0ee5ef0538ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:37.640654 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47b62b-27ec-4997-b2de-0ee5ef0538ab admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:37.657283 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47b62b-27ec-4997-b2de-0ee5ef0538ab admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:37.660056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47b62b-27ec-4997-b2de-0ee5ef0538ab admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:37.683140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-dc47b62b-27ec-4997-b2de-0ee5ef0538ab admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:37.684681 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 307/611] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:37.690463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2a9ee-0c58-4ac1-a365-a336c6b2d62c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:37.705918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2a9ee-0c58-4ac1-a365-a336c6b2d62c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:37.710415 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75223691-69ae-4df9-99e3-d537d6f463ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:37.711063 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75223691-69ae-4df9-99e3-d537d6f463ec admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:37.711361 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75223691-69ae-4df9-99e3-d537d6f463ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:37.711633 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75223691-69ae-4df9-99e3-d537d6f463ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:37.712364 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75223691-69ae-4df9-99e3-d537d6f463ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:37.712662 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75223691-69ae-4df9-99e3-d537d6f463ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:37.714226 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75223691-69ae-4df9-99e3-d537d6f463ec admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:37.732624 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 305/612] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:37.738563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47b62b-27ec-4997-b2de-0ee5ef0538ab admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:37.752505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47b62b-27ec-4997-b2de-0ee5ef0538ab admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:37.761168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801567a6-9d0e-4bcd-a6c3-de58a8976e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:37.761954 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801567a6-9d0e-4bcd-a6c3-de58a8976e02 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:37.762233 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801567a6-9d0e-4bcd-a6c3-de58a8976e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:37.762501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801567a6-9d0e-4bcd-a6c3-de58a8976e02 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:37.772476 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801567a6-9d0e-4bcd-a6c3-de58a8976e02 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:37.774478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801567a6-9d0e-4bcd-a6c3-de58a8976e02 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:37.788644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-801567a6-9d0e-4bcd-a6c3-de58a8976e02 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Feb 12 04:16:37.790074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 308/613] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:37.796495 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75223691-69ae-4df9-99e3-d537d6f463ec admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:37.810471 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75223691-69ae-4df9-99e3-d537d6f463ec admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:37.819638 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ea610-0d92-4db2-b286-c79f9a0e6225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:37.820548 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ea610-0d92-4db2-b286-c79f9a0e6225 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:37.820977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ea610-0d92-4db2-b286-c79f9a0e6225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:37.821393 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ea610-0d92-4db2-b286-c79f9a0e6225 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:37.822422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ea610-0d92-4db2-b286-c79f9a0e6225 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:37.822891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ea610-0d92-4db2-b286-c79f9a0e6225 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:37.824891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ea610-0d92-4db2-b286-c79f9a0e6225 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:37.855659 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 306/614] 10.222.0.35 () {56 vars in 1158 bytes} [Sat Feb 12 04:16:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:37.862284 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801567a6-9d0e-4bcd-a6c3-de58a8976e02 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:37.875860 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801567a6-9d0e-4bcd-a6c3-de58a8976e02 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:37.883845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d44daa-98c8-44f2-a2e4-07d31acc9da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:37.884491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d44daa-98c8-44f2-a2e4-07d31acc9da5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:37.884774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d44daa-98c8-44f2-a2e4-07d31acc9da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:37.885047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d44daa-98c8-44f2-a2e4-07d31acc9da5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:37.896227 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d44daa-98c8-44f2-a2e4-07d31acc9da5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:37.897977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d44daa-98c8-44f2-a2e4-07d31acc9da5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:37.910123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 309/615] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:37.915245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ea610-0d92-4db2-b286-c79f9a0e6225 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:37.929191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ea610-0d92-4db2-b286-c79f9a0e6225 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:37.938747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f06df2-c747-456c-b1b7-5684ea922161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:37.940210 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f06df2-c747-456c-b1b7-5684ea922161 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:37.940719 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f06df2-c747-456c-b1b7-5684ea922161 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:37.941202 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f06df2-c747-456c-b1b7-5684ea922161 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:37.963145 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f06df2-c747-456c-b1b7-5684ea922161 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:37.965343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f06df2-c747-456c-b1b7-5684ea922161 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:37.993298 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-22f06df2-c747-456c-b1b7-5684ea922161 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:37.994822 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 307/616] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:38.000283 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d44daa-98c8-44f2-a2e4-07d31acc9da5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.013389 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d44daa-98c8-44f2-a2e4-07d31acc9da5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.024825 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7151f16-b90c-4c42-a58d-cc10b10963d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.025483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7151f16-b90c-4c42-a58d-cc10b10963d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.025766 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7151f16-b90c-4c42-a58d-cc10b10963d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.026043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7151f16-b90c-4c42-a58d-cc10b10963d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.026785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7151f16-b90c-4c42-a58d-cc10b10963d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:38.027090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7151f16-b90c-4c42-a58d-cc10b10963d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.028764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7151f16-b90c-4c42-a58d-cc10b10963d5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.050238 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 310/617] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:38.055365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f06df2-c747-456c-b1b7-5684ea922161 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.068828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f06df2-c747-456c-b1b7-5684ea922161 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.076129 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a206b-cf09-44b0-8e22-6c5d537ba7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.077220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a206b-cf09-44b0-8e22-6c5d537ba7be admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.077697 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a206b-cf09-44b0-8e22-6c5d537ba7be admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.078160 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a206b-cf09-44b0-8e22-6c5d537ba7be admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.092450 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a206b-cf09-44b0-8e22-6c5d537ba7be admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.094407 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a206b-cf09-44b0-8e22-6c5d537ba7be admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.109221 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-7d7a206b-cf09-44b0-8e22-6c5d537ba7be admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:38.110699 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 308/618] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:38.116967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7151f16-b90c-4c42-a58d-cc10b10963d5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.127648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7151f16-b90c-4c42-a58d-cc10b10963d5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.138915 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1b869-21d9-4afb-a74f-a47bbd94b201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.139259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb9fd-0912-49bf-98df-9cbad0f78b3d None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.139530 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb9fd-0912-49bf-98df-9cbad0f78b3d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.139624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1b869-21d9-4afb-a74f-a47bbd94b201 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.139800 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bb9fd-0912-49bf-98df-9cbad0f78b3d None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.139913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1b869-21d9-4afb-a74f-a47bbd94b201 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.140105 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1b869-21d9-4afb-a74f-a47bbd94b201 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.140904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1b869-21d9-4afb-a74f-a47bbd94b201 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:38.141209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1b869-21d9-4afb-a74f-a47bbd94b201 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.141704 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 309/619] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:38.143799 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1b869-21d9-4afb-a74f-a47bbd94b201 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.148208 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f196a2c-aa46-45cb-96f6-e0d50e6f4a2c None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.148724 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f196a2c-aa46-45cb-96f6-e0d50e6f4a2c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.149191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f196a2c-aa46-45cb-96f6-e0d50e6f4a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.166784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 311/620] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:38.170244 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1b869-21d9-4afb-a74f-a47bbd94b201 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.186296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-7f196a2c-aa46-45cb-96f6-e0d50e6f4a2c None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:38.187979 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7f196a2c-aa46-45cb-96f6-e0d50e6f4a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:38.190582 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1b869-21d9-4afb-a74f-a47bbd94b201 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.198457 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605ae56-61f4-4930-a997-d486bf083536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.200276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605ae56-61f4-4930-a997-d486bf083536 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.201946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605ae56-61f4-4930-a997-d486bf083536 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.202421 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605ae56-61f4-4930-a997-d486bf083536 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.203507 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605ae56-61f4-4930-a997-d486bf083536 admin admin] RBAC: Adding query filter params (role.id=f9ebfff2487e4c75854f6c174dcebf56, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=e3df18302cd84e6eae6a1a60b0a8b2dc) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:38.205053 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605ae56-61f4-4930-a997-d486bf083536 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.206536 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 310/621] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:38.213323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5605ae56-61f4-4930-a997-d486bf083536 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.220851 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 312/622] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/role_assignments?user.id=e3df18302cd84e6eae6a1a60b0a8b2dc&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=f9ebfff2487e4c75854f6c174dcebf56 => generated 608 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:38.240256 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f196a2c-aa46-45cb-96f6-e0d50e6f4a2c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.250805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f196a2c-aa46-45cb-96f6-e0d50e6f4a2c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.256556 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db454886-84d2-4560-a47b-fbae43efe6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.257576 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db454886-84d2-4560-a47b-fbae43efe6fa admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.258050 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db454886-84d2-4560-a47b-fbae43efe6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.258512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db454886-84d2-4560-a47b-fbae43efe6fa admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.271079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db454886-84d2-4560-a47b-fbae43efe6fa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:38.278716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-db454886-84d2-4560-a47b-fbae43efe6fa admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:38.286152 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 311/623] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:38.287633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605ae56-61f4-4930-a997-d486bf083536 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.306412 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605ae56-61f4-4930-a997-d486bf083536 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.315047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582f2a3-fa7f-4868-8f19-3e44a2a3a0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.316300 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582f2a3-fa7f-4868-8f19-3e44a2a3a0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.316818 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582f2a3-fa7f-4868-8f19-3e44a2a3a0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.317387 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582f2a3-fa7f-4868-8f19-3e44a2a3a0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.318939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582f2a3-fa7f-4868-8f19-3e44a2a3a0c1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:38.321518 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582f2a3-fa7f-4868-8f19-3e44a2a3a0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.323281 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582f2a3-fa7f-4868-8f19-3e44a2a3a0c1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.337644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 313/624] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:38.343009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db454886-84d2-4560-a47b-fbae43efe6fa admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.356529 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db454886-84d2-4560-a47b-fbae43efe6fa admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.367137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c30d65-1f2b-48d5-8f21-c1ae7c385b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.367957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c30d65-1f2b-48d5-8f21-c1ae7c385b59 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.368234 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c30d65-1f2b-48d5-8f21-c1ae7c385b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.368510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c30d65-1f2b-48d5-8f21-c1ae7c385b59 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.380597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c30d65-1f2b-48d5-8f21-c1ae7c385b59 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.382463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c30d65-1f2b-48d5-8f21-c1ae7c385b59 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.400214 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-56c30d65-1f2b-48d5-8f21-c1ae7c385b59 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:38.401449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 312/625] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:38.407161 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582f2a3-fa7f-4868-8f19-3e44a2a3a0c1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.417898 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582f2a3-fa7f-4868-8f19-3e44a2a3a0c1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.422600 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a9983-931c-482f-91d3-2a012ce79e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.423482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a9983-931c-482f-91d3-2a012ce79e70 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.424675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a9983-931c-482f-91d3-2a012ce79e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.424675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a9983-931c-482f-91d3-2a012ce79e70 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.425593 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a9983-931c-482f-91d3-2a012ce79e70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:38.426016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a9983-931c-482f-91d3-2a012ce79e70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.427739 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a9983-931c-482f-91d3-2a012ce79e70 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.441079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 314/626] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:38.446612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c30d65-1f2b-48d5-8f21-c1ae7c385b59 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.457368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c30d65-1f2b-48d5-8f21-c1ae7c385b59 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.462020 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310718fb-b705-456d-a527-95177a12406e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.462836 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310718fb-b705-456d-a527-95177a12406e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.463119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310718fb-b705-456d-a527-95177a12406e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.463430 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310718fb-b705-456d-a527-95177a12406e admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.473097 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310718fb-b705-456d-a527-95177a12406e admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.475123 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310718fb-b705-456d-a527-95177a12406e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.490191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-310718fb-b705-456d-a527-95177a12406e admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 12 04:16:38.495341 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 313/627] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:38.497393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a9983-931c-482f-91d3-2a012ce79e70 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.507726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a9983-931c-482f-91d3-2a012ce79e70 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.512351 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9152a-f1e6-45bd-9c21-7d441e992e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.513029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9152a-f1e6-45bd-9c21-7d441e992e56 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.513312 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9152a-f1e6-45bd-9c21-7d441e992e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.513588 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9152a-f1e6-45bd-9c21-7d441e992e56 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.514456 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9152a-f1e6-45bd-9c21-7d441e992e56 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:38.514762 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9152a-f1e6-45bd-9c21-7d441e992e56 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.516850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d9152a-f1e6-45bd-9c21-7d441e992e56 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.544947 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 315/628] 10.222.0.35 () {56 vars in 1158 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:38.546282 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310718fb-b705-456d-a527-95177a12406e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.557051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310718fb-b705-456d-a527-95177a12406e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.561526 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83670330-fec4-4b1f-8d21-183cd02216e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.562164 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83670330-fec4-4b1f-8d21-183cd02216e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.562448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83670330-fec4-4b1f-8d21-183cd02216e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.562725 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83670330-fec4-4b1f-8d21-183cd02216e7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.571235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83670330-fec4-4b1f-8d21-183cd02216e7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.573062 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83670330-fec4-4b1f-8d21-183cd02216e7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.587358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 314/629] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 04:16:38.589309 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9152a-f1e6-45bd-9c21-7d441e992e56 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.600014 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d9152a-f1e6-45bd-9c21-7d441e992e56 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.605540 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e67b50-f016-4b6d-baec-7d57b4e701aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.606370 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e67b50-f016-4b6d-baec-7d57b4e701aa admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.606694 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e67b50-f016-4b6d-baec-7d57b4e701aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.606971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e67b50-f016-4b6d-baec-7d57b4e701aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.619771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e67b50-f016-4b6d-baec-7d57b4e701aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.621532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e67b50-f016-4b6d-baec-7d57b4e701aa admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.641666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-f8e67b50-f016-4b6d-baec-7d57b4e701aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:38.647115 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 316/630] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:38.648882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83670330-fec4-4b1f-8d21-183cd02216e7 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.659970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83670330-fec4-4b1f-8d21-183cd02216e7 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.664877 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaca285-bad0-41fa-ad01-5b1d1803b6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.665609 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaca285-bad0-41fa-ad01-5b1d1803b6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.665891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaca285-bad0-41fa-ad01-5b1d1803b6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.666165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaca285-bad0-41fa-ad01-5b1d1803b6b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.666975 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaca285-bad0-41fa-ad01-5b1d1803b6b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:38.667351 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaca285-bad0-41fa-ad01-5b1d1803b6b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.668964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaca285-bad0-41fa-ad01-5b1d1803b6b1 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.687357 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 315/631] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:38.692651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaca285-bad0-41fa-ad01-5b1d1803b6b1 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.693114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb0667-654e-46ad-b885-6fdde1932cb9 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.693403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb0667-654e-46ad-b885-6fdde1932cb9 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.693670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb0667-654e-46ad-b885-6fdde1932cb9 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.695554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 317/632] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:38.704616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78f9fa-2d97-4abc-b635-b40ab0e74c7d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.704616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78f9fa-2d97-4abc-b635-b40ab0e74c7d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.704616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab78f9fa-2d97-4abc-b635-b40ab0e74c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.705234 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaca285-bad0-41fa-ad01-5b1d1803b6b1 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.709986 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a01013-5408-4f67-a319-1364ddbf4fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.711117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01013-5408-4f67-a319-1364ddbf4fe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.711616 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01013-5408-4f67-a319-1364ddbf4fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.712077 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a01013-5408-4f67-a319-1364ddbf4fe0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.719967 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a01013-5408-4f67-a319-1364ddbf4fe0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.722244 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a01013-5408-4f67-a319-1364ddbf4fe0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.725700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-ab78f9fa-2d97-4abc-b635-b40ab0e74c7d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:38.726850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ab78f9fa-2d97-4abc-b635-b40ab0e74c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:38.735867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 318/633] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:38.737706 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-d7a01013-5408-4f67-a319-1364ddbf4fe0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:38.743310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 316/634] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:38.745139 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78f9fa-2d97-4abc-b635-b40ab0e74c7d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.755755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab78f9fa-2d97-4abc-b635-b40ab0e74c7d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.760646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3365e6-fc8f-414b-9ba7-96b7e651bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.761588 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3365e6-fc8f-414b-9ba7-96b7e651bdfe admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.762129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3365e6-fc8f-414b-9ba7-96b7e651bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.762625 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3365e6-fc8f-414b-9ba7-96b7e651bdfe admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.763890 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3365e6-fc8f-414b-9ba7-96b7e651bdfe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:38.764400 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3365e6-fc8f-414b-9ba7-96b7e651bdfe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.764903 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a01013-5408-4f67-a319-1364ddbf4fe0 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.766765 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3365e6-fc8f-414b-9ba7-96b7e651bdfe admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.778917 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a01013-5408-4f67-a319-1364ddbf4fe0 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.785668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 319/635] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:38.787177 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3365e6-fc8f-414b-9ba7-96b7e651bdfe admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.790400 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c5df2-cf69-4b5b-951d-0c06946420ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.791568 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c5df2-cf69-4b5b-951d-0c06946420ef admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.792048 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c5df2-cf69-4b5b-951d-0c06946420ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.792546 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c5df2-cf69-4b5b-951d-0c06946420ef admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.800334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3365e6-fc8f-414b-9ba7-96b7e651bdfe admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.804939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009523a-4d7b-4b10-8eeb-9c5a26956741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.805882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009523a-4d7b-4b10-8eeb-9c5a26956741 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.806161 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009523a-4d7b-4b10-8eeb-9c5a26956741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.806509 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009523a-4d7b-4b10-8eeb-9c5a26956741 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.807297 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c5df2-cf69-4b5b-951d-0c06946420ef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:38.807403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009523a-4d7b-4b10-8eeb-9c5a26956741 admin admin] RBAC: Adding query filter params (role.id=f9ebfff2487e4c75854f6c174dcebf56, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=df25b09762ab4130a1c656cd499d5fb2) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:38.807683 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009523a-4d7b-4b10-8eeb-9c5a26956741 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.809637 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009523a-4d7b-4b10-8eeb-9c5a26956741 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.815279 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-e22c5df2-cf69-4b5b-951d-0c06946420ef admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:38.817027 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 317/636] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:38.817633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 320/637] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/role_assignments?user.id=df25b09762ab4130a1c656cd499d5fb2&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=f9ebfff2487e4c75854f6c174dcebf56 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:38.823252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c5df2-cf69-4b5b-951d-0c06946420ef admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.834574 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c5df2-cf69-4b5b-951d-0c06946420ef admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.839555 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8466350-4904-44a5-bb03-0c3b9363641d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.840329 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8466350-4904-44a5-bb03-0c3b9363641d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.840680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8466350-4904-44a5-bb03-0c3b9363641d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.841024 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8466350-4904-44a5-bb03-0c3b9363641d admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.841879 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8466350-4904-44a5-bb03-0c3b9363641d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:38.842255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8466350-4904-44a5-bb03-0c3b9363641d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.844026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8466350-4904-44a5-bb03-0c3b9363641d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.854362 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 318/638] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:38.860480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009523a-4d7b-4b10-8eeb-9c5a26956741 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.878162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009523a-4d7b-4b10-8eeb-9c5a26956741 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.884468 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5f8cc-15c2-4e57-8ae9-212bc43dbf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.885384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f8cc-15c2-4e57-8ae9-212bc43dbf6d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.885672 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f8cc-15c2-4e57-8ae9-212bc43dbf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.885949 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5f8cc-15c2-4e57-8ae9-212bc43dbf6d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.902008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5f8cc-15c2-4e57-8ae9-212bc43dbf6d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.904058 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5f8cc-15c2-4e57-8ae9-212bc43dbf6d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.923207 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-9af5f8cc-15c2-4e57-8ae9-212bc43dbf6d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:38.925032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 321/639] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:38.930888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8466350-4904-44a5-bb03-0c3b9363641d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.943140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8466350-4904-44a5-bb03-0c3b9363641d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.952742 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbecb51-0932-4171-b4fc-0e4838e4bd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:38.953725 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbecb51-0932-4171-b4fc-0e4838e4bd96 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.954187 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbecb51-0932-4171-b4fc-0e4838e4bd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.954641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbecb51-0932-4171-b4fc-0e4838e4bd96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.956181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbecb51-0932-4171-b4fc-0e4838e4bd96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:38.956692 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbecb51-0932-4171-b4fc-0e4838e4bd96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:38.958656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbecb51-0932-4171-b4fc-0e4838e4bd96 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:38.978023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 319/640] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:38.979732 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5f8cc-15c2-4e57-8ae9-212bc43dbf6d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:38.985312 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45d2d4-dfcd-489e-a438-886c55fec12e None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.985592 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45d2d4-dfcd-489e-a438-886c55fec12e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.985877 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae45d2d4-dfcd-489e-a438-886c55fec12e None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:38.988612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 320/641] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:38.992383 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5f8cc-15c2-4e57-8ae9-212bc43dbf6d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:38.994289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e2de4-7545-40a7-9dbd-b562044326a7 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:38.994573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e2de4-7545-40a7-9dbd-b562044326a7 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:38.994845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e2de4-7545-40a7-9dbd-b562044326a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.000024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8878f-5b56-49eb-9a6c-bab3a21486d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.001281 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8878f-5b56-49eb-9a6c-bab3a21486d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.002677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8878f-5b56-49eb-9a6c-bab3a21486d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.003113 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8878f-5b56-49eb-9a6c-bab3a21486d4 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.015680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-d34e2de4-7545-40a7-9dbd-b562044326a7 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:39.016856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d34e2de4-7545-40a7-9dbd-b562044326a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:39.017915 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8878f-5b56-49eb-9a6c-bab3a21486d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.020639 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8878f-5b56-49eb-9a6c-bab3a21486d4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.025126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 321/642] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:39.036826 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-b8e8878f-5b56-49eb-9a6c-bab3a21486d4 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Feb 12 04:16:39.038311 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 322/643] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:39.043647 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e2de4-7545-40a7-9dbd-b562044326a7 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.055928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e2de4-7545-40a7-9dbd-b562044326a7 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.057855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8878f-5b56-49eb-9a6c-bab3a21486d4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.067418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4bfc0-e0d1-4559-81f9-230cea0f09bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.068512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4bfc0-e0d1-4559-81f9-230cea0f09bc admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.069060 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4bfc0-e0d1-4559-81f9-230cea0f09bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.069588 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4bfc0-e0d1-4559-81f9-230cea0f09bc admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.070670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4bfc0-e0d1-4559-81f9-230cea0f09bc admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:39.071003 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8878f-5b56-49eb-9a6c-bab3a21486d4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.072715 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4bfc0-e0d1-4559-81f9-230cea0f09bc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.076060 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4bfc0-e0d1-4559-81f9-230cea0f09bc admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.080860 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b5829-7ff9-44ae-9ca6-f541f911be54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.082008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5829-7ff9-44ae-9ca6-f541f911be54 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.082516 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5829-7ff9-44ae-9ca6-f541f911be54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.082979 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b5829-7ff9-44ae-9ca6-f541f911be54 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.103534 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 322/644] 10.222.0.35 () {56 vars in 1160 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:39.103740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b5829-7ff9-44ae-9ca6-f541f911be54 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:39.109320 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4bfc0-e0d1-4559-81f9-230cea0f09bc admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.109743 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-9c6b5829-7ff9-44ae-9ca6-f541f911be54 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:39.111777 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 323/645] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:39.117258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b5829-7ff9-44ae-9ca6-f541f911be54 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.127490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4bfc0-e0d1-4559-81f9-230cea0f09bc admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.129253 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b5829-7ff9-44ae-9ca6-f541f911be54 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.133346 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688700d0-2fb4-4a47-8da7-008af24464ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.134081 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688700d0-2fb4-4a47-8da7-008af24464ff admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.134417 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688700d0-2fb4-4a47-8da7-008af24464ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.134748 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688700d0-2fb4-4a47-8da7-008af24464ff admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.135280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dfd2f-78ee-4260-a8c5-bc7549de2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.136222 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dfd2f-78ee-4260-a8c5-bc7549de2dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.136715 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dfd2f-78ee-4260-a8c5-bc7549de2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.137167 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dfd2f-78ee-4260-a8c5-bc7549de2dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.138152 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397dfd2f-78ee-4260-a8c5-bc7549de2dd0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:39.138672 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397dfd2f-78ee-4260-a8c5-bc7549de2dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.142813 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397dfd2f-78ee-4260-a8c5-bc7549de2dd0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.144452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688700d0-2fb4-4a47-8da7-008af24464ff admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.146248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688700d0-2fb4-4a47-8da7-008af24464ff admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.153634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 324/646] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:39.158878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 323/647] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:39.164200 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dfd2f-78ee-4260-a8c5-bc7549de2dd0 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.165711 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688700d0-2fb4-4a47-8da7-008af24464ff admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.175341 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dfd2f-78ee-4260-a8c5-bc7549de2dd0 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.175699 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688700d0-2fb4-4a47-8da7-008af24464ff admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.182798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7f044-dcbe-40dd-aa6d-80f85083f5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.183075 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90348f56-dac0-4549-92c0-924aa68592b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.183607 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7f044-dcbe-40dd-aa6d-80f85083f5e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.183903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7f044-dcbe-40dd-aa6d-80f85083f5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.184160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7f044-dcbe-40dd-aa6d-80f85083f5e1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.184874 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90348f56-dac0-4549-92c0-924aa68592b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.185360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90348f56-dac0-4549-92c0-924aa68592b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.185826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90348f56-dac0-4549-92c0-924aa68592b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.199255 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7f044-dcbe-40dd-aa6d-80f85083f5e1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.199255 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7f044-dcbe-40dd-aa6d-80f85083f5e1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.204162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90348f56-dac0-4549-92c0-924aa68592b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.207146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90348f56-dac0-4549-92c0-924aa68592b6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.216937 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-a9b7f044-dcbe-40dd-aa6d-80f85083f5e1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:39.218473 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 325/648] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:39.224729 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7f044-dcbe-40dd-aa6d-80f85083f5e1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.235513 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7f044-dcbe-40dd-aa6d-80f85083f5e1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.243977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-90348f56-dac0-4549-92c0-924aa68592b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:39.245204 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 324/649] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:39.250853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90348f56-dac0-4549-92c0-924aa68592b6 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.256807 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5efbe-d1e0-4b34-b283-3ff9981737da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.257478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5efbe-d1e0-4b34-b283-3ff9981737da admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.257753 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5efbe-d1e0-4b34-b283-3ff9981737da admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.258035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5efbe-d1e0-4b34-b283-3ff9981737da admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.258771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5efbe-d1e0-4b34-b283-3ff9981737da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:39.259072 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5efbe-d1e0-4b34-b283-3ff9981737da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.260685 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5efbe-d1e0-4b34-b283-3ff9981737da admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.262543 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90348f56-dac0-4549-92c0-924aa68592b6 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.267994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42e6f2-b67e-43a7-bbb3-9cae1780e577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.268893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42e6f2-b67e-43a7-bbb3-9cae1780e577 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.269343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42e6f2-b67e-43a7-bbb3-9cae1780e577 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.269815 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e42e6f2-b67e-43a7-bbb3-9cae1780e577 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.270713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42e6f2-b67e-43a7-bbb3-9cae1780e577 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:39.271213 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42e6f2-b67e-43a7-bbb3-9cae1780e577 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.273280 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e42e6f2-b67e-43a7-bbb3-9cae1780e577 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.286500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 326/650] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:39.292418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5efbe-d1e0-4b34-b283-3ff9981737da admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.293687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 325/651] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:39.306857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5efbe-d1e0-4b34-b283-3ff9981737da admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.310088 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42e6f2-b67e-43a7-bbb3-9cae1780e577 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.316467 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea02ce-3771-47a3-b9ea-3d7006f98982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.317250 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea02ce-3771-47a3-b9ea-3d7006f98982 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.317532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea02ce-3771-47a3-b9ea-3d7006f98982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.317806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea02ce-3771-47a3-b9ea-3d7006f98982 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.328566 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e42e6f2-b67e-43a7-bbb3-9cae1780e577 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.331163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea02ce-3771-47a3-b9ea-3d7006f98982 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.333144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea02ce-3771-47a3-b9ea-3d7006f98982 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.344853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee36259-4339-437d-80c8-7e346493faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.346246 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee36259-4339-437d-80c8-7e346493faf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.346536 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee36259-4339-437d-80c8-7e346493faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.346875 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee36259-4339-437d-80c8-7e346493faf4 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.349207 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-64ea02ce-3771-47a3-b9ea-3d7006f98982 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:39.350747 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 327/652] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:39.355964 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea02ce-3771-47a3-b9ea-3d7006f98982 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.366966 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee36259-4339-437d-80c8-7e346493faf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.370289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee36259-4339-437d-80c8-7e346493faf4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.372797 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea02ce-3771-47a3-b9ea-3d7006f98982 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.385475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d742284-759c-42ac-bd02-742212edb81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.395659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d742284-759c-42ac-bd02-742212edb81f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.395659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d742284-759c-42ac-bd02-742212edb81f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.395659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d742284-759c-42ac-bd02-742212edb81f admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.395659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d742284-759c-42ac-bd02-742212edb81f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:39.395659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d742284-759c-42ac-bd02-742212edb81f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.395659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d742284-759c-42ac-bd02-742212edb81f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.397450 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-9ee36259-4339-437d-80c8-7e346493faf4 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 04:16:39.399662 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 326/653] 10.222.0.35 () {56 vars in 1114 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:39.405218 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee36259-4339-437d-80c8-7e346493faf4 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.412222 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 328/654] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:39.414863 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eab0b3-aad2-4984-9789-4664b4b4191c None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.415456 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eab0b3-aad2-4984-9789-4664b4b4191c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.415873 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eab0b3-aad2-4984-9789-4664b4b4191c None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.417768 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee36259-4339-437d-80c8-7e346493faf4 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.417902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 329/655] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:39.422772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eab0b3-aad2-4984-9789-4664b4b4191c None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.424311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed6e94-5091-466c-984c-cd54b85f5c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.424694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6e94-5091-466c-984c-cd54b85f5c9e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.425093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6e94-5091-466c-984c-cd54b85f5c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.425463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed6e94-5091-466c-984c-cd54b85f5c9e admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.426477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed6e94-5091-466c-984c-cd54b85f5c9e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:39.426880 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed6e94-5091-466c-984c-cd54b85f5c9e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.428982 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed6e94-5091-466c-984c-cd54b85f5c9e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.438682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eab0b3-aad2-4984-9789-4664b4b4191c None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.445071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431b520-43a2-4c3e-9139-6140219883c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.446641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b520-43a2-4c3e-9139-6140219883c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.447140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b520-43a2-4c3e-9139-6140219883c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.447586 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b520-43a2-4c3e-9139-6140219883c5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.448555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431b520-43a2-4c3e-9139-6140219883c5 admin admin] RBAC: Adding query filter params (role.id=f9ebfff2487e4c75854f6c174dcebf56, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=d9c5541a29cf42f6ab394133baa05fae) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:39.448773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 327/656] 10.222.0.35 () {56 vars in 1154 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:39.452994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431b520-43a2-4c3e-9139-6140219883c5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.453104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3b0b6-1ade-4895-94e8-5a2925344d9b None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.453104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3b0b6-1ade-4895-94e8-5a2925344d9b None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.453104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c3b0b6-1ade-4895-94e8-5a2925344d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.453346 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431b520-43a2-4c3e-9139-6140219883c5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.458881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 330/657] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/role_assignments?user.id=d9c5541a29cf42f6ab394133baa05fae&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=f9ebfff2487e4c75854f6c174dcebf56 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:39.460670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431b520-43a2-4c3e-9139-6140219883c5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.472056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-67c3b0b6-1ade-4895-94e8-5a2925344d9b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:39.472959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431b520-43a2-4c3e-9139-6140219883c5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.473626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-67c3b0b6-1ade-4895-94e8-5a2925344d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:39.478367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a11d7-7f4a-4669-bbe1-d9b6ad1ad407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.479313 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a11d7-7f4a-4669-bbe1-d9b6ad1ad407 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.479783 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a11d7-7f4a-4669-bbe1-d9b6ad1ad407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.480235 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a11d7-7f4a-4669-bbe1-d9b6ad1ad407 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.481962 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 328/658] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:39.490123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a11d7-7f4a-4669-bbe1-d9b6ad1ad407 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.492264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a11d7-7f4a-4669-bbe1-d9b6ad1ad407 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.503074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 331/659] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:39.506973 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3b0b6-1ade-4895-94e8-5a2925344d9b None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.513445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a11d7-7f4a-4669-bbe1-d9b6ad1ad407 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.516475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c3b0b6-1ade-4895-94e8-5a2925344d9b None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.525923 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a11d7-7f4a-4669-bbe1-d9b6ad1ad407 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.527696 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe713b-7880-4d25-9845-906318f84911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.528506 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe713b-7880-4d25-9845-906318f84911 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.528784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe713b-7880-4d25-9845-906318f84911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.529114 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe713b-7880-4d25-9845-906318f84911 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.538725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c36d4-2ce4-4d2b-9464-81740b6ce41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.539548 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c36d4-2ce4-4d2b-9464-81740b6ce41d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.541987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c36d4-2ce4-4d2b-9464-81740b6ce41d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.542256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c36d4-2ce4-4d2b-9464-81740b6ce41d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.553090 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe713b-7880-4d25-9845-906318f84911 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:39.564864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-1efe713b-7880-4d25-9845-906318f84911 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:39.572774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c36d4-2ce4-4d2b-9464-81740b6ce41d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.574721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c36d4-2ce4-4d2b-9464-81740b6ce41d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.575205 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 329/660] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:39.579350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe713b-7880-4d25-9845-906318f84911 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.595878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe713b-7880-4d25-9845-906318f84911 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.607170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-f06c36d4-2ce4-4d2b-9464-81740b6ce41d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:39.608598 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 332/661] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:39.609908 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a60e8-eec4-4508-ac8e-5366817f7717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.610581 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a60e8-eec4-4508-ac8e-5366817f7717 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.610861 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a60e8-eec4-4508-ac8e-5366817f7717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.611885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56a60e8-eec4-4508-ac8e-5366817f7717 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.612669 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a60e8-eec4-4508-ac8e-5366817f7717 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:39.612974 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a60e8-eec4-4508-ac8e-5366817f7717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.615064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c36d4-2ce4-4d2b-9464-81740b6ce41d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.616284 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56a60e8-eec4-4508-ac8e-5366817f7717 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.633195 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 330/662] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:39.639908 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c36d4-2ce4-4d2b-9464-81740b6ce41d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.642054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a60e8-eec4-4508-ac8e-5366817f7717 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.652567 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078151f8-9597-4a54-b5b2-a3f71619a053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.653236 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078151f8-9597-4a54-b5b2-a3f71619a053 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.653513 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078151f8-9597-4a54-b5b2-a3f71619a053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.653785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078151f8-9597-4a54-b5b2-a3f71619a053 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.654528 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078151f8-9597-4a54-b5b2-a3f71619a053 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:39.654831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078151f8-9597-4a54-b5b2-a3f71619a053 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.656476 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078151f8-9597-4a54-b5b2-a3f71619a053 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.661387 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56a60e8-eec4-4508-ac8e-5366817f7717 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.673306 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1ed29-b204-4e38-aadf-a98f6e2db00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.674629 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1ed29-b204-4e38-aadf-a98f6e2db00a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.674903 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1ed29-b204-4e38-aadf-a98f6e2db00a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.675172 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1ed29-b204-4e38-aadf-a98f6e2db00a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.679475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 333/663] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:39.685721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078151f8-9597-4a54-b5b2-a3f71619a053 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.689716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1ed29-b204-4e38-aadf-a98f6e2db00a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.691706 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa1ed29-b204-4e38-aadf-a98f6e2db00a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.699725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078151f8-9597-4a54-b5b2-a3f71619a053 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.705774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b5be0-725e-47e9-872f-67fb8a580188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.706798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5be0-725e-47e9-872f-67fb8a580188 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.707313 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5be0-725e-47e9-872f-67fb8a580188 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.707794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b5be0-725e-47e9-872f-67fb8a580188 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.711474 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-dfa1ed29-b204-4e38-aadf-a98f6e2db00a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:39.715257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b5be0-725e-47e9-872f-67fb8a580188 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.717405 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b5be0-725e-47e9-872f-67fb8a580188 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.718258 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 331/664] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:39.719702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1ed29-b204-4e38-aadf-a98f6e2db00a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.732212 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1ed29-b204-4e38-aadf-a98f6e2db00a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.736613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-1d5b5be0-725e-47e9-872f-67fb8a580188 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:39.737982 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39409ea1-32ab-4dbc-9258-ccbe87c14d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.738642 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39409ea1-32ab-4dbc-9258-ccbe87c14d7e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.739006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 334/665] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:39.739105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39409ea1-32ab-4dbc-9258-ccbe87c14d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.743325 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39409ea1-32ab-4dbc-9258-ccbe87c14d7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.743325 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39409ea1-32ab-4dbc-9258-ccbe87c14d7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:39.743325 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39409ea1-32ab-4dbc-9258-ccbe87c14d7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.743325 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39409ea1-32ab-4dbc-9258-ccbe87c14d7e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.745479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b5be0-725e-47e9-872f-67fb8a580188 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.756815 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b5be0-725e-47e9-872f-67fb8a580188 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.760572 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 332/666] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:39.766883 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39409ea1-32ab-4dbc-9258-ccbe87c14d7e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.768439 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b4e50-94ca-4642-8b54-d8a74240bd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.769334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b4e50-94ca-4642-8b54-d8a74240bd99 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.769806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b4e50-94ca-4642-8b54-d8a74240bd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.770273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b4e50-94ca-4642-8b54-d8a74240bd99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.771321 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b4e50-94ca-4642-8b54-d8a74240bd99 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:39.771926 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b4e50-94ca-4642-8b54-d8a74240bd99 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.774820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b4e50-94ca-4642-8b54-d8a74240bd99 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.778186 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39409ea1-32ab-4dbc-9258-ccbe87c14d7e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.783016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20349dc8-0f0e-4125-9697-4f479a647506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.783789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20349dc8-0f0e-4125-9697-4f479a647506 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.784067 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20349dc8-0f0e-4125-9697-4f479a647506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.784389 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20349dc8-0f0e-4125-9697-4f479a647506 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.792187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 335/667] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:39.792657 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20349dc8-0f0e-4125-9697-4f479a647506 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.799697 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20349dc8-0f0e-4125-9697-4f479a647506 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.800256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b4e50-94ca-4642-8b54-d8a74240bd99 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.810065 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b4e50-94ca-4642-8b54-d8a74240bd99 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.815161 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fe97a-e650-4cff-8d67-f471065292b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.815771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe97a-e650-4cff-8d67-f471065292b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.816055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe97a-e650-4cff-8d67-f471065292b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.816332 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe97a-e650-4cff-8d67-f471065292b3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.817173 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fe97a-e650-4cff-8d67-f471065292b3 admin admin] RBAC: Adding query filter params (role.id=f9ebfff2487e4c75854f6c174dcebf56, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=362ab4aeb88746d8b8a14a238c877a53) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:39.817483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fe97a-e650-4cff-8d67-f471065292b3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.819058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-20349dc8-0f0e-4125-9697-4f479a647506 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 12 04:16:39.819342 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fe97a-e650-4cff-8d67-f471065292b3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.820762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 333/668] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:39.826965 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20349dc8-0f0e-4125-9697-4f479a647506 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.830737 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 336/669] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/role_assignments?user.id=362ab4aeb88746d8b8a14a238c877a53&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=f9ebfff2487e4c75854f6c174dcebf56 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:39.849053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20349dc8-0f0e-4125-9697-4f479a647506 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.859695 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c0245-4cf5-457b-afff-ec71d05001f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.860851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c0245-4cf5-457b-afff-ec71d05001f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.861679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c0245-4cf5-457b-afff-ec71d05001f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.862155 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c0245-4cf5-457b-afff-ec71d05001f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.863307 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c0245-4cf5-457b-afff-ec71d05001f7 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:39.863853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c0245-4cf5-457b-afff-ec71d05001f7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.866093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c0245-4cf5-457b-afff-ec71d05001f7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.893744 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 334/670] 10.222.0.35 () {56 vars in 1156 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:39.899718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fe97a-e650-4cff-8d67-f471065292b3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.911160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fe97a-e650-4cff-8d67-f471065292b3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:39.916231 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd78518-0c02-4af8-b4a8-970f4b549573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:39.917340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd78518-0c02-4af8-b4a8-970f4b549573 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:39.917833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd78518-0c02-4af8-b4a8-970f4b549573 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:39.918355 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd78518-0c02-4af8-b4a8-970f4b549573 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:39.944523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd78518-0c02-4af8-b4a8-970f4b549573 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:39.946790 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd78518-0c02-4af8-b4a8-970f4b549573 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:39.971418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-fcd78518-0c02-4af8-b4a8-970f4b549573 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:39.972813 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 337/671] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:39.978633 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c0245-4cf5-457b-afff-ec71d05001f7 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:39.996601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c0245-4cf5-457b-afff-ec71d05001f7 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:40.012079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba7b72-f0a5-4c22-accf-5caa26ff9d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:40.013137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba7b72-f0a5-4c22-accf-5caa26ff9d47 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:40.013619 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba7b72-f0a5-4c22-accf-5caa26ff9d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:40.014087 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba7b72-f0a5-4c22-accf-5caa26ff9d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:40.015058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba7b72-f0a5-4c22-accf-5caa26ff9d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:40.015637 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba7b72-f0a5-4c22-accf-5caa26ff9d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:40.018087 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba7b72-f0a5-4c22-accf-5caa26ff9d47 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:40.037316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 335/672] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:40.043398 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd78518-0c02-4af8-b4a8-970f4b549573 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:40.056696 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd78518-0c02-4af8-b4a8-970f4b549573 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:40.061123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b36c-8461-40b1-8c54-4af9cb463ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:40.061907 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b36c-8461-40b1-8c54-4af9cb463ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:40.062184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b36c-8461-40b1-8c54-4af9cb463ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:40.062451 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3b36c-8461-40b1-8c54-4af9cb463ff5 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:40.074332 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3b36c-8461-40b1-8c54-4af9cb463ff5 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:40.076231 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3b36c-8461-40b1-8c54-4af9cb463ff5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:40.091794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-f2c3b36c-8461-40b1-8c54-4af9cb463ff5 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:40.093270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 338/673] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:40.099410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba7b72-f0a5-4c22-accf-5caa26ff9d47 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:40.116148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba7b72-f0a5-4c22-accf-5caa26ff9d47 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:40.121474 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a1da9-a10b-4d2d-a3ab-18382d38ada6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:40.122536 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a1da9-a10b-4d2d-a3ab-18382d38ada6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:40.123015 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a1da9-a10b-4d2d-a3ab-18382d38ada6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:40.123514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a1da9-a10b-4d2d-a3ab-18382d38ada6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:40.124529 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a1da9-a10b-4d2d-a3ab-18382d38ada6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:40.125120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a1da9-a10b-4d2d-a3ab-18382d38ada6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:40.127826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a1da9-a10b-4d2d-a3ab-18382d38ada6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:40.146260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 336/674] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:40.147936 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b36c-8461-40b1-8c54-4af9cb463ff5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:40.160290 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3b36c-8461-40b1-8c54-4af9cb463ff5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:40.170306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6ffa2-a4f6-4c26-b6cf-ec50da8de9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:40.171470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6ffa2-a4f6-4c26-b6cf-ec50da8de9f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:40.171946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6ffa2-a4f6-4c26-b6cf-ec50da8de9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:40.172440 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6ffa2-a4f6-4c26-b6cf-ec50da8de9f0 admin admin] PATH_INFO: `/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/3b37a10e3b5e404db7aad72e1772a2de/roles/f9ebfff2487e4c75854f6c174dcebf56` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:40.190520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6ffa2-a4f6-4c26-b6cf-ec50da8de9f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e546ab571490aa0b23c0b22a35c4f, user_id=3b37a10e3b5e404db7aad72e1772a2de, role_id=f9ebfff2487e4c75854f6c174dcebf56)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:40.193567 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6ffa2-a4f6-4c26-b6cf-ec50da8de9f0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:40.298009 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 339/675] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:16:40 2022] PUT /identity/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/3b37a10e3b5e404db7aad72e1772a2de/roles/f9ebfff2487e4c75854f6c174dcebf56 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:41.421856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f5a11-dc0f-4b12-a9f2-7ec7c1b1f7c2 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:41.422893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f5a11-dc0f-4b12-a9f2-7ec7c1b1f7c2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:41.423444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f5a11-dc0f-4b12-a9f2-7ec7c1b1f7c2 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:41.425875 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 337/676] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:41.444826 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764995-a7ab-4460-b6fc-d4ac253dd84a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:41.445813 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764995-a7ab-4460-b6fc-d4ac253dd84a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:41.455424 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11764995-a7ab-4460-b6fc-d4ac253dd84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:41.472915 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-11764995-a7ab-4460-b6fc-d4ac253dd84a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:41.474113 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-11764995-a7ab-4460-b6fc-d4ac253dd84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:41.496044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8cd75-11c9-48ea-96fe-708e3e406bab None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:41.496352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8cd75-11c9-48ea-96fe-708e3e406bab None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:41.496589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8cd75-11c9-48ea-96fe-708e3e406bab None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:41.498594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 338/677] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:41.503791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c279734-ac7b-4a63-aeb9-b526105e5575 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:41.504072 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c279734-ac7b-4a63-aeb9-b526105e5575 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:41.504344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c279734-ac7b-4a63-aeb9-b526105e5575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:41.526438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-8c279734-ac7b-4a63-aeb9-b526105e5575 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:41.527648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8c279734-ac7b-4a63-aeb9-b526105e5575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:41.572066 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 340/678] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:41.597872 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11764995-a7ab-4460-b6fc-d4ac253dd84a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:41.606708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11764995-a7ab-4460-b6fc-d4ac253dd84a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:41.619588 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 339/679] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:41.625113 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f317a-a18a-4d8d-8b7d-5bd3216cbc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:41.625892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f317a-a18a-4d8d-8b7d-5bd3216cbc3e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:41.626164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f317a-a18a-4d8d-8b7d-5bd3216cbc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:41.626564 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f317a-a18a-4d8d-8b7d-5bd3216cbc3e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:41.637741 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f317a-a18a-4d8d-8b7d-5bd3216cbc3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:41.639793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597f317a-a18a-4d8d-8b7d-5bd3216cbc3e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:41.656506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-597f317a-a18a-4d8d-8b7d-5bd3216cbc3e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:41.657966 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 341/680] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:41.658753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c279734-ac7b-4a63-aeb9-b526105e5575 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:41.671008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f317a-a18a-4d8d-8b7d-5bd3216cbc3e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:41.672412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c279734-ac7b-4a63-aeb9-b526105e5575 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:41.677738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79598c-db26-4500-817a-68747490e710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:41.678788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79598c-db26-4500-817a-68747490e710 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:41.679319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79598c-db26-4500-817a-68747490e710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:41.679811 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79598c-db26-4500-817a-68747490e710 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:41.680928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79598c-db26-4500-817a-68747490e710 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:41.682125 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-ce79598c-db26-4500-817a-68747490e710 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:41.682125 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:16:41.682125 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:16:41.682591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f317a-a18a-4d8d-8b7d-5bd3216cbc3e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:41.683711 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79598c-db26-4500-817a-68747490e710 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:41.698699 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-ce79598c-db26-4500-817a-68747490e710 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 12 04:16:41.701859 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205149e-43c9-4437-8674-622f3254edac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:41.702514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205149e-43c9-4437-8674-622f3254edac admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:41.702789 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205149e-43c9-4437-8674-622f3254edac admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:41.703056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2205149e-43c9-4437-8674-622f3254edac admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:41.703829 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205149e-43c9-4437-8674-622f3254edac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:41.704124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205149e-43c9-4437-8674-622f3254edac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:41.705757 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2205149e-43c9-4437-8674-622f3254edac admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:41.708101 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 340/681] 10.222.0.35 () {56 vars in 1150 bytes} [Sat Feb 12 04:16:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:41.715562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79598c-db26-4500-817a-68747490e710 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:41.727785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 342/682] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:41.731603 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79598c-db26-4500-817a-68747490e710 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:41.733607 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205149e-43c9-4437-8674-622f3254edac admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:41.747459 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2205149e-43c9-4437-8674-622f3254edac admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:41.749524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec503d4-d63e-4dd0-95c0-03ae3bd900be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:41.750183 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec503d4-d63e-4dd0-95c0-03ae3bd900be admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:41.750456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec503d4-d63e-4dd0-95c0-03ae3bd900be admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:41.750723 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec503d4-d63e-4dd0-95c0-03ae3bd900be admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:41.752193 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec503d4-d63e-4dd0-95c0-03ae3bd900be admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:41.752485 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec503d4-d63e-4dd0-95c0-03ae3bd900be admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:41.753483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-9ec503d4-d63e-4dd0-95c0-03ae3bd900be admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:41.753483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:16:41.753483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:16:41.754347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec503d4-d63e-4dd0-95c0-03ae3bd900be admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:41.759644 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 341/683] 10.222.0.35 () {56 vars in 1145 bytes} [Sat Feb 12 04:16:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:41.761879 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a415c4-deeb-4631-bd98-17493adfc7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:41.762770 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a415c4-deeb-4631-bd98-17493adfc7da admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:41.763297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a415c4-deeb-4631-bd98-17493adfc7da admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:41.764073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a415c4-deeb-4631-bd98-17493adfc7da admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:41.764990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a415c4-deeb-4631-bd98-17493adfc7da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:41.767747 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a415c4-deeb-4631-bd98-17493adfc7da admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:41.768573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec503d4-d63e-4dd0-95c0-03ae3bd900be admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:41.786882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec503d4-d63e-4dd0-95c0-03ae3bd900be admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:41.792187 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9271e-94a1-4469-8b4a-75f2cf5f0b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:41.798956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9271e-94a1-4469-8b4a-75f2cf5f0b1a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:41.798956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9271e-94a1-4469-8b4a-75f2cf5f0b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:41.798956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9271e-94a1-4469-8b4a-75f2cf5f0b1a admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:41.798956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9271e-94a1-4469-8b4a-75f2cf5f0b1a admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:41.798956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9271e-94a1-4469-8b4a-75f2cf5f0b1a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:41.798956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9271e-94a1-4469-8b4a-75f2cf5f0b1a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:41.803741 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 342/684] 10.222.0.35 () {56 vars in 1145 bytes} [Sat Feb 12 04:16:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:41.868975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 343/685] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:16:41 2022] POST /identity/v3/users => generated 254 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:42.491924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2ab83-2978-4201-ac5b-e00a767ceb5c None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:42.492451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2ab83-2978-4201-ac5b-e00a767ceb5c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:42.492559 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f2ab83-2978-4201-ac5b-e00a767ceb5c None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:42.494583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 343/686] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:42.500149 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d3964-be2b-4afd-adb1-348754858ed9 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:42.500553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d3964-be2b-4afd-adb1-348754858ed9 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:42.500721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11d3964-be2b-4afd-adb1-348754858ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:42.528243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-f11d3964-be2b-4afd-adb1-348754858ed9 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:42.529601 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f11d3964-be2b-4afd-adb1-348754858ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:42.538659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 344/687] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Feb 12 04:16:42.561447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2ab83-2978-4201-ac5b-e00a767ceb5c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:42.574617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f2ab83-2978-4201-ac5b-e00a767ceb5c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:42.579070 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f019c30-01e5-4e9f-ab96-8d8560d1564f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:42.579916 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f019c30-01e5-4e9f-ab96-8d8560d1564f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:42.580198 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f019c30-01e5-4e9f-ab96-8d8560d1564f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:42.580475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f019c30-01e5-4e9f-ab96-8d8560d1564f admin admin] PATH_INFO: `/v3/services/network` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:42.581159 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f019c30-01e5-4e9f-ab96-8d8560d1564f admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:42.582743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f019c30-01e5-4e9f-ab96-8d8560d1564f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:42.594941 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-9f019c30-01e5-4e9f-ab96-8d8560d1564f admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 12 04:16:42.596697 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 344/688] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:42 2022] GET /identity/v3/services/network => generated 88 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:42.608597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d3964-be2b-4afd-adb1-348754858ed9 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:42.618580 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11d3964-be2b-4afd-adb1-348754858ed9 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:42.627987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad95573-4887-442a-92f4-c1af35b63aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:42.628662 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad95573-4887-442a-92f4-c1af35b63aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:42.628946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad95573-4887-442a-92f4-c1af35b63aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:42.629224 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad95573-4887-442a-92f4-c1af35b63aa6 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:42.629960 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad95573-4887-442a-92f4-c1af35b63aa6 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:42.630266 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad95573-4887-442a-92f4-c1af35b63aa6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:42.631324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-9ad95573-4887-442a-92f4-c1af35b63aa6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:42.631324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:16:42.631324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:16:42.632220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad95573-4887-442a-92f4-c1af35b63aa6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:42.637613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 345/689] 10.222.0.35 () {56 vars in 1133 bytes} [Sat Feb 12 04:16:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:42.643699 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f019c30-01e5-4e9f-ab96-8d8560d1564f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:42.653854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f019c30-01e5-4e9f-ab96-8d8560d1564f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:42.663852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b90ab-6222-4702-9abc-86c94d370fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:42.664511 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b90ab-6222-4702-9abc-86c94d370fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:42.664789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b90ab-6222-4702-9abc-86c94d370fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:42.665058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b90ab-6222-4702-9abc-86c94d370fb3 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:42.665778 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b90ab-6222-4702-9abc-86c94d370fb3 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:42.666159 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b90ab-6222-4702-9abc-86c94d370fb3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:42.667762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b90ab-6222-4702-9abc-86c94d370fb3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:42.675912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 345/690] 10.222.0.35 () {56 vars in 1133 bytes} [Sat Feb 12 04:16:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:42.826483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88b363-e785-4558-b9d0-2728fe503e0d None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:42.826827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88b363-e785-4558-b9d0-2728fe503e0d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:42.826997 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88b363-e785-4558-b9d0-2728fe503e0d None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:42.829278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 346/691] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:42.837760 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cca0f-bc89-46d4-aaf3-8e71144d3e5e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:42.838219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cca0f-bc89-46d4-aaf3-8e71144d3e5e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:42.838495 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0cca0f-bc89-46d4-aaf3-8e71144d3e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:42.868575 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-bf0cca0f-bc89-46d4-aaf3-8e71144d3e5e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:42.869787 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-bf0cca0f-bc89-46d4-aaf3-8e71144d3e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:42.885203 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 346/692] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:42.922721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88b363-e785-4558-b9d0-2728fe503e0d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:42.939975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88b363-e785-4558-b9d0-2728fe503e0d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:42.946628 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29793b4f-4f9a-4a0d-9b7c-7421967d30bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:42.947442 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29793b4f-4f9a-4a0d-9b7c-7421967d30bc admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:42.947719 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29793b4f-4f9a-4a0d-9b7c-7421967d30bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:42.947987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29793b4f-4f9a-4a0d-9b7c-7421967d30bc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:42.961705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29793b4f-4f9a-4a0d-9b7c-7421967d30bc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:42.968514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-29793b4f-4f9a-4a0d-9b7c-7421967d30bc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:16:42.970233 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 347/693] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:42.975921 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cca0f-bc89-46d4-aaf3-8e71144d3e5e None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:42.984955 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0cca0f-bc89-46d4-aaf3-8e71144d3e5e None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:42.991916 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162220e-7d89-463f-9e02-4a26f45bafd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:42.992577 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162220e-7d89-463f-9e02-4a26f45bafd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:42.992853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162220e-7d89-463f-9e02-4a26f45bafd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:42.993122 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e162220e-7d89-463f-9e02-4a26f45bafd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:42.998124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162220e-7d89-463f-9e02-4a26f45bafd5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:42.998124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162220e-7d89-463f-9e02-4a26f45bafd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:42.998124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e162220e-7d89-463f-9e02-4a26f45bafd5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.010081 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 347/694] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:43.015700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29793b4f-4f9a-4a0d-9b7c-7421967d30bc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.029673 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29793b4f-4f9a-4a0d-9b7c-7421967d30bc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.037899 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a0bbb-e742-4650-a224-9cb8a6395d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.038738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a0bbb-e742-4650-a224-9cb8a6395d28 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.039027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a0bbb-e742-4650-a224-9cb8a6395d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.039320 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7a0bbb-e742-4650-a224-9cb8a6395d28 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.055145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a0bbb-e742-4650-a224-9cb8a6395d28 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.057045 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7a0bbb-e742-4650-a224-9cb8a6395d28 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.077350 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-9d7a0bbb-e742-4650-a224-9cb8a6395d28 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:43.078475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 348/695] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:43.084237 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162220e-7d89-463f-9e02-4a26f45bafd5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.094090 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e162220e-7d89-463f-9e02-4a26f45bafd5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.101205 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf891b-9d2b-4b09-b83e-08fe8d9d10ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.101864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf891b-9d2b-4b09-b83e-08fe8d9d10ac admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.102140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf891b-9d2b-4b09-b83e-08fe8d9d10ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.102411 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf891b-9d2b-4b09-b83e-08fe8d9d10ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.103146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf891b-9d2b-4b09-b83e-08fe8d9d10ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:43.103475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf891b-9d2b-4b09-b83e-08fe8d9d10ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.105046 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcf891b-9d2b-4b09-b83e-08fe8d9d10ac admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.125421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 348/696] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:43.131959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a0bbb-e742-4650-a224-9cb8a6395d28 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.145639 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7a0bbb-e742-4650-a224-9cb8a6395d28 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.152893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd393c-a483-4271-95dc-f93233a289bd None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.153460 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd393c-a483-4271-95dc-f93233a289bd None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.153931 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd393c-a483-4271-95dc-f93233a289bd None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.154384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b3795-1184-4c34-b84a-218d0935680c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.155167 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b3795-1184-4c34-b84a-218d0935680c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.155474 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b3795-1184-4c34-b84a-218d0935680c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.155802 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b3795-1184-4c34-b84a-218d0935680c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.157044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 349/697] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:43.163880 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc1319-384c-4d6c-b5ad-1345dce6b85e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.164454 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc1319-384c-4d6c-b5ad-1345dce6b85e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.164944 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc1319-384c-4d6c-b5ad-1345dce6b85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.169655 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b3795-1184-4c34-b84a-218d0935680c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.173154 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b3795-1184-4c34-b84a-218d0935680c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.192220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-f6bc1319-384c-4d6c-b5ad-1345dce6b85e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:43.193404 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f6bc1319-384c-4d6c-b5ad-1345dce6b85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:43.196185 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-684b3795-1184-4c34-b84a-218d0935680c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 04:16:43.197867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 349/698] 10.222.0.35 () {56 vars in 1114 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:43.203718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b3795-1184-4c34-b84a-218d0935680c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.213347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 350/699] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:43.218689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b3795-1184-4c34-b84a-218d0935680c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.237027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ed1e-6a74-451b-8517-a40fe42b2378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.238102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ed1e-6a74-451b-8517-a40fe42b2378 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.238614 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ed1e-6a74-451b-8517-a40fe42b2378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.239151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f4ed1e-6a74-451b-8517-a40fe42b2378 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.240357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4ed1e-6a74-451b-8517-a40fe42b2378 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:43.240859 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4ed1e-6a74-451b-8517-a40fe42b2378 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.243109 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc1319-384c-4d6c-b5ad-1345dce6b85e None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.251417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f4ed1e-6a74-451b-8517-a40fe42b2378 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.253778 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc1319-384c-4d6c-b5ad-1345dce6b85e None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.266110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6937f9-92e6-4462-b4c2-00010d9d82ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.267859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6937f9-92e6-4462-b4c2-00010d9d82ea admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.268653 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6937f9-92e6-4462-b4c2-00010d9d82ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.269126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6937f9-92e6-4462-b4c2-00010d9d82ea admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.296703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 350/700] 10.222.0.35 () {56 vars in 1154 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:43.297278 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6937f9-92e6-4462-b4c2-00010d9d82ea admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:43.304500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-8e6937f9-92e6-4462-b4c2-00010d9d82ea admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:43.306206 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 351/701] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:43.307647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ed1e-6a74-451b-8517-a40fe42b2378 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.312167 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6937f9-92e6-4462-b4c2-00010d9d82ea admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.317695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f4ed1e-6a74-451b-8517-a40fe42b2378 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.322295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66407e96-7346-4838-a6d6-732d7c38c326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.322930 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66407e96-7346-4838-a6d6-732d7c38c326 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.323211 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66407e96-7346-4838-a6d6-732d7c38c326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.323514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66407e96-7346-4838-a6d6-732d7c38c326 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.324409 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6937f9-92e6-4462-b4c2-00010d9d82ea admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.333145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66407e96-7346-4838-a6d6-732d7c38c326 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.334925 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66407e96-7346-4838-a6d6-732d7c38c326 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.343901 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fc4b9-eacb-47a7-b82a-09aa008a5e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.344444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 351/702] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 04:16:43.344544 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc4b9-eacb-47a7-b82a-09aa008a5e6c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.344830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc4b9-eacb-47a7-b82a-09aa008a5e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.345143 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4fc4b9-eacb-47a7-b82a-09aa008a5e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.346724 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fc4b9-eacb-47a7-b82a-09aa008a5e6c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:43.347024 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fc4b9-eacb-47a7-b82a-09aa008a5e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.348632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4fc4b9-eacb-47a7-b82a-09aa008a5e6c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.350309 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66407e96-7346-4838-a6d6-732d7c38c326 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.359126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66407e96-7346-4838-a6d6-732d7c38c326 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.362086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 352/703] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:43.364299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b02be-b99d-4353-8678-fa443202c525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.365243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b02be-b99d-4353-8678-fa443202c525 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.365595 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b02be-b99d-4353-8678-fa443202c525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.365938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b02be-b99d-4353-8678-fa443202c525 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.368461 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fc4b9-eacb-47a7-b82a-09aa008a5e6c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.377632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b02be-b99d-4353-8678-fa443202c525 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.379489 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b02be-b99d-4353-8678-fa443202c525 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.380892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4fc4b9-eacb-47a7-b82a-09aa008a5e6c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.398243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-7a1b02be-b99d-4353-8678-fa443202c525 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:43.399923 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 352/704] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:43.404483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f373be-3c81-42a7-ae8e-4804f0e42fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.405199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b02be-b99d-4353-8678-fa443202c525 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.405381 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f373be-3c81-42a7-ae8e-4804f0e42fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.405546 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f373be-3c81-42a7-ae8e-4804f0e42fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.405787 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f373be-3c81-42a7-ae8e-4804f0e42fb0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.415878 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b02be-b99d-4353-8678-fa443202c525 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.420462 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657deb4-87da-4020-ad0e-44ba59bb5ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.421141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657deb4-87da-4020-ad0e-44ba59bb5ab0 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.421424 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657deb4-87da-4020-ad0e-44ba59bb5ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.421735 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657deb4-87da-4020-ad0e-44ba59bb5ab0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.422472 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657deb4-87da-4020-ad0e-44ba59bb5ab0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:43.422773 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657deb4-87da-4020-ad0e-44ba59bb5ab0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.424586 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5657deb4-87da-4020-ad0e-44ba59bb5ab0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.428521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f373be-3c81-42a7-ae8e-4804f0e42fb0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.430842 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f373be-3c81-42a7-ae8e-4804f0e42fb0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.437132 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 353/705] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:43.442857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657deb4-87da-4020-ad0e-44ba59bb5ab0 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.452950 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657deb4-87da-4020-ad0e-44ba59bb5ab0 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.458463 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68258c-93ae-426e-9c66-a8c23a1e30c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.459254 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68258c-93ae-426e-9c66-a8c23a1e30c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.459553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68258c-93ae-426e-9c66-a8c23a1e30c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.459826 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68258c-93ae-426e-9c66-a8c23a1e30c7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.469781 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-34f373be-3c81-42a7-ae8e-4804f0e42fb0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:43.469919 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68258c-93ae-426e-9c66-a8c23a1e30c7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.469919 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68258c-93ae-426e-9c66-a8c23a1e30c7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.472615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 353/706] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:43.479271 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f373be-3c81-42a7-ae8e-4804f0e42fb0 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.484623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-dd68258c-93ae-426e-9c66-a8c23a1e30c7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:43.491246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 354/707] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:43.493252 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68258c-93ae-426e-9c66-a8c23a1e30c7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.500499 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f373be-3c81-42a7-ae8e-4804f0e42fb0 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.509934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68258c-93ae-426e-9c66-a8c23a1e30c7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.511885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0985e26-d997-4133-b0b7-66198454ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.512539 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0985e26-d997-4133-b0b7-66198454ec04 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.512821 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0985e26-d997-4133-b0b7-66198454ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.513147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0985e26-d997-4133-b0b7-66198454ec04 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.513891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0985e26-d997-4133-b0b7-66198454ec04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:43.514292 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0985e26-d997-4133-b0b7-66198454ec04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.515914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0985e26-d997-4133-b0b7-66198454ec04 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.522447 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461cc48-1c97-40a2-ac5f-f49964d6250e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.523099 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461cc48-1c97-40a2-ac5f-f49964d6250e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.523400 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461cc48-1c97-40a2-ac5f-f49964d6250e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.525084 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461cc48-1c97-40a2-ac5f-f49964d6250e admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.525988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461cc48-1c97-40a2-ac5f-f49964d6250e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:43.526301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461cc48-1c97-40a2-ac5f-f49964d6250e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.529599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1461cc48-1c97-40a2-ac5f-f49964d6250e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.543798 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 354/708] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:43.550024 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0985e26-d997-4133-b0b7-66198454ec04 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.555316 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 355/709] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:43.561041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461cc48-1c97-40a2-ac5f-f49964d6250e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.568875 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0985e26-d997-4133-b0b7-66198454ec04 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.574721 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75c87c-bcfe-4750-ba73-a04cf7099bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.575806 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75c87c-bcfe-4750-ba73-a04cf7099bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.576331 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75c87c-bcfe-4750-ba73-a04cf7099bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.576824 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75c87c-bcfe-4750-ba73-a04cf7099bc0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.582571 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461cc48-1c97-40a2-ac5f-f49964d6250e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.586418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75c87c-bcfe-4750-ba73-a04cf7099bc0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.588759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75c87c-bcfe-4750-ba73-a04cf7099bc0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.592700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc5546-517e-4dd0-b074-f765321df8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.593340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc5546-517e-4dd0-b074-f765321df8ab admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.593609 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc5546-517e-4dd0-b074-f765321df8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.593875 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc5546-517e-4dd0-b074-f765321df8ab admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.594724 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc5546-517e-4dd0-b074-f765321df8ab admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=362ab4aeb88746d8b8a14a238c877a53) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:43.595030 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc5546-517e-4dd0-b074-f765321df8ab admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.603243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc5546-517e-4dd0-b074-f765321df8ab admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.609854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-0b75c87c-bcfe-4750-ba73-a04cf7099bc0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 12 04:16:43.612244 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 355/710] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:43.617466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75c87c-bcfe-4750-ba73-a04cf7099bc0 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.618527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 356/711] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/role_assignments?user.id=362ab4aeb88746d8b8a14a238c877a53&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 259 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:43.636523 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75c87c-bcfe-4750-ba73-a04cf7099bc0 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.650163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e074b9-990d-4e09-b8e2-5471773206ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.651216 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e074b9-990d-4e09-b8e2-5471773206ea admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.651753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e074b9-990d-4e09-b8e2-5471773206ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.652226 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e074b9-990d-4e09-b8e2-5471773206ea admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.653335 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e074b9-990d-4e09-b8e2-5471773206ea admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:43.653871 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e074b9-990d-4e09-b8e2-5471773206ea admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.656070 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e074b9-990d-4e09-b8e2-5471773206ea admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.682649 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 356/712] 10.222.0.35 () {56 vars in 1156 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:43.688475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc5546-517e-4dd0-b074-f765321df8ab admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.709050 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc5546-517e-4dd0-b074-f765321df8ab admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.719933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abf936-04a8-4fcd-bb78-f5b30cc537ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.720699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abf936-04a8-4fcd-bb78-f5b30cc537ea admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.720991 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abf936-04a8-4fcd-bb78-f5b30cc537ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.721382 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abf936-04a8-4fcd-bb78-f5b30cc537ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.739505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abf936-04a8-4fcd-bb78-f5b30cc537ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.741262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abf936-04a8-4fcd-bb78-f5b30cc537ea admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.758315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 357/713] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:16:43.763625 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e074b9-990d-4e09-b8e2-5471773206ea admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.780885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e074b9-990d-4e09-b8e2-5471773206ea admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.789192 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7d03e-1d46-467a-a31c-3534cfcc5a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.790404 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7d03e-1d46-467a-a31c-3534cfcc5a4c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.790883 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7d03e-1d46-467a-a31c-3534cfcc5a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.791500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7d03e-1d46-467a-a31c-3534cfcc5a4c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.807696 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7d03e-1d46-467a-a31c-3534cfcc5a4c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.809936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca7d03e-1d46-467a-a31c-3534cfcc5a4c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.836940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-fca7d03e-1d46-467a-a31c-3534cfcc5a4c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:43.838109 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 357/714] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:43.843948 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abf936-04a8-4fcd-bb78-f5b30cc537ea admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.856193 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abf936-04a8-4fcd-bb78-f5b30cc537ea admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.864859 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392abad-3f9e-48d2-8548-1d299e0cb93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.865521 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392abad-3f9e-48d2-8548-1d299e0cb93f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.865799 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392abad-3f9e-48d2-8548-1d299e0cb93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.866068 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392abad-3f9e-48d2-8548-1d299e0cb93f admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.866800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392abad-3f9e-48d2-8548-1d299e0cb93f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:43.867099 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392abad-3f9e-48d2-8548-1d299e0cb93f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.868706 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392abad-3f9e-48d2-8548-1d299e0cb93f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.886059 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 358/715] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:43.891515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7d03e-1d46-467a-a31c-3534cfcc5a4c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.904127 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca7d03e-1d46-467a-a31c-3534cfcc5a4c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.914148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bd340-eebe-4b91-8285-ff3b94d9ff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.914926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bd340-eebe-4b91-8285-ff3b94d9ff6d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.915201 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bd340-eebe-4b91-8285-ff3b94d9ff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.915494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bd340-eebe-4b91-8285-ff3b94d9ff6d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.932404 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6bd340-eebe-4b91-8285-ff3b94d9ff6d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.934345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6bd340-eebe-4b91-8285-ff3b94d9ff6d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:43.951044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-3f6bd340-eebe-4b91-8285-ff3b94d9ff6d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:43.952556 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 358/716] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:43.958711 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392abad-3f9e-48d2-8548-1d299e0cb93f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:43.972529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392abad-3f9e-48d2-8548-1d299e0cb93f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:43.983377 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ed83a-ebf5-49cc-99d1-030a2c64c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:43.984028 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ed83a-ebf5-49cc-99d1-030a2c64c7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:43.984308 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ed83a-ebf5-49cc-99d1-030a2c64c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:43.984579 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ed83a-ebf5-49cc-99d1-030a2c64c7d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:43.985377 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ed83a-ebf5-49cc-99d1-030a2c64c7d8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:43.986185 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ed83a-ebf5-49cc-99d1-030a2c64c7d8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:43.988070 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ed83a-ebf5-49cc-99d1-030a2c64c7d8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:44.010624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 359/717] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:44.016378 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bd340-eebe-4b91-8285-ff3b94d9ff6d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:44.032008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bd340-eebe-4b91-8285-ff3b94d9ff6d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:44.042210 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2a709-cc93-43f6-aed4-8ef6d9ebce3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:44.042863 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2a709-cc93-43f6-aed4-8ef6d9ebce3a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:44.043140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2a709-cc93-43f6-aed4-8ef6d9ebce3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:44.043435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2a709-cc93-43f6-aed4-8ef6d9ebce3a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:44.044296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2a709-cc93-43f6-aed4-8ef6d9ebce3a admin admin] RBAC: Adding query filter params (role.id=f9ebfff2487e4c75854f6c174dcebf56, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=3b37a10e3b5e404db7aad72e1772a2de) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:44.044601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2a709-cc93-43f6-aed4-8ef6d9ebce3a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:44.046511 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2a709-cc93-43f6-aed4-8ef6d9ebce3a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:44.056209 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 359/718] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:44 2022] GET /identity/v3/role_assignments?user.id=3b37a10e3b5e404db7aad72e1772a2de&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=f9ebfff2487e4c75854f6c174dcebf56 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:44.463056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1832c5d-9d55-4c82-9785-86afd5e6e397 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:44.463760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1832c5d-9d55-4c82-9785-86afd5e6e397 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:44.464239 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1832c5d-9d55-4c82-9785-86afd5e6e397 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:44.466482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 360/719] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:44.473793 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0a3a7-c18f-4bc1-aafa-ec7855a664ca None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:44.474396 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0a3a7-c18f-4bc1-aafa-ec7855a664ca None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:44.474888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0a3a7-c18f-4bc1-aafa-ec7855a664ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:44.493626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-22c0a3a7-c18f-4bc1-aafa-ec7855a664ca None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:44.495123 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-22c0a3a7-c18f-4bc1-aafa-ec7855a664ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:44.503463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 360/720] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Feb 12 04:16:44.527770 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1832c5d-9d55-4c82-9785-86afd5e6e397 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:44.541646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1832c5d-9d55-4c82-9785-86afd5e6e397 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:44.546304 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1bfbc2-4576-426a-b3db-eafa1609fa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:44.547182 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bfbc2-4576-426a-b3db-eafa1609fa5d admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:44.547707 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bfbc2-4576-426a-b3db-eafa1609fa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:44.548256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1bfbc2-4576-426a-b3db-eafa1609fa5d admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:44.549689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bfbc2-4576-426a-b3db-eafa1609fa5d admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:44.550901 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-7b1bfbc2-4576-426a-b3db-eafa1609fa5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:44.550901 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:16:44.550901 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:16:44.552120 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1bfbc2-4576-426a-b3db-eafa1609fa5d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:44.726816 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 361/721] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Feb 12 04:16:44 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:44.960948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4c5ac-d755-47ef-982b-b2ea0bab068c None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:44.961636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4c5ac-d755-47ef-982b-b2ea0bab068c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:44.962119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4c5ac-d755-47ef-982b-b2ea0bab068c None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:44.964133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 361/722] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:44.969860 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10477142-d956-48a7-b6a9-8b8ae6a86d86 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:44.971054 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10477142-d956-48a7-b6a9-8b8ae6a86d86 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:44.971549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10477142-d956-48a7-b6a9-8b8ae6a86d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:44.992612 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-10477142-d956-48a7-b6a9-8b8ae6a86d86 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:44.994130 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-10477142-d956-48a7-b6a9-8b8ae6a86d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:45.017303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 362/723] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:44 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:45.042194 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4c5ac-d755-47ef-982b-b2ea0bab068c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:45.062763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4c5ac-d755-47ef-982b-b2ea0bab068c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:45.071847 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95945aec-64db-4617-9a20-92c249826272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:45.073032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95945aec-64db-4617-9a20-92c249826272 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.073535 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95945aec-64db-4617-9a20-92c249826272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.074002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95945aec-64db-4617-9a20-92c249826272 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.090225 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95945aec-64db-4617-9a20-92c249826272 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:45.101456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-95945aec-64db-4617-9a20-92c249826272 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:45.103323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 362/724] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:45.108689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10477142-d956-48a7-b6a9-8b8ae6a86d86 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:45.119060 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10477142-d956-48a7-b6a9-8b8ae6a86d86 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:45.124186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64423a3b-d9ac-49ed-a3f4-f5a307e058d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:45.124833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64423a3b-d9ac-49ed-a3f4-f5a307e058d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.125114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64423a3b-d9ac-49ed-a3f4-f5a307e058d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.125386 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64423a3b-d9ac-49ed-a3f4-f5a307e058d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.126152 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64423a3b-d9ac-49ed-a3f4-f5a307e058d3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:45.126989 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64423a3b-d9ac-49ed-a3f4-f5a307e058d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:45.128660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64423a3b-d9ac-49ed-a3f4-f5a307e058d3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:45.143184 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95945aec-64db-4617-9a20-92c249826272 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:45.143500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 363/725] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:45.153860 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95945aec-64db-4617-9a20-92c249826272 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:45.168805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c40a5-c7af-4198-8aaf-d0d39e656407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:45.169888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c40a5-c7af-4198-8aaf-d0d39e656407 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.170368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c40a5-c7af-4198-8aaf-d0d39e656407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.170856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c40a5-c7af-4198-8aaf-d0d39e656407 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.186519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c40a5-c7af-4198-8aaf-d0d39e656407 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:45.188643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c40a5-c7af-4198-8aaf-d0d39e656407 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:45.216886 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-c50c40a5-c7af-4198-8aaf-d0d39e656407 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:45.218371 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 363/726] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:45.223939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64423a3b-d9ac-49ed-a3f4-f5a307e058d3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:45.239831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64423a3b-d9ac-49ed-a3f4-f5a307e058d3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:45.253318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359e05b-db35-4529-9deb-64357c977794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:45.253975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359e05b-db35-4529-9deb-64357c977794 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.254253 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359e05b-db35-4529-9deb-64357c977794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.254575 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359e05b-db35-4529-9deb-64357c977794 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.255336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359e05b-db35-4529-9deb-64357c977794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:45.255635 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359e05b-db35-4529-9deb-64357c977794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:45.257221 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2359e05b-db35-4529-9deb-64357c977794 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:45.280790 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 364/727] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:45.287240 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c40a5-c7af-4198-8aaf-d0d39e656407 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:45.297343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c40a5-c7af-4198-8aaf-d0d39e656407 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:45.307913 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de00fe50-f6b9-45c8-ad2d-c46e03707d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:45.309022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00fe50-f6b9-45c8-ad2d-c46e03707d63 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.309519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00fe50-f6b9-45c8-ad2d-c46e03707d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.310030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de00fe50-f6b9-45c8-ad2d-c46e03707d63 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.320756 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00fe50-f6b9-45c8-ad2d-c46e03707d63 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:45.323107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de00fe50-f6b9-45c8-ad2d-c46e03707d63 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:45.351251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-de00fe50-f6b9-45c8-ad2d-c46e03707d63 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 12 04:16:45.351251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 364/728] 10.222.0.35 () {56 vars in 1138 bytes} [Sat Feb 12 04:16:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:45.353984 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359e05b-db35-4529-9deb-64357c977794 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:45.378081 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359e05b-db35-4529-9deb-64357c977794 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:45.390625 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb8b46-bdaa-4769-8599-925097ac8541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:45.391710 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb8b46-bdaa-4769-8599-925097ac8541 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.395002 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb8b46-bdaa-4769-8599-925097ac8541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.395002 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb8b46-bdaa-4769-8599-925097ac8541 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.395002 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb8b46-bdaa-4769-8599-925097ac8541 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:45.395002 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb8b46-bdaa-4769-8599-925097ac8541 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:45.395307 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713435e6-0eb7-4962-8455-886e55f2012c None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.395307 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713435e6-0eb7-4962-8455-886e55f2012c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.395307 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713435e6-0eb7-4962-8455-886e55f2012c None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.395695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bb8b46-bdaa-4769-8599-925097ac8541 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:45.396561 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 365/729] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:45.402218 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888b643-0f2f-4345-880d-f77725a2e61c None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.402502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888b643-0f2f-4345-880d-f77725a2e61c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.402777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888b643-0f2f-4345-880d-f77725a2e61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.421930 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 365/730] 10.222.0.35 () {56 vars in 1170 bytes} [Sat Feb 12 04:16:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:45.430953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb8b46-bdaa-4769-8599-925097ac8541 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:45.447980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bb8b46-bdaa-4769-8599-925097ac8541 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:45.449852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-8888b643-0f2f-4345-880d-f77725a2e61c None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:45.451635 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8888b643-0f2f-4345-880d-f77725a2e61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:45.457901 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2160830-6dcc-4fd0-9e13-55cc068b8bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:45.458865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2160830-6dcc-4fd0-9e13-55cc068b8bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.459417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2160830-6dcc-4fd0-9e13-55cc068b8bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.459939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2160830-6dcc-4fd0-9e13-55cc068b8bf4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.475310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 366/731] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:45 2022] POST /identity/v3/auth/tokens => generated 1018 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:16:45.479298 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2160830-6dcc-4fd0-9e13-55cc068b8bf4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:45.479298 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2160830-6dcc-4fd0-9e13-55cc068b8bf4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:45.494591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 366/732] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:45 2022] GET /identity/v3/auth/tokens => generated 1018 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:16:45.499637 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888b643-0f2f-4345-880d-f77725a2e61c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:45.510272 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888b643-0f2f-4345-880d-f77725a2e61c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:45.514228 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2160830-6dcc-4fd0-9e13-55cc068b8bf4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:45.526209 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db4337-f212-496c-bd4d-eae70c354747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:45.527059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db4337-f212-496c-bd4d-eae70c354747 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.527367 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db4337-f212-496c-bd4d-eae70c354747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.527642 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db4337-f212-496c-bd4d-eae70c354747 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.533392 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2160830-6dcc-4fd0-9e13-55cc068b8bf4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:45.542849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db4337-f212-496c-bd4d-eae70c354747 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:45.544536 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc15549-ab6c-4c11-9330-bc6260daf9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:45.544770 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2db4337-f212-496c-bd4d-eae70c354747 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:45.545209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc15549-ab6c-4c11-9330-bc6260daf9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.545494 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc15549-ab6c-4c11-9330-bc6260daf9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.545817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc15549-ab6c-4c11-9330-bc6260daf9b4 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.546643 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc15549-ab6c-4c11-9330-bc6260daf9b4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:45.548224 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc15549-ab6c-4c11-9330-bc6260daf9b4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:45.569426 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-e2db4337-f212-496c-bd4d-eae70c354747 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:45.570899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 367/733] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:45.575848 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db4337-f212-496c-bd4d-eae70c354747 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:45.585952 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db4337-f212-496c-bd4d-eae70c354747 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:45.590442 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ed247-119d-4a13-b0ca-23195177cdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:45.591064 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed247-119d-4a13-b0ca-23195177cdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.591368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed247-119d-4a13-b0ca-23195177cdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.591643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06ed247-119d-4a13-b0ca-23195177cdb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.592412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ed247-119d-4a13-b0ca-23195177cdb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:45.592709 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ed247-119d-4a13-b0ca-23195177cdb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:45.594371 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06ed247-119d-4a13-b0ca-23195177cdb4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:45.606969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 368/734] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:45.612861 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ed247-119d-4a13-b0ca-23195177cdb4 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:45.628468 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 367/735] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Feb 12 04:16:45 2022] POST /identity/v3/services => generated 240 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:45.631648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06ed247-119d-4a13-b0ca-23195177cdb4 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:45.656227 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fcb5c-9adb-4857-85e7-ce0fbbd61466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:45.657057 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fcb5c-9adb-4857-85e7-ce0fbbd61466 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.657333 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fcb5c-9adb-4857-85e7-ce0fbbd61466 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.657633 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9fcb5c-9adb-4857-85e7-ce0fbbd61466 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.665431 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fcb5c-9adb-4857-85e7-ce0fbbd61466 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:45.667616 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9fcb5c-9adb-4857-85e7-ce0fbbd61466 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:45.683012 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-ca9fcb5c-9adb-4857-85e7-ce0fbbd61466 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:45.684614 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 369/736] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:45.691401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc15549-ab6c-4c11-9330-bc6260daf9b4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:45.702045 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc15549-ab6c-4c11-9330-bc6260daf9b4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:45.706824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdcb5e4-448b-4679-95f3-d53b3d681b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:45.707537 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcb5e4-448b-4679-95f3-d53b3d681b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.707818 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcb5e4-448b-4679-95f3-d53b3d681b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.708087 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdcb5e4-448b-4679-95f3-d53b3d681b41 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.708898 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdcb5e4-448b-4679-95f3-d53b3d681b41 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:45.709201 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdcb5e4-448b-4679-95f3-d53b3d681b41 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:45.711105 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdcb5e4-448b-4679-95f3-d53b3d681b41 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:45.724585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 368/737] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:45.730711 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fcb5c-9adb-4857-85e7-ce0fbbd61466 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:45.741365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9fcb5c-9adb-4857-85e7-ce0fbbd61466 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:45.745956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c73eb-5838-4f8c-b33f-85327b20d110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:45.746709 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c73eb-5838-4f8c-b33f-85327b20d110 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:45.746991 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c73eb-5838-4f8c-b33f-85327b20d110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:45.747288 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c73eb-5838-4f8c-b33f-85327b20d110 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:45.748152 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c73eb-5838-4f8c-b33f-85327b20d110 admin admin] RBAC: Adding query filter params (role.id=f9ebfff2487e4c75854f6c174dcebf56, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=560fd9efb8a04f449acaf2f3987ce81c) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:45.748513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c73eb-5838-4f8c-b33f-85327b20d110 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:45.750441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083c73eb-5838-4f8c-b33f-85327b20d110 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:45.756970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 370/738] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:45 2022] GET /identity/v3/role_assignments?user.id=560fd9efb8a04f449acaf2f3987ce81c&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=f9ebfff2487e4c75854f6c174dcebf56 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:46.442734 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e9614-2d4d-4d8a-b769-cce7bf0c7d8a None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:46.443105 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e9614-2d4d-4d8a-b769-cce7bf0c7d8a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:46.443330 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e9614-2d4d-4d8a-b769-cce7bf0c7d8a None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:46.445536 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 369/739] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:46.450866 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694148-d685-4f9e-93b1-18c06406deb1 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:46.451159 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694148-d685-4f9e-93b1-18c06406deb1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:46.451466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85694148-d685-4f9e-93b1-18c06406deb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:46.470354 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-85694148-d685-4f9e-93b1-18c06406deb1 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:46.471563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-85694148-d685-4f9e-93b1-18c06406deb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:46.483545 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 371/740] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:46 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:16:46.504276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e9614-2d4d-4d8a-b769-cce7bf0c7d8a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:46.516506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e9614-2d4d-4d8a-b769-cce7bf0c7d8a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:46.521496 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42221237-181b-493c-9fb4-bc96ed5ec97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:46.522261 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42221237-181b-493c-9fb4-bc96ed5ec97e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:46.522538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42221237-181b-493c-9fb4-bc96ed5ec97e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:46.522805 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42221237-181b-493c-9fb4-bc96ed5ec97e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:46.534490 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42221237-181b-493c-9fb4-bc96ed5ec97e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:46.541112 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-42221237-181b-493c-9fb4-bc96ed5ec97e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:16:46.546986 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 370/741] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:46.548466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85694148-d685-4f9e-93b1-18c06406deb1 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:46.561547 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85694148-d685-4f9e-93b1-18c06406deb1 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:46.568889 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb107d8-27fb-4c4e-97ef-637dcce9ede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:46.569571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb107d8-27fb-4c4e-97ef-637dcce9ede6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:46.569855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb107d8-27fb-4c4e-97ef-637dcce9ede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:46.570132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb107d8-27fb-4c4e-97ef-637dcce9ede6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:46.570976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb107d8-27fb-4c4e-97ef-637dcce9ede6 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:46.571319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb107d8-27fb-4c4e-97ef-637dcce9ede6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:46.572954 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb107d8-27fb-4c4e-97ef-637dcce9ede6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:46.588399 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 372/742] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:46.593632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42221237-181b-493c-9fb4-bc96ed5ec97e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:46.608255 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42221237-181b-493c-9fb4-bc96ed5ec97e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:46.615354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf5971-523e-447e-9df0-cfe9380d1615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:46.616131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf5971-523e-447e-9df0-cfe9380d1615 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:46.616412 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf5971-523e-447e-9df0-cfe9380d1615 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:46.616680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf5971-523e-447e-9df0-cfe9380d1615 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:46.638820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf5971-523e-447e-9df0-cfe9380d1615 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:46.640689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf5971-523e-447e-9df0-cfe9380d1615 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:46.662762 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-eabf5971-523e-447e-9df0-cfe9380d1615 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:46.668495 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 371/743] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:46.669852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb107d8-27fb-4c4e-97ef-637dcce9ede6 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:46.689714 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb107d8-27fb-4c4e-97ef-637dcce9ede6 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:46.703845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1990b-2154-4753-ad5f-59f4e3bd7739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:46.704556 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1990b-2154-4753-ad5f-59f4e3bd7739 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:46.704812 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1990b-2154-4753-ad5f-59f4e3bd7739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:46.705096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1990b-2154-4753-ad5f-59f4e3bd7739 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:46.705827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1990b-2154-4753-ad5f-59f4e3bd7739 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:46.706126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1990b-2154-4753-ad5f-59f4e3bd7739 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:46.707724 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1990b-2154-4753-ad5f-59f4e3bd7739 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:46.725445 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 373/744] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:46.730931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf5971-523e-447e-9df0-cfe9380d1615 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:46.744990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf5971-523e-447e-9df0-cfe9380d1615 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:46.759840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbaf13c-7641-43f1-a8f5-ca486d537a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:46.760621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbaf13c-7641-43f1-a8f5-ca486d537a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:46.760902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbaf13c-7641-43f1-a8f5-ca486d537a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:46.761174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbaf13c-7641-43f1-a8f5-ca486d537a97 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:46.772359 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbaf13c-7641-43f1-a8f5-ca486d537a97 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:46.774362 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbaf13c-7641-43f1-a8f5-ca486d537a97 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:46.799921 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-dcbaf13c-7641-43f1-a8f5-ca486d537a97 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 04:16:46.801469 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 372/745] 10.222.0.35 () {56 vars in 1114 bytes} [Sat Feb 12 04:16:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:46.807314 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1990b-2154-4753-ad5f-59f4e3bd7739 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:46.824671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1990b-2154-4753-ad5f-59f4e3bd7739 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:46.840452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bce76-fb38-48a7-b39b-a965113c82c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:46.841127 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bce76-fb38-48a7-b39b-a965113c82c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:46.841401 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bce76-fb38-48a7-b39b-a965113c82c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:46.841669 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bce76-fb38-48a7-b39b-a965113c82c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:46.842553 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bce76-fb38-48a7-b39b-a965113c82c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:46.842826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bce76-fb38-48a7-b39b-a965113c82c5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:46.844693 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bce76-fb38-48a7-b39b-a965113c82c5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:46.874793 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 374/746] 10.222.0.35 () {56 vars in 1154 bytes} [Sat Feb 12 04:16:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:46.880243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbaf13c-7641-43f1-a8f5-ca486d537a97 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:46.896835 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbaf13c-7641-43f1-a8f5-ca486d537a97 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:46.908339 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a6dc-91b7-498b-8fa3-b2db487ab400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:46.909128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a6dc-91b7-498b-8fa3-b2db487ab400 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:46.909406 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a6dc-91b7-498b-8fa3-b2db487ab400 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:46.909684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255a6dc-91b7-498b-8fa3-b2db487ab400 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:46.927262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255a6dc-91b7-498b-8fa3-b2db487ab400 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:46.929149 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255a6dc-91b7-498b-8fa3-b2db487ab400 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:46.957715 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-a255a6dc-91b7-498b-8fa3-b2db487ab400 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:46.959306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 373/747] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:46.964487 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bce76-fb38-48a7-b39b-a965113c82c5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:46.980289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bce76-fb38-48a7-b39b-a965113c82c5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:46.992727 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80afffe-9723-4397-b330-f6faabbd6898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:46.993380 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80afffe-9723-4397-b330-f6faabbd6898 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:46.993659 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80afffe-9723-4397-b330-f6faabbd6898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:46.993929 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80afffe-9723-4397-b330-f6faabbd6898 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:46.994668 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80afffe-9723-4397-b330-f6faabbd6898 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:46.994994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80afffe-9723-4397-b330-f6faabbd6898 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:46.996572 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80afffe-9723-4397-b330-f6faabbd6898 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.012980 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 375/748] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:47.019043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a6dc-91b7-498b-8fa3-b2db487ab400 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.029073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255a6dc-91b7-498b-8fa3-b2db487ab400 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.039530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50577f65-29c5-4ef3-b773-8962076d4f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.040325 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577f65-29c5-4ef3-b773-8962076d4f83 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.040603 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577f65-29c5-4ef3-b773-8962076d4f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.040873 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50577f65-29c5-4ef3-b773-8962076d4f83 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.054476 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50577f65-29c5-4ef3-b773-8962076d4f83 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.056660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50577f65-29c5-4ef3-b773-8962076d4f83 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.074778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-50577f65-29c5-4ef3-b773-8962076d4f83 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:47.081281 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 374/749] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:47.082626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80afffe-9723-4397-b330-f6faabbd6898 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.092316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80afffe-9723-4397-b330-f6faabbd6898 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.097504 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d153b-bcab-491b-8e8a-2afa5b28566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.098150 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d153b-bcab-491b-8e8a-2afa5b28566c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.098428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d153b-bcab-491b-8e8a-2afa5b28566c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.098702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d153b-bcab-491b-8e8a-2afa5b28566c admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.099529 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d153b-bcab-491b-8e8a-2afa5b28566c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:47.099837 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d153b-bcab-491b-8e8a-2afa5b28566c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.101678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d153b-bcab-491b-8e8a-2afa5b28566c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.122270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fe2f8-5a6a-4a0c-80aa-18dde59fd1bc None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.122548 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fe2f8-5a6a-4a0c-80aa-18dde59fd1bc None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.122829 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709fe2f8-5a6a-4a0c-80aa-18dde59fd1bc None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.125033 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 375/750] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:47.130604 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2966-a020-46d9-b681-7fbea0448107 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.130898 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2966-a020-46d9-b681-7fbea0448107 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.131145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a2966-a020-46d9-b681-7fbea0448107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.136593 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 376/751] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:47.146897 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d153b-bcab-491b-8e8a-2afa5b28566c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.159595 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-181a2966-a020-46d9-b681-7fbea0448107 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:47.160890 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-181a2966-a020-46d9-b681-7fbea0448107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:47.163592 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d153b-bcab-491b-8e8a-2afa5b28566c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.170707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b7750-a016-49b7-ac55-e5fb5ace7b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.171654 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b7750-a016-49b7-ac55-e5fb5ace7b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.171982 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b7750-a016-49b7-ac55-e5fb5ace7b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.172252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b7750-a016-49b7-ac55-e5fb5ace7b9d admin admin] PATH_INFO: `/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/362ab4aeb88746d8b8a14a238c877a53/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.177583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b7750-a016-49b7-ac55-e5fb5ace7b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e546ab571490aa0b23c0b22a35c4f, user_id=362ab4aeb88746d8b8a14a238c877a53, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.180641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 376/752] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:47 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:47.182477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b7750-a016-49b7-ac55-e5fb5ace7b9d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.203923 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a2966-a020-46d9-b681-7fbea0448107 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.214885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a2966-a020-46d9-b681-7fbea0448107 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.219480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc35a71-d225-48c7-8092-b2fa3625a9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.220792 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc35a71-d225-48c7-8092-b2fa3625a9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.221111 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc35a71-d225-48c7-8092-b2fa3625a9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.221417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc35a71-d225-48c7-8092-b2fa3625a9e5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.232824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc35a71-d225-48c7-8092-b2fa3625a9e5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:47.240696 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-bbc35a71-d225-48c7-8092-b2fa3625a9e5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:16:47.242364 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 377/753] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:47.248277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc35a71-d225-48c7-8092-b2fa3625a9e5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.258973 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc35a71-d225-48c7-8092-b2fa3625a9e5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.271702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 377/754] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:16:47 2022] PUT /identity/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/362ab4aeb88746d8b8a14a238c877a53/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:16:47.352622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c2084-a7f4-46c2-8b7c-200fb57a6702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.353225 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c2084-a7f4-46c2-8b7c-200fb57a6702 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.353509 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c2084-a7f4-46c2-8b7c-200fb57a6702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.353783 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094c2084-a7f4-46c2-8b7c-200fb57a6702 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.354618 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c2084-a7f4-46c2-8b7c-200fb57a6702 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:47.354929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c2084-a7f4-46c2-8b7c-200fb57a6702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.356742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094c2084-a7f4-46c2-8b7c-200fb57a6702 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.370090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 378/755] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:47.375892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b7750-a016-49b7-ac55-e5fb5ace7b9d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.388572 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b7750-a016-49b7-ac55-e5fb5ace7b9d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.396129 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfb942-eb04-43cb-9b30-9e686b77400a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.397348 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb942-eb04-43cb-9b30-9e686b77400a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.397845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb942-eb04-43cb-9b30-9e686b77400a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.398377 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbfb942-eb04-43cb-9b30-9e686b77400a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.416505 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfb942-eb04-43cb-9b30-9e686b77400a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.418445 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbfb942-eb04-43cb-9b30-9e686b77400a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.443718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-bfbfb942-eb04-43cb-9b30-9e686b77400a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:47.445295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 378/756] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:47.451014 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c2084-a7f4-46c2-8b7c-200fb57a6702 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.462026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094c2084-a7f4-46c2-8b7c-200fb57a6702 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.466703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8631c8-e2fe-4151-9790-d617a4769c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.467410 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8631c8-e2fe-4151-9790-d617a4769c8b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.467697 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8631c8-e2fe-4151-9790-d617a4769c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.467973 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8631c8-e2fe-4151-9790-d617a4769c8b admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.468716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8631c8-e2fe-4151-9790-d617a4769c8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:47.469019 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8631c8-e2fe-4151-9790-d617a4769c8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.471256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8631c8-e2fe-4151-9790-d617a4769c8b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.483209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 379/757] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:47.488686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfb942-eb04-43cb-9b30-9e686b77400a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.499449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbfb942-eb04-43cb-9b30-9e686b77400a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.504655 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d142001a-c48b-40e1-99d6-0d13bc151257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.505446 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142001a-c48b-40e1-99d6-0d13bc151257 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.505784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142001a-c48b-40e1-99d6-0d13bc151257 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.506064 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d142001a-c48b-40e1-99d6-0d13bc151257 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.514173 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142001a-c48b-40e1-99d6-0d13bc151257 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.516289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d142001a-c48b-40e1-99d6-0d13bc151257 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.533769 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-d142001a-c48b-40e1-99d6-0d13bc151257 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 12 04:16:47.535340 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 379/758] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:47.540935 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8631c8-e2fe-4151-9790-d617a4769c8b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.551759 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8631c8-e2fe-4151-9790-d617a4769c8b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.556772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d33a6-63c8-4302-b4cb-a0f2a9c16698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.557431 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d33a6-63c8-4302-b4cb-a0f2a9c16698 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.557764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d33a6-63c8-4302-b4cb-a0f2a9c16698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.558046 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d33a6-63c8-4302-b4cb-a0f2a9c16698 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.558907 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d33a6-63c8-4302-b4cb-a0f2a9c16698 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:47.559214 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d33a6-63c8-4302-b4cb-a0f2a9c16698 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.561175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5d33a6-63c8-4302-b4cb-a0f2a9c16698 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.570466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19c21-98ce-455e-877b-f357dae72398 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.570949 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19c21-98ce-455e-877b-f357dae72398 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.571049 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d19c21-98ce-455e-877b-f357dae72398 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.573058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 380/759] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:47.584224 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf21945-74e8-44f5-9ab4-145349131ae5 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.584524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf21945-74e8-44f5-9ab4-145349131ae5 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.584782 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf21945-74e8-44f5-9ab4-145349131ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.586358 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 380/760] 10.222.0.35 () {56 vars in 1156 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:47.592305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d33a6-63c8-4302-b4cb-a0f2a9c16698 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.608559 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d33a6-63c8-4302-b4cb-a0f2a9c16698 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.615247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-0bf21945-74e8-44f5-9ab4-145349131ae5 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:47.615247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0bf21945-74e8-44f5-9ab4-145349131ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:47.620991 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 381/761] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:47 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:47.621800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f141e0-4dec-4449-ab84-79669096f5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.622752 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f141e0-4dec-4449-ab84-79669096f5bf admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.623245 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f141e0-4dec-4449-ab84-79669096f5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.623711 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f141e0-4dec-4449-ab84-79669096f5bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.638942 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f141e0-4dec-4449-ab84-79669096f5bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.640998 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f141e0-4dec-4449-ab84-79669096f5bf admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.649690 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf21945-74e8-44f5-9ab4-145349131ae5 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.655258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 381/762] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:16:47.662281 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f141e0-4dec-4449-ab84-79669096f5bf admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.663561 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf21945-74e8-44f5-9ab4-145349131ae5 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.668490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bdfd5-f9d7-408f-b3e0-32f5a73d49f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.669342 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bdfd5-f9d7-408f-b3e0-32f5a73d49f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.669675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bdfd5-f9d7-408f-b3e0-32f5a73d49f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.669951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6bdfd5-f9d7-408f-b3e0-32f5a73d49f8 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.671215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bdfd5-f9d7-408f-b3e0-32f5a73d49f8 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.673607 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6bdfd5-f9d7-408f-b3e0-32f5a73d49f8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.676231 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f141e0-4dec-4449-ab84-79669096f5bf admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.686283 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-1f6bdfd5-f9d7-408f-b3e0-32f5a73d49f8 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 12 04:16:47.687838 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 382/763] 10.222.0.35 () {56 vars in 1150 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:47.688307 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d81d7-c61d-4360-b87e-7968a3bae3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.690137 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d81d7-c61d-4360-b87e-7968a3bae3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.690613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d81d7-c61d-4360-b87e-7968a3bae3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.691073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d81d7-c61d-4360-b87e-7968a3bae3d1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.694086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bdfd5-f9d7-408f-b3e0-32f5a73d49f8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.705519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6bdfd5-f9d7-408f-b3e0-32f5a73d49f8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.710745 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb5e85-5fdd-4f2a-af80-084382b17381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.711460 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb5e85-5fdd-4f2a-af80-084382b17381 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.711743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb5e85-5fdd-4f2a-af80-084382b17381 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.712070 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb5e85-5fdd-4f2a-af80-084382b17381 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.713145 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb5e85-5fdd-4f2a-af80-084382b17381 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:47.713457 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb5e85-5fdd-4f2a-af80-084382b17381 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.714077 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d81d7-c61d-4360-b87e-7968a3bae3d1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.715211 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb5e85-5fdd-4f2a-af80-084382b17381 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.716366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d81d7-c61d-4360-b87e-7968a3bae3d1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.731606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 383/764] 10.222.0.35 () {56 vars in 1145 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:47.732545 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb5e85-5fdd-4f2a-af80-084382b17381 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.754371 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb5e85-5fdd-4f2a-af80-084382b17381 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.755883 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-e66d81d7-c61d-4360-b87e-7968a3bae3d1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:47.757130 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 382/765] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:47.763372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d81d7-c61d-4360-b87e-7968a3bae3d1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.770488 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e84fe-6df3-447b-9360-6bcf021da975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.771161 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e84fe-6df3-447b-9360-6bcf021da975 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.771516 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e84fe-6df3-447b-9360-6bcf021da975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.771848 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e84fe-6df3-447b-9360-6bcf021da975 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.772582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e84fe-6df3-447b-9360-6bcf021da975 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:47.772942 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e84fe-6df3-447b-9360-6bcf021da975 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.775999 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e84fe-6df3-447b-9360-6bcf021da975 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.786276 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 384/766] 10.222.0.35 () {56 vars in 1145 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:47.787466 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d81d7-c61d-4360-b87e-7968a3bae3d1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.793916 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e84fe-6df3-447b-9360-6bcf021da975 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.803525 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d386ba6-4ec4-4fcc-a3f6-527ed1ef4cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.804250 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d386ba6-4ec4-4fcc-a3f6-527ed1ef4cac admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.804531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d386ba6-4ec4-4fcc-a3f6-527ed1ef4cac admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.806115 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d386ba6-4ec4-4fcc-a3f6-527ed1ef4cac admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.806983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d386ba6-4ec4-4fcc-a3f6-527ed1ef4cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:47.807646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d386ba6-4ec4-4fcc-a3f6-527ed1ef4cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.811071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d386ba6-4ec4-4fcc-a3f6-527ed1ef4cac admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.811832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e84fe-6df3-447b-9360-6bcf021da975 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.823263 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a782c8-2852-44fa-ac83-140781602e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.823974 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a782c8-2852-44fa-ac83-140781602e4e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.824256 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a782c8-2852-44fa-ac83-140781602e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.824532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a782c8-2852-44fa-ac83-140781602e4e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.826112 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a782c8-2852-44fa-ac83-140781602e4e admin admin] RBAC: Adding query filter params (interface=public, service_id=7787ccb940b34d468b974713aa4b536e, region_id=RegionOne) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:47.827605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a782c8-2852-44fa-ac83-140781602e4e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.828676 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-39a782c8-2852-44fa-ac83-140781602e4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:47.828676 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:16:47.828676 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:16:47.834124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a782c8-2852-44fa-ac83-140781602e4e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.835823 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 383/767] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:47.839384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d386ba6-4ec4-4fcc-a3f6-527ed1ef4cac admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.849591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 385/768] 10.222.0.35 () {56 vars in 1272 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/endpoints?service_id=7787ccb940b34d468b974713aa4b536e&interface=public®ion_id=RegionOne => generated 194 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:47.858195 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d386ba6-4ec4-4fcc-a3f6-527ed1ef4cac admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.860140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a782c8-2852-44fa-ac83-140781602e4e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.873236 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a782c8-2852-44fa-ac83-140781602e4e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.874207 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283e398-252c-449b-9de0-106db9cf3662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.875042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283e398-252c-449b-9de0-106db9cf3662 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.875347 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283e398-252c-449b-9de0-106db9cf3662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.875623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a283e398-252c-449b-9de0-106db9cf3662 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.884506 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100e937-5862-48bf-bfe8-cf28555d9c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.886347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e937-5862-48bf-bfe8-cf28555d9c40 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.886680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e937-5862-48bf-bfe8-cf28555d9c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.886960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9100e937-5862-48bf-bfe8-cf28555d9c40 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.888949 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100e937-5862-48bf-bfe8-cf28555d9c40 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.891516 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283e398-252c-449b-9de0-106db9cf3662 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.894002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9100e937-5862-48bf-bfe8-cf28555d9c40 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.895390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a283e398-252c-449b-9de0-106db9cf3662 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.900435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 386/769] 10.222.0.35 () {56 vars in 1108 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/services => generated 772 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:47.918481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-a283e398-252c-449b-9de0-106db9cf3662 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:47.924622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 384/770] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:47.930593 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100e937-5862-48bf-bfe8-cf28555d9c40 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.943080 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9100e937-5862-48bf-bfe8-cf28555d9c40 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.948342 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88617a9f-1332-47dd-9201-2001cd0aea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.949007 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88617a9f-1332-47dd-9201-2001cd0aea2e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.949287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88617a9f-1332-47dd-9201-2001cd0aea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.949564 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88617a9f-1332-47dd-9201-2001cd0aea2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.950371 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88617a9f-1332-47dd-9201-2001cd0aea2e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:47.950679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88617a9f-1332-47dd-9201-2001cd0aea2e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.952625 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88617a9f-1332-47dd-9201-2001cd0aea2e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:47.969022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 387/771] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:47.975666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283e398-252c-449b-9de0-106db9cf3662 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:47.986368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a283e398-252c-449b-9de0-106db9cf3662 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:47.991288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35de56cf-eb41-4ce2-be5d-2e1ea4ae365e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:47.991948 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de56cf-eb41-4ce2-be5d-2e1ea4ae365e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:47.992232 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de56cf-eb41-4ce2-be5d-2e1ea4ae365e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:47.992512 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de56cf-eb41-4ce2-be5d-2e1ea4ae365e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:47.993368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de56cf-eb41-4ce2-be5d-2e1ea4ae365e admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=3b37a10e3b5e404db7aad72e1772a2de) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:47.993678 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de56cf-eb41-4ce2-be5d-2e1ea4ae365e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:47.995622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35de56cf-eb41-4ce2-be5d-2e1ea4ae365e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:48.002772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 385/772] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:47 2022] GET /identity/v3/role_assignments?user.id=3b37a10e3b5e404db7aad72e1772a2de&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:48.475425 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8c825-a9bd-4d99-8c59-eaff941d9176 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:48.476113 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8c825-a9bd-4d99-8c59-eaff941d9176 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:48.476601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8c825-a9bd-4d99-8c59-eaff941d9176 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:48.478620 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 388/773] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:48.485010 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7f25a-5afd-4d81-949b-ee18b1c8d5fc None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:48.486274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7f25a-5afd-4d81-949b-ee18b1c8d5fc None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:48.487039 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7f25a-5afd-4d81-949b-ee18b1c8d5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:48.507688 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-87c7f25a-5afd-4d81-949b-ee18b1c8d5fc None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:48.509445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-87c7f25a-5afd-4d81-949b-ee18b1c8d5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:48.518482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 386/774] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:48 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:16:48.542205 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8c825-a9bd-4d99-8c59-eaff941d9176 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:48.559585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8c825-a9bd-4d99-8c59-eaff941d9176 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:48.564601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b06f97-5431-44bb-9566-aa5e3a347cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:48.565631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b06f97-5431-44bb-9566-aa5e3a347cbf admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:48.566140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b06f97-5431-44bb-9566-aa5e3a347cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:48.566626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b06f97-5431-44bb-9566-aa5e3a347cbf admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:48.577776 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b06f97-5431-44bb-9566-aa5e3a347cbf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:48.586603 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-d2b06f97-5431-44bb-9566-aa5e3a347cbf admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:48.588356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 389/775] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:48.594218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7f25a-5afd-4d81-949b-ee18b1c8d5fc None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:48.604708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7f25a-5afd-4d81-949b-ee18b1c8d5fc None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:48.609621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be6be-6fff-46cc-8d51-032a9128292b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:48.611024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be6be-6fff-46cc-8d51-032a9128292b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:48.611809 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be6be-6fff-46cc-8d51-032a9128292b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:48.612409 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6be6be-6fff-46cc-8d51-032a9128292b admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:48.613377 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6be6be-6fff-46cc-8d51-032a9128292b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:48.613897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6be6be-6fff-46cc-8d51-032a9128292b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:48.615740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6be6be-6fff-46cc-8d51-032a9128292b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:48.624730 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 387/776] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:48.630729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b06f97-5431-44bb-9566-aa5e3a347cbf admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:48.641623 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b06f97-5431-44bb-9566-aa5e3a347cbf admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:48.647398 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24c472-ae50-4fa9-b78f-2f4a61e74a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:48.648414 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24c472-ae50-4fa9-b78f-2f4a61e74a1e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:48.648946 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24c472-ae50-4fa9-b78f-2f4a61e74a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:48.649437 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a24c472-ae50-4fa9-b78f-2f4a61e74a1e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:48.665179 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24c472-ae50-4fa9-b78f-2f4a61e74a1e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:48.667290 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a24c472-ae50-4fa9-b78f-2f4a61e74a1e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:48.689269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-4a24c472-ae50-4fa9-b78f-2f4a61e74a1e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:48.691110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 390/777] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:48.696896 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be6be-6fff-46cc-8d51-032a9128292b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:48.710784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6be6be-6fff-46cc-8d51-032a9128292b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:48.715565 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d09e0-2dd1-4667-b926-09d0ab94a6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:48.716450 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d09e0-2dd1-4667-b926-09d0ab94a6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:48.716931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d09e0-2dd1-4667-b926-09d0ab94a6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:48.717422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d09e0-2dd1-4667-b926-09d0ab94a6d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:48.718348 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d09e0-2dd1-4667-b926-09d0ab94a6d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:48.718850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d09e0-2dd1-4667-b926-09d0ab94a6d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:48.721063 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d09e0-2dd1-4667-b926-09d0ab94a6d5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:48.738179 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 388/778] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:48.744471 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24c472-ae50-4fa9-b78f-2f4a61e74a1e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:48.760238 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a24c472-ae50-4fa9-b78f-2f4a61e74a1e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:48.765068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45448f27-ad18-48cc-ab4c-a729ade62e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:48.766089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448f27-ad18-48cc-ab4c-a729ade62e11 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:48.766592 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448f27-ad18-48cc-ab4c-a729ade62e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:48.767741 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45448f27-ad18-48cc-ab4c-a729ade62e11 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:48.780540 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45448f27-ad18-48cc-ab4c-a729ade62e11 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:48.783551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45448f27-ad18-48cc-ab4c-a729ade62e11 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:48.806003 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-45448f27-ad18-48cc-ab4c-a729ade62e11 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 12 04:16:48.807573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 391/779] 10.222.0.35 () {56 vars in 1138 bytes} [Sat Feb 12 04:16:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:48.813164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d09e0-2dd1-4667-b926-09d0ab94a6d5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:48.828111 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d09e0-2dd1-4667-b926-09d0ab94a6d5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:48.833761 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5ca12-85aa-46d5-bb5a-7b13345468fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:48.834665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ca12-85aa-46d5-bb5a-7b13345468fa admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:48.835172 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ca12-85aa-46d5-bb5a-7b13345468fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:48.835679 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5ca12-85aa-46d5-bb5a-7b13345468fa admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:48.836736 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5ca12-85aa-46d5-bb5a-7b13345468fa admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:48.837248 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5ca12-85aa-46d5-bb5a-7b13345468fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:48.839355 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5ca12-85aa-46d5-bb5a-7b13345468fa admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:48.869400 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 389/780] 10.222.0.35 () {56 vars in 1170 bytes} [Sat Feb 12 04:16:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:48.874877 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45448f27-ad18-48cc-ab4c-a729ade62e11 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:48.886031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45448f27-ad18-48cc-ab4c-a729ade62e11 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:48.891160 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5637a23-c4e3-4517-8d06-736f437b0118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:48.893155 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637a23-c4e3-4517-8d06-736f437b0118 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:48.893726 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637a23-c4e3-4517-8d06-736f437b0118 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:48.894209 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637a23-c4e3-4517-8d06-736f437b0118 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:48.897016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31c35c-561b-4854-ae5c-204c828fe246 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:48.897520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31c35c-561b-4854-ae5c-204c828fe246 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:48.898013 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31c35c-561b-4854-ae5c-204c828fe246 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:48.900271 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 390/781] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:48.905569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41009222-b241-4894-9a5c-af88bd00e320 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:48.906077 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41009222-b241-4894-9a5c-af88bd00e320 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:48.906557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41009222-b241-4894-9a5c-af88bd00e320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:48.925689 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5637a23-c4e3-4517-8d06-736f437b0118 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:48.927892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5637a23-c4e3-4517-8d06-736f437b0118 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:48.939063 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-41009222-b241-4894-9a5c-af88bd00e320 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:48.940643 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-41009222-b241-4894-9a5c-af88bd00e320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:48.954568 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-c5637a23-c4e3-4517-8d06-736f437b0118 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:48.956569 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 392/782] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:48.963303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 391/783] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:48 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:48.965354 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5637a23-c4e3-4517-8d06-736f437b0118 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:48.980515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5637a23-c4e3-4517-8d06-736f437b0118 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:48.984882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41009222-b241-4894-9a5c-af88bd00e320 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:48.989324 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb771-6034-4841-963c-8db387a7ba48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:48.990286 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb771-6034-4841-963c-8db387a7ba48 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:48.990795 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb771-6034-4841-963c-8db387a7ba48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:48.991297 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcb771-6034-4841-963c-8db387a7ba48 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:48.992291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcb771-6034-4841-963c-8db387a7ba48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:48.992801 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcb771-6034-4841-963c-8db387a7ba48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:48.994637 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcb771-6034-4841-963c-8db387a7ba48 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:49.005676 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41009222-b241-4894-9a5c-af88bd00e320 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:49.008073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 393/784] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:49.016217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb771-6034-4841-963c-8db387a7ba48 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:49.016553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bc6c2-9ece-420d-888d-6a7483cc56e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:49.017473 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bc6c2-9ece-420d-888d-6a7483cc56e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:49.017799 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bc6c2-9ece-420d-888d-6a7483cc56e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:49.018073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7bc6c2-9ece-420d-888d-6a7483cc56e9 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:49.018792 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bc6c2-9ece-420d-888d-6a7483cc56e9 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:49.019931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-9d7bc6c2-9ece-420d-888d-6a7483cc56e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:49.019931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:16:49.019931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:16:49.020803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7bc6c2-9ece-420d-888d-6a7483cc56e9 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:49.028637 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcb771-6034-4841-963c-8db387a7ba48 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:49.039069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-9d7bc6c2-9ece-420d-888d-6a7483cc56e9 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 12 04:16:49.040330 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 392/785] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:48 2022] GET /identity/v3/services/network => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:49.048932 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7330bd-b2f9-445d-bd02-84971372f930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:49.049096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bc6c2-9ece-420d-888d-6a7483cc56e9 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:49.050056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7330bd-b2f9-445d-bd02-84971372f930 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:49.050515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7330bd-b2f9-445d-bd02-84971372f930 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:49.051058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7330bd-b2f9-445d-bd02-84971372f930 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:49.059082 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7330bd-b2f9-445d-bd02-84971372f930 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:49.061272 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7330bd-b2f9-445d-bd02-84971372f930 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:49.069988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7bc6c2-9ece-420d-888d-6a7483cc56e9 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:49.075632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-ff7330bd-b2f9-445d-bd02-84971372f930 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:49.077303 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 394/786] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:49.079062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be452e5-c189-47b9-88db-abcc7cb8b8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:49.082558 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be452e5-c189-47b9-88db-abcc7cb8b8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:49.082845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be452e5-c189-47b9-88db-abcc7cb8b8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:49.083117 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be452e5-c189-47b9-88db-abcc7cb8b8a7 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:49.083875 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be452e5-c189-47b9-88db-abcc7cb8b8a7 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:49.084186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be452e5-c189-47b9-88db-abcc7cb8b8a7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:49.085772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be452e5-c189-47b9-88db-abcc7cb8b8a7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:49.088429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7330bd-b2f9-445d-bd02-84971372f930 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:49.099463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7330bd-b2f9-445d-bd02-84971372f930 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:49.110593 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 393/787] 10.222.0.35 () {56 vars in 1133 bytes} [Sat Feb 12 04:16:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:49.117058 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be452e5-c189-47b9-88db-abcc7cb8b8a7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:49.117961 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c473a-8d8d-4d1e-ac5b-af77aaf2bfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:49.119395 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c473a-8d8d-4d1e-ac5b-af77aaf2bfea admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:49.120648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c473a-8d8d-4d1e-ac5b-af77aaf2bfea admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:49.121469 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69c473a-8d8d-4d1e-ac5b-af77aaf2bfea admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:49.122701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c473a-8d8d-4d1e-ac5b-af77aaf2bfea admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:49.125737 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c473a-8d8d-4d1e-ac5b-af77aaf2bfea admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:49.129406 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69c473a-8d8d-4d1e-ac5b-af77aaf2bfea admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:49.137778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be452e5-c189-47b9-88db-abcc7cb8b8a7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:49.151874 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add65354-47d2-4ea8-9126-133c21465493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:49.152849 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add65354-47d2-4ea8-9126-133c21465493 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:49.153348 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add65354-47d2-4ea8-9126-133c21465493 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:49.153795 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add65354-47d2-4ea8-9126-133c21465493 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:49.155426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add65354-47d2-4ea8-9126-133c21465493 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:49.156463 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add65354-47d2-4ea8-9126-133c21465493 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:49.158284 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 395/788] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:49.159900 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add65354-47d2-4ea8-9126-133c21465493 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:49.163404 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c473a-8d8d-4d1e-ac5b-af77aaf2bfea admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:49.176251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69c473a-8d8d-4d1e-ac5b-af77aaf2bfea admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:49.178958 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 394/789] 10.222.0.35 () {56 vars in 1133 bytes} [Sat Feb 12 04:16:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:49.187587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8863c3-908b-4ae5-a768-8942c3ae5935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:49.189306 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8863c3-908b-4ae5-a768-8942c3ae5935 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:49.189819 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8863c3-908b-4ae5-a768-8942c3ae5935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:49.190304 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8863c3-908b-4ae5-a768-8942c3ae5935 admin admin] PATH_INFO: `/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/560fd9efb8a04f449acaf2f3987ce81c/roles/f9ebfff2487e4c75854f6c174dcebf56` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:49.192655 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add65354-47d2-4ea8-9126-133c21465493 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:49.207304 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add65354-47d2-4ea8-9126-133c21465493 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:49.217909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be97f2-c57a-4ae6-a927-f81349595a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:49.218796 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be97f2-c57a-4ae6-a927-f81349595a5f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:49.219305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be97f2-c57a-4ae6-a927-f81349595a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:49.220546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be97f2-c57a-4ae6-a927-f81349595a5f admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:49.221860 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be97f2-c57a-4ae6-a927-f81349595a5f admin admin] RBAC: Adding query filter params (interface=public, service_id=99973882edcd4ede8853693526d31cb2, region_id=RegionOne) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:49.222997 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be97f2-c57a-4ae6-a927-f81349595a5f admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:49.225993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-f0be97f2-c57a-4ae6-a927-f81349595a5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:49.225993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:16:49.225993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:16:49.228098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be97f2-c57a-4ae6-a927-f81349595a5f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:49.239111 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 395/790] 10.222.0.35 () {56 vars in 1272 bytes} [Sat Feb 12 04:16:49 2022] GET /identity/v3/endpoints?service_id=99973882edcd4ede8853693526d31cb2&interface=public®ion_id=RegionOne => generated 194 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:49.244482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8863c3-908b-4ae5-a768-8942c3ae5935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e546ab571490aa0b23c0b22a35c4f, user_id=560fd9efb8a04f449acaf2f3987ce81c, role_id=f9ebfff2487e4c75854f6c174dcebf56)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:49.247452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8863c3-908b-4ae5-a768-8942c3ae5935 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:49.252909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be97f2-c57a-4ae6-a927-f81349595a5f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:49.263429 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be97f2-c57a-4ae6-a927-f81349595a5f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:49.269114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc5ed4-4b44-4730-ba0c-8ddb69b78c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:49.269966 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc5ed4-4b44-4730-ba0c-8ddb69b78c88 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:49.270408 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc5ed4-4b44-4730-ba0c-8ddb69b78c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:49.270875 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc5ed4-4b44-4730-ba0c-8ddb69b78c88 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:49.277496 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc5ed4-4b44-4730-ba0c-8ddb69b78c88 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:49.277496 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc5ed4-4b44-4730-ba0c-8ddb69b78c88 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:49.280584 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 396/791] 10.222.0.35 () {56 vars in 1108 bytes} [Sat Feb 12 04:16:49 2022] GET /identity/v3/services => generated 772 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:49.359150 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 396/792] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:16:49 2022] PUT /identity/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/560fd9efb8a04f449acaf2f3987ce81c/roles/f9ebfff2487e4c75854f6c174dcebf56 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:16:50.017860 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cb866-3284-4440-bf3c-e1e0b924769d None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.018864 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cb866-3284-4440-bf3c-e1e0b924769d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.019414 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cb866-3284-4440-bf3c-e1e0b924769d None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.021375 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 397/793] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:50.026864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc7973-ccae-496d-8fb5-39a3a63bb31e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.027803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc7973-ccae-496d-8fb5-39a3a63bb31e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.028295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc7973-ccae-496d-8fb5-39a3a63bb31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.056180 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-8cdc7973-ccae-496d-8fb5-39a3a63bb31e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:50.057665 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8cdc7973-ccae-496d-8fb5-39a3a63bb31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:50.124859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 397/794] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:50 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:50.168709 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cb866-3284-4440-bf3c-e1e0b924769d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:50.184813 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cb866-3284-4440-bf3c-e1e0b924769d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:50.189803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474b35b-3e36-476d-b5a7-cf0f9b5fdb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:50.190845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474b35b-3e36-476d-b5a7-cf0f9b5fdb7e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.191393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474b35b-3e36-476d-b5a7-cf0f9b5fdb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.191894 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474b35b-3e36-476d-b5a7-cf0f9b5fdb7e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.205980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474b35b-3e36-476d-b5a7-cf0f9b5fdb7e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:50.213372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-0474b35b-3e36-476d-b5a7-cf0f9b5fdb7e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:16:50.214787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 398/795] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:50.221245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc7973-ccae-496d-8fb5-39a3a63bb31e None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:50.230805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc7973-ccae-496d-8fb5-39a3a63bb31e None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:50.239621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3321b-93d1-4ffc-a908-50c126647557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:50.240527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3321b-93d1-4ffc-a908-50c126647557 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.241005 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3321b-93d1-4ffc-a908-50c126647557 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.241473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3321b-93d1-4ffc-a908-50c126647557 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.242451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3321b-93d1-4ffc-a908-50c126647557 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:50.242950 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3321b-93d1-4ffc-a908-50c126647557 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:50.244752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3321b-93d1-4ffc-a908-50c126647557 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:50.254898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 398/796] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:50.260216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474b35b-3e36-476d-b5a7-cf0f9b5fdb7e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:50.270578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474b35b-3e36-476d-b5a7-cf0f9b5fdb7e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:50.284567 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ac9ce-d00d-496f-bf8d-7c3eb8224ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:50.285643 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ac9ce-d00d-496f-bf8d-7c3eb8224ddc admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.286137 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ac9ce-d00d-496f-bf8d-7c3eb8224ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.286622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ac9ce-d00d-496f-bf8d-7c3eb8224ddc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.298908 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ac9ce-d00d-496f-bf8d-7c3eb8224ddc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:50.301065 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ac9ce-d00d-496f-bf8d-7c3eb8224ddc admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:50.327774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-e55ac9ce-d00d-496f-bf8d-7c3eb8224ddc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:50.329811 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 399/797] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:50.335127 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3321b-93d1-4ffc-a908-50c126647557 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:50.346139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3321b-93d1-4ffc-a908-50c126647557 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:50.355390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed1f55-1f4e-4836-a3aa-d2183146a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:50.356316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1f55-1f4e-4836-a3aa-d2183146a63d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.356809 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1f55-1f4e-4836-a3aa-d2183146a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.357294 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feed1f55-1f4e-4836-a3aa-d2183146a63d admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.358230 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed1f55-1f4e-4836-a3aa-d2183146a63d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:50.358749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed1f55-1f4e-4836-a3aa-d2183146a63d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:50.361138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feed1f55-1f4e-4836-a3aa-d2183146a63d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:50.374824 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 399/798] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:50.380373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ac9ce-d00d-496f-bf8d-7c3eb8224ddc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:50.392334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ac9ce-d00d-496f-bf8d-7c3eb8224ddc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:50.402357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcde5fe-cd0d-4f5b-81ac-e7ce5946a158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:50.403579 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcde5fe-cd0d-4f5b-81ac-e7ce5946a158 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.404062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcde5fe-cd0d-4f5b-81ac-e7ce5946a158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.404579 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcde5fe-cd0d-4f5b-81ac-e7ce5946a158 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.416066 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcde5fe-cd0d-4f5b-81ac-e7ce5946a158 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:50.418474 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcde5fe-cd0d-4f5b-81ac-e7ce5946a158 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:50.438330 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-9fcde5fe-cd0d-4f5b-81ac-e7ce5946a158 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 04:16:50.439989 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 400/799] 10.222.0.35 () {56 vars in 1114 bytes} [Sat Feb 12 04:16:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:50.446251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed1f55-1f4e-4836-a3aa-d2183146a63d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:50.457489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feed1f55-1f4e-4836-a3aa-d2183146a63d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:50.468146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b22db-4a4b-4f16-85d6-34fefff703bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:50.469230 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b22db-4a4b-4f16-85d6-34fefff703bb admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.469729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b22db-4a4b-4f16-85d6-34fefff703bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.470736 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b22db-4a4b-4f16-85d6-34fefff703bb admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.471849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b22db-4a4b-4f16-85d6-34fefff703bb admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:50.472355 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b22db-4a4b-4f16-85d6-34fefff703bb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:50.476579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b22db-4a4b-4f16-85d6-34fefff703bb admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:50.496065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 400/800] 10.222.0.35 () {56 vars in 1154 bytes} [Sat Feb 12 04:16:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:50.501934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcde5fe-cd0d-4f5b-81ac-e7ce5946a158 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:50.512602 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcde5fe-cd0d-4f5b-81ac-e7ce5946a158 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:50.521248 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a805f-3a26-4170-a2d4-c15cb74bc148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:50.522220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a805f-3a26-4170-a2d4-c15cb74bc148 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.522700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a805f-3a26-4170-a2d4-c15cb74bc148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.523187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a805f-3a26-4170-a2d4-c15cb74bc148 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.536295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a805f-3a26-4170-a2d4-c15cb74bc148 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:50.538379 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a805f-3a26-4170-a2d4-c15cb74bc148 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:50.553259 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 401/801] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:50 2022] GET /identity/v3/auth/tokens => generated 1117 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:16:50.558854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b22db-4a4b-4f16-85d6-34fefff703bb admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:50.569187 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b22db-4a4b-4f16-85d6-34fefff703bb admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:50.578895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f2f7c-a873-46b3-9479-42d8f97d0283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:50.580536 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f2f7c-a873-46b3-9479-42d8f97d0283 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.581041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f2f7c-a873-46b3-9479-42d8f97d0283 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.581506 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f2f7c-a873-46b3-9479-42d8f97d0283 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.592858 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f2f7c-a873-46b3-9479-42d8f97d0283 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:50.595545 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f2f7c-a873-46b3-9479-42d8f97d0283 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:50.620025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-973f2f7c-a873-46b3-9479-42d8f97d0283 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:50.621951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 401/802] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:50.627340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a805f-3a26-4170-a2d4-c15cb74bc148 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:50.636324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a805f-3a26-4170-a2d4-c15cb74bc148 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:50.640973 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a193de-10ed-43dc-bc41-b6902770ef8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:50.641619 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a193de-10ed-43dc-bc41-b6902770ef8c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.642424 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a193de-10ed-43dc-bc41-b6902770ef8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.642680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a193de-10ed-43dc-bc41-b6902770ef8c admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.643432 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a193de-10ed-43dc-bc41-b6902770ef8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:50.643729 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a193de-10ed-43dc-bc41-b6902770ef8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:50.645292 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a193de-10ed-43dc-bc41-b6902770ef8c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:50.659051 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 402/803] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:50.664148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f2f7c-a873-46b3-9479-42d8f97d0283 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:50.681864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f2f7c-a873-46b3-9479-42d8f97d0283 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:50.692349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb79920-d87c-4706-8712-8b898e6af355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:50.693331 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb79920-d87c-4706-8712-8b898e6af355 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.693717 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb79920-d87c-4706-8712-8b898e6af355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.694099 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb79920-d87c-4706-8712-8b898e6af355 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.704469 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb79920-d87c-4706-8712-8b898e6af355 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:50.707026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb79920-d87c-4706-8712-8b898e6af355 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:50.726454 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-2cb79920-d87c-4706-8712-8b898e6af355 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:50.727964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 402/804] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:50.733900 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a193de-10ed-43dc-bc41-b6902770ef8c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:50.748555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a193de-10ed-43dc-bc41-b6902770ef8c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:50.755968 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf2432c-148f-4272-bbbc-43c0a1745a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:50.756744 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2432c-148f-4272-bbbc-43c0a1745a6b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.757123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2432c-148f-4272-bbbc-43c0a1745a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.757500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf2432c-148f-4272-bbbc-43c0a1745a6b admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.758411 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2432c-148f-4272-bbbc-43c0a1745a6b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:50.758834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2432c-148f-4272-bbbc-43c0a1745a6b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:50.760826 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf2432c-148f-4272-bbbc-43c0a1745a6b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:50.778597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 403/805] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:50.784842 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb79920-d87c-4706-8712-8b898e6af355 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:50.800580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb79920-d87c-4706-8712-8b898e6af355 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:50.805581 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c6bb9-40a3-4f0b-b186-9cf2e302e517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:50.806326 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c6bb9-40a3-4f0b-b186-9cf2e302e517 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.806709 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c6bb9-40a3-4f0b-b186-9cf2e302e517 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.807090 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c6bb9-40a3-4f0b-b186-9cf2e302e517 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.808087 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c6bb9-40a3-4f0b-b186-9cf2e302e517 admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=362ab4aeb88746d8b8a14a238c877a53) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:50.808499 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c6bb9-40a3-4f0b-b186-9cf2e302e517 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:50.810418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c6bb9-40a3-4f0b-b186-9cf2e302e517 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:50.819820 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 403/806] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:50 2022] GET /identity/v3/role_assignments?user.id=362ab4aeb88746d8b8a14a238c877a53&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:50.868145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3534e9-b8e8-4843-87c4-d3da1f2ede1f None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.868590 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3534e9-b8e8-4843-87c4-d3da1f2ede1f None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.868968 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3534e9-b8e8-4843-87c4-d3da1f2ede1f None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.870920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 404/807] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:50.877926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d31d5-f112-4a22-94d2-d262f28eeb04 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.877926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d31d5-f112-4a22-94d2-d262f28eeb04 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.877926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d31d5-f112-4a22-94d2-d262f28eeb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.903015 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-d84d31d5-f112-4a22-94d2-d262f28eeb04 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:50.904462 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d84d31d5-f112-4a22-94d2-d262f28eeb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:50.917412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 404/808] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:50 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:50.923354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24a480-2289-4f91-8607-2b800750d996 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.923646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24a480-2289-4f91-8607-2b800750d996 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.923927 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24a480-2289-4f91-8607-2b800750d996 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.926060 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 405/809] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:50.931998 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3655f-a990-413a-be86-0b8261ed78c4 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.932502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3655f-a990-413a-be86-0b8261ed78c4 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.932948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3655f-a990-413a-be86-0b8261ed78c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.946656 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24a480-2289-4f91-8607-2b800750d996 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:50.959667 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24a480-2289-4f91-8607-2b800750d996 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:50.960621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-75e3655f-a990-413a-be86-0b8261ed78c4 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:50.962007 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-75e3655f-a990-413a-be86-0b8261ed78c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:50.964688 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdff73-da3b-4593-b738-b3bec0240674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:50.965693 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdff73-da3b-4593-b738-b3bec0240674 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:50.966123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdff73-da3b-4593-b738-b3bec0240674 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:50.966690 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdff73-da3b-4593-b738-b3bec0240674 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:50.973729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 405/810] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:50 2022] POST /identity/v3/auth/tokens => generated 1117 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:50.980568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdff73-da3b-4593-b738-b3bec0240674 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:50.988795 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-95fdff73-da3b-4593-b738-b3bec0240674 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:16:50.990674 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 406/811] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:50.996737 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3655f-a990-413a-be86-0b8261ed78c4 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:51.007385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdff73-da3b-4593-b738-b3bec0240674 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:51.007617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3655f-a990-413a-be86-0b8261ed78c4 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:51.021453 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdff73-da3b-4593-b738-b3bec0240674 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:51.025601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d324b2-7f25-4c84-9e84-df90e06d7a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:51.026622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d324b2-7f25-4c84-9e84-df90e06d7a19 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.027672 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d324b2-7f25-4c84-9e84-df90e06d7a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.029032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d324b2-7f25-4c84-9e84-df90e06d7a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.030715 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d324b2-7f25-4c84-9e84-df90e06d7a19 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:51.031801 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d324b2-7f25-4c84-9e84-df90e06d7a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:51.035769 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f8d14-eb0f-4563-9389-b878315c2322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:51.036484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d324b2-7f25-4c84-9e84-df90e06d7a19 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:51.037655 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f8d14-eb0f-4563-9389-b878315c2322 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.039165 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f8d14-eb0f-4563-9389-b878315c2322 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.039640 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f8d14-eb0f-4563-9389-b878315c2322 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.040478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f8d14-eb0f-4563-9389-b878315c2322 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:51.046646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f8d14-eb0f-4563-9389-b878315c2322 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:51.054168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 406/812] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:51.062473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d324b2-7f25-4c84-9e84-df90e06d7a19 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:51.074108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-a73f8d14-eb0f-4563-9389-b878315c2322 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Feb 12 04:16:51.078044 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 407/813] 10.222.0.35 () {56 vars in 1150 bytes} [Sat Feb 12 04:16:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:51.082112 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d324b2-7f25-4c84-9e84-df90e06d7a19 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:51.083909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f8d14-eb0f-4563-9389-b878315c2322 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:51.093599 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf4871-a143-450f-a63f-7c3cfa9091a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:51.094458 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf4871-a143-450f-a63f-7c3cfa9091a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.095265 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf4871-a143-450f-a63f-7c3cfa9091a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.095571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf4871-a143-450f-a63f-7c3cfa9091a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.097041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f8d14-eb0f-4563-9389-b878315c2322 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:51.102118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ec6e2-19ce-4f4d-8b25-6dec6aa66a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:51.103011 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ec6e2-19ce-4f4d-8b25-6dec6aa66a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.103567 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ec6e2-19ce-4f4d-8b25-6dec6aa66a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.104066 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ec6e2-19ce-4f4d-8b25-6dec6aa66a00 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.105049 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ec6e2-19ce-4f4d-8b25-6dec6aa66a00 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:51.105532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ec6e2-19ce-4f4d-8b25-6dec6aa66a00 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:51.107527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ec6e2-19ce-4f4d-8b25-6dec6aa66a00 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:51.107635 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf4871-a143-450f-a63f-7c3cfa9091a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:51.109406 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acf4871-a143-450f-a63f-7c3cfa9091a8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:51.119847 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 408/814] 10.222.0.35 () {56 vars in 1145 bytes} [Sat Feb 12 04:16:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:51.127770 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ec6e2-19ce-4f4d-8b25-6dec6aa66a00 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:51.128322 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-9acf4871-a143-450f-a63f-7c3cfa9091a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:51.129772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 407/815] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:51.136860 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf4871-a143-450f-a63f-7c3cfa9091a8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:51.140142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ec6e2-19ce-4f4d-8b25-6dec6aa66a00 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:51.152134 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acf4871-a143-450f-a63f-7c3cfa9091a8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:51.152427 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3370-8c7b-4247-a924-c78381b93296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:51.153376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3370-8c7b-4247-a924-c78381b93296 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.153963 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3370-8c7b-4247-a924-c78381b93296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.154408 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3370-8c7b-4247-a924-c78381b93296 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.155340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e3370-8c7b-4247-a924-c78381b93296 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:51.155820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e3370-8c7b-4247-a924-c78381b93296 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:51.157790 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e3370-8c7b-4247-a924-c78381b93296 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:51.163887 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 409/816] 10.222.0.35 () {56 vars in 1145 bytes} [Sat Feb 12 04:16:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:51.164949 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bdd79-6be2-4374-9bb5-bd5104771b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:51.170267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bdd79-6be2-4374-9bb5-bd5104771b04 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.170267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bdd79-6be2-4374-9bb5-bd5104771b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.170267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086bdd79-6be2-4374-9bb5-bd5104771b04 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.170267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bdd79-6be2-4374-9bb5-bd5104771b04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:51.170267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bdd79-6be2-4374-9bb5-bd5104771b04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:51.170717 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3370-8c7b-4247-a924-c78381b93296 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:51.170800 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086bdd79-6be2-4374-9bb5-bd5104771b04 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:51.185318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3370-8c7b-4247-a924-c78381b93296 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:51.189447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 408/817] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:51.191255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bdd79-6be2-4374-9bb5-bd5104771b04 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:51.196166 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79dc3f-dd93-4257-9dcd-c7d10c1e6a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:51.197126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79dc3f-dd93-4257-9dcd-c7d10c1e6a12 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.197623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79dc3f-dd93-4257-9dcd-c7d10c1e6a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.198107 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b79dc3f-dd93-4257-9dcd-c7d10c1e6a12 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.199145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79dc3f-dd93-4257-9dcd-c7d10c1e6a12 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:51.200538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-4b79dc3f-dd93-4257-9dcd-c7d10c1e6a12 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:51.200538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:16:51.200538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:16:51.201189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086bdd79-6be2-4374-9bb5-bd5104771b04 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:51.202008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b79dc3f-dd93-4257-9dcd-c7d10c1e6a12 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:51.208384 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad692388-1158-4e68-8be6-2683f0f17d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:51.209605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad692388-1158-4e68-8be6-2683f0f17d0d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.210035 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad692388-1158-4e68-8be6-2683f0f17d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.210519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad692388-1158-4e68-8be6-2683f0f17d0d admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.218719 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad692388-1158-4e68-8be6-2683f0f17d0d admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:51.221233 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad692388-1158-4e68-8be6-2683f0f17d0d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:51.237180 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-ad692388-1158-4e68-8be6-2683f0f17d0d admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 12 04:16:51.244906 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 409/818] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:51.244906 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad692388-1158-4e68-8be6-2683f0f17d0d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:51.254534 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad692388-1158-4e68-8be6-2683f0f17d0d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:51.259179 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6e72e-17a4-4627-92e7-b3840ccdde5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:51.259895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6e72e-17a4-4627-92e7-b3840ccdde5e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.260230 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6e72e-17a4-4627-92e7-b3840ccdde5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.260508 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6e72e-17a4-4627-92e7-b3840ccdde5e admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.261415 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6e72e-17a4-4627-92e7-b3840ccdde5e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:51.261722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6e72e-17a4-4627-92e7-b3840ccdde5e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:51.263707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6e72e-17a4-4627-92e7-b3840ccdde5e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:51.283482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 410/819] 10.222.0.35 () {56 vars in 1156 bytes} [Sat Feb 12 04:16:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:51.289080 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6e72e-17a4-4627-92e7-b3840ccdde5e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:51.298979 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6e72e-17a4-4627-92e7-b3840ccdde5e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:51.305516 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c736e-294b-4dbb-a127-cf1543287d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:51.306673 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c736e-294b-4dbb-a127-cf1543287d63 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.307186 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c736e-294b-4dbb-a127-cf1543287d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.313269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057c736e-294b-4dbb-a127-cf1543287d63 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.319208 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c736e-294b-4dbb-a127-cf1543287d63 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:51.321339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057c736e-294b-4dbb-a127-cf1543287d63 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:51.343683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-057c736e-294b-4dbb-a127-cf1543287d63 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:51.344289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 410/821] 10.222.0.35 () {60 vars in 1165 bytes} [Sat Feb 12 04:16:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:51.347587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 411/821] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:51.350158 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79dc3f-dd93-4257-9dcd-c7d10c1e6a12 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:51.375876 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b79dc3f-dd93-4257-9dcd-c7d10c1e6a12 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:51.382794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd955bc8-6816-40ff-b585-0504ed6bcc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:51.383807 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd955bc8-6816-40ff-b585-0504ed6bcc5c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.384187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd955bc8-6816-40ff-b585-0504ed6bcc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.384549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd955bc8-6816-40ff-b585-0504ed6bcc5c admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.385481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd955bc8-6816-40ff-b585-0504ed6bcc5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:51.385884 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd955bc8-6816-40ff-b585-0504ed6bcc5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:51.387708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd955bc8-6816-40ff-b585-0504ed6bcc5c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:51.406423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 411/822] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:51.412767 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c736e-294b-4dbb-a127-cf1543287d63 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:51.424942 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057c736e-294b-4dbb-a127-cf1543287d63 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:51.431956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239580b1-912d-4b6d-a481-95e70dfb96ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:51.432869 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239580b1-912d-4b6d-a481-95e70dfb96ae admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.433242 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239580b1-912d-4b6d-a481-95e70dfb96ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.433608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239580b1-912d-4b6d-a481-95e70dfb96ae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.443936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239580b1-912d-4b6d-a481-95e70dfb96ae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:51.446110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239580b1-912d-4b6d-a481-95e70dfb96ae admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:51.464725 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-239580b1-912d-4b6d-a481-95e70dfb96ae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:51.468174 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 412/823] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:51.472769 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd955bc8-6816-40ff-b585-0504ed6bcc5c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:51.483126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd955bc8-6816-40ff-b585-0504ed6bcc5c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:51.488306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d822e14-50a1-4db7-9933-8f0aa0b6953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:51.489031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d822e14-50a1-4db7-9933-8f0aa0b6953d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.489384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d822e14-50a1-4db7-9933-8f0aa0b6953d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.489712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d822e14-50a1-4db7-9933-8f0aa0b6953d admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.490576 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d822e14-50a1-4db7-9933-8f0aa0b6953d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:51.490946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d822e14-50a1-4db7-9933-8f0aa0b6953d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:51.493023 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d822e14-50a1-4db7-9933-8f0aa0b6953d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:51.506597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 412/824] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:51.512579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239580b1-912d-4b6d-a481-95e70dfb96ae admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:51.525310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239580b1-912d-4b6d-a481-95e70dfb96ae admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:51.530174 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24983755-ee78-40e7-b986-77a4999462f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:51.531129 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24983755-ee78-40e7-b986-77a4999462f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.531495 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24983755-ee78-40e7-b986-77a4999462f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.531826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24983755-ee78-40e7-b986-77a4999462f2 admin admin] PATH_INFO: `/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/3b37a10e3b5e404db7aad72e1772a2de/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.534691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24983755-ee78-40e7-b986-77a4999462f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e546ab571490aa0b23c0b22a35c4f, user_id=3b37a10e3b5e404db7aad72e1772a2de, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:51.537483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24983755-ee78-40e7-b986-77a4999462f2 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:51.617604 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 413/825] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:16:51 2022] PUT /identity/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/3b37a10e3b5e404db7aad72e1772a2de/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:16:51.955665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e551be-7876-4de7-b1a7-dc670ab06b47 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.956167 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e551be-7876-4de7-b1a7-dc670ab06b47 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.956564 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e551be-7876-4de7-b1a7-dc670ab06b47 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:51.958646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 413/826] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:51.973988 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549841a3-57f0-4e27-9293-3a5909b95fd8 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:51.974271 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549841a3-57f0-4e27-9293-3a5909b95fd8 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:51.974552 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549841a3-57f0-4e27-9293-3a5909b95fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.004316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-549841a3-57f0-4e27-9293-3a5909b95fd8 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:52.005543 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-549841a3-57f0-4e27-9293-3a5909b95fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:52.084260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 414/827] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:51 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:52.119893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e551be-7876-4de7-b1a7-dc670ab06b47 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.135692 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e551be-7876-4de7-b1a7-dc670ab06b47 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.142275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce38dd6-58f5-4a0a-ba50-a7852fb2813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.143168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce38dd6-58f5-4a0a-ba50-a7852fb2813a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.143469 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce38dd6-58f5-4a0a-ba50-a7852fb2813a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.143740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce38dd6-58f5-4a0a-ba50-a7852fb2813a admin admin] PATH_INFO: `/v3/services/network` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.144461 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce38dd6-58f5-4a0a-ba50-a7852fb2813a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.146090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce38dd6-58f5-4a0a-ba50-a7852fb2813a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.160718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-fce38dd6-58f5-4a0a-ba50-a7852fb2813a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Feb 12 04:16:52.164540 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 414/828] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/services/network => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:52.167759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549841a3-57f0-4e27-9293-3a5909b95fd8 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.180556 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549841a3-57f0-4e27-9293-3a5909b95fd8 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.191561 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7b97-c461-4619-9844-b64a53feedc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.192231 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7b97-c461-4619-9844-b64a53feedc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.192513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7b97-c461-4619-9844-b64a53feedc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.192789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d7b97-c461-4619-9844-b64a53feedc1 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.193523 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d7b97-c461-4619-9844-b64a53feedc1 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:52.193827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d7b97-c461-4619-9844-b64a53feedc1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.195452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d7b97-c461-4619-9844-b64a53feedc1 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.203253 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 415/829] 10.222.0.35 () {56 vars in 1133 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:52.209441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce38dd6-58f5-4a0a-ba50-a7852fb2813a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.224938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce38dd6-58f5-4a0a-ba50-a7852fb2813a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.233138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9a18f2-7d37-4d85-9c67-b98859f884ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.233798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a18f2-7d37-4d85-9c67-b98859f884ed admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.234078 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a18f2-7d37-4d85-9c67-b98859f884ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.234348 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9a18f2-7d37-4d85-9c67-b98859f884ed admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.235068 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a18f2-7d37-4d85-9c67-b98859f884ed admin admin] RBAC: Adding query filter params (type=network) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:52.235958 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a18f2-7d37-4d85-9c67-b98859f884ed admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.237543 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9a18f2-7d37-4d85-9c67-b98859f884ed admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.247431 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 415/830] 10.222.0.35 () {56 vars in 1133 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:52.253628 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7b97-c461-4619-9844-b64a53feedc1 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.268479 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d7b97-c461-4619-9844-b64a53feedc1 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.278856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b893a1-285e-428c-8d26-e0baff32636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.280379 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b893a1-285e-428c-8d26-e0baff32636a admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.280856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b893a1-285e-428c-8d26-e0baff32636a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.281320 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b893a1-285e-428c-8d26-e0baff32636a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.282311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b893a1-285e-428c-8d26-e0baff32636a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.283548 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-c2b893a1-285e-428c-8d26-e0baff32636a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:52.283548 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:16:52.283548 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:16:52.284784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b893a1-285e-428c-8d26-e0baff32636a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.360998 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d203a-55ee-4115-a0ed-d1c4432b4888 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.361379 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d203a-55ee-4115-a0ed-d1c4432b4888 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.361662 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08d203a-55ee-4115-a0ed-d1c4432b4888 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.363852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 416/831] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:52.374100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cbecc-e203-44cd-b218-01fbcdbea08e None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.374100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cbecc-e203-44cd-b218-01fbcdbea08e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.374100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3cbecc-e203-44cd-b218-01fbcdbea08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.390481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-0a3cbecc-e203-44cd-b218-01fbcdbea08e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:52.391882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-0a3cbecc-e203-44cd-b218-01fbcdbea08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:52.400885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 417/832] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:52 2022] POST /identity/v3/auth/tokens => generated 1303 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:16:52.403442 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 416/833] 10.222.0.35 () {60 vars in 1165 bytes} [Sat Feb 12 04:16:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:52.426881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cbecc-e203-44cd-b218-01fbcdbea08e None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.437679 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3cbecc-e203-44cd-b218-01fbcdbea08e None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.453366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18886b02-9e99-4372-a700-c5b99e036b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.454316 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18886b02-9e99-4372-a700-c5b99e036b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.454978 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18886b02-9e99-4372-a700-c5b99e036b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.455574 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18886b02-9e99-4372-a700-c5b99e036b40 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.468131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18886b02-9e99-4372-a700-c5b99e036b40 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:52.476531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-18886b02-9e99-4372-a700-c5b99e036b40 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:16:52.478386 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 418/834] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:52.484369 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b893a1-285e-428c-8d26-e0baff32636a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.495050 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b893a1-285e-428c-8d26-e0baff32636a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.500104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223766fa-afec-4384-9474-1a60b2aacb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.500879 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223766fa-afec-4384-9474-1a60b2aacb15 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.501755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223766fa-afec-4384-9474-1a60b2aacb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.502101 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223766fa-afec-4384-9474-1a60b2aacb15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.503060 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223766fa-afec-4384-9474-1a60b2aacb15 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:52.503476 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223766fa-afec-4384-9474-1a60b2aacb15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.505205 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223766fa-afec-4384-9474-1a60b2aacb15 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.514948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 417/835] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:52.521261 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18886b02-9e99-4372-a700-c5b99e036b40 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.531958 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18886b02-9e99-4372-a700-c5b99e036b40 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.537999 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc92ab9-8667-45e2-acb6-f4d1e0f698ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.538861 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc92ab9-8667-45e2-acb6-f4d1e0f698ec admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.539217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc92ab9-8667-45e2-acb6-f4d1e0f698ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.539589 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc92ab9-8667-45e2-acb6-f4d1e0f698ec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.552103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc92ab9-8667-45e2-acb6-f4d1e0f698ec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.554152 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc92ab9-8667-45e2-acb6-f4d1e0f698ec admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.576246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-ffc92ab9-8667-45e2-acb6-f4d1e0f698ec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:52.578034 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 419/836] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:52.584241 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223766fa-afec-4384-9474-1a60b2aacb15 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.594551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223766fa-afec-4384-9474-1a60b2aacb15 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.599940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567a9ca-b95d-45b9-964a-49cb4f6bee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.600675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567a9ca-b95d-45b9-964a-49cb4f6bee6c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.601025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567a9ca-b95d-45b9-964a-49cb4f6bee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.601369 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b567a9ca-b95d-45b9-964a-49cb4f6bee6c admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.602191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567a9ca-b95d-45b9-964a-49cb4f6bee6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:52.602568 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567a9ca-b95d-45b9-964a-49cb4f6bee6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.604251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b567a9ca-b95d-45b9-964a-49cb4f6bee6c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.625439 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 418/837] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:52.631649 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc92ab9-8667-45e2-acb6-f4d1e0f698ec admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.643106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc92ab9-8667-45e2-acb6-f4d1e0f698ec admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.648069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85816030-f9a7-4a3b-af85-242e55517269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.648990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85816030-f9a7-4a3b-af85-242e55517269 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.649344 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85816030-f9a7-4a3b-af85-242e55517269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.649687 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85816030-f9a7-4a3b-af85-242e55517269 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.658901 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85816030-f9a7-4a3b-af85-242e55517269 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.661035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85816030-f9a7-4a3b-af85-242e55517269 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.675191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-85816030-f9a7-4a3b-af85-242e55517269 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 12 04:16:52.676827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 420/838] 10.222.0.35 () {56 vars in 1138 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:52.682711 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567a9ca-b95d-45b9-964a-49cb4f6bee6c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.693534 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b567a9ca-b95d-45b9-964a-49cb4f6bee6c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.698265 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ccd78-2ee6-4967-9342-2e45ee7c0cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.699058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ccd78-2ee6-4967-9342-2e45ee7c0cbf admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.699435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ccd78-2ee6-4967-9342-2e45ee7c0cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.699776 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ccd78-2ee6-4967-9342-2e45ee7c0cbf admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.700706 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ccd78-2ee6-4967-9342-2e45ee7c0cbf admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:52.701083 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ccd78-2ee6-4967-9342-2e45ee7c0cbf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.702986 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ccd78-2ee6-4967-9342-2e45ee7c0cbf admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.731947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 419/839] 10.222.0.35 () {56 vars in 1170 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:52.737921 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85816030-f9a7-4a3b-af85-242e55517269 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.747956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85816030-f9a7-4a3b-af85-242e55517269 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.753532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e2bc-661f-43a5-a453-62bf8b175d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.754237 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e2bc-661f-43a5-a453-62bf8b175d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.754590 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e2bc-661f-43a5-a453-62bf8b175d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.754933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc5e2bc-661f-43a5-a453-62bf8b175d53 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.763297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5e2bc-661f-43a5-a453-62bf8b175d53 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.765100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc5e2bc-661f-43a5-a453-62bf8b175d53 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.775107 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 421/840] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:16:52.780468 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ccd78-2ee6-4967-9342-2e45ee7c0cbf admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.790573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ccd78-2ee6-4967-9342-2e45ee7c0cbf admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.795352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f0ba5-cd9c-4b2e-9222-6465e6d3ea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.796199 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f0ba5-cd9c-4b2e-9222-6465e6d3ea69 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.796477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f0ba5-cd9c-4b2e-9222-6465e6d3ea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.796808 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9f0ba5-cd9c-4b2e-9222-6465e6d3ea69 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.808644 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f0ba5-cd9c-4b2e-9222-6465e6d3ea69 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.810507 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9f0ba5-cd9c-4b2e-9222-6465e6d3ea69 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.829073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-ce9f0ba5-cd9c-4b2e-9222-6465e6d3ea69 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:52.831157 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 420/841] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:52.836689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e2bc-661f-43a5-a453-62bf8b175d53 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.845812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc5e2bc-661f-43a5-a453-62bf8b175d53 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.850543 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49539aad-cdc5-44eb-aaa7-2df15e25158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.851257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49539aad-cdc5-44eb-aaa7-2df15e25158a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.851596 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49539aad-cdc5-44eb-aaa7-2df15e25158a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.851869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49539aad-cdc5-44eb-aaa7-2df15e25158a admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.852621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49539aad-cdc5-44eb-aaa7-2df15e25158a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:52.852922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49539aad-cdc5-44eb-aaa7-2df15e25158a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.854566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49539aad-cdc5-44eb-aaa7-2df15e25158a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.867862 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 422/842] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:52.873342 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f0ba5-cd9c-4b2e-9222-6465e6d3ea69 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.884163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9f0ba5-cd9c-4b2e-9222-6465e6d3ea69 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.889018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006a3db-fd79-404e-9123-7bfeeff28b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.889862 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006a3db-fd79-404e-9123-7bfeeff28b4e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.890148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006a3db-fd79-404e-9123-7bfeeff28b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.890472 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1006a3db-fd79-404e-9123-7bfeeff28b4e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.898027 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006a3db-fd79-404e-9123-7bfeeff28b4e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.900087 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1006a3db-fd79-404e-9123-7bfeeff28b4e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.913758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-1006a3db-fd79-404e-9123-7bfeeff28b4e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:52.915293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 421/843] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:52.921028 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49539aad-cdc5-44eb-aaa7-2df15e25158a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.932157 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49539aad-cdc5-44eb-aaa7-2df15e25158a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.936969 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b578a3d-9b0d-4907-943b-4c66e9b186d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.937630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b578a3d-9b0d-4907-943b-4c66e9b186d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.937912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b578a3d-9b0d-4907-943b-4c66e9b186d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.938191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b578a3d-9b0d-4907-943b-4c66e9b186d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.939062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b578a3d-9b0d-4907-943b-4c66e9b186d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:52.939568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b578a3d-9b0d-4907-943b-4c66e9b186d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.941543 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b578a3d-9b0d-4907-943b-4c66e9b186d5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.957062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 423/844] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:52.962985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006a3db-fd79-404e-9123-7bfeeff28b4e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:52.974129 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1006a3db-fd79-404e-9123-7bfeeff28b4e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:52.978797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c42dc-ac48-4a24-b13f-7dfee0160fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:52.979487 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c42dc-ac48-4a24-b13f-7dfee0160fcd admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:52.979771 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c42dc-ac48-4a24-b13f-7dfee0160fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:52.980051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c42dc-ac48-4a24-b13f-7dfee0160fcd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:52.980909 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c42dc-ac48-4a24-b13f-7dfee0160fcd admin admin] RBAC: Adding query filter params (role.id=f9ebfff2487e4c75854f6c174dcebf56, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=560fd9efb8a04f449acaf2f3987ce81c) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:52.981219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c42dc-ac48-4a24-b13f-7dfee0160fcd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:52.983106 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c42dc-ac48-4a24-b13f-7dfee0160fcd admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:52.992971 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 422/845] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:52 2022] GET /identity/v3/role_assignments?user.id=560fd9efb8a04f449acaf2f3987ce81c&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=f9ebfff2487e4c75854f6c174dcebf56 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:53.648159 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066773-941b-45fb-a6f0-32c541f9d700 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:53.648644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066773-941b-45fb-a6f0-32c541f9d700 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:53.648644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3066773-941b-45fb-a6f0-32c541f9d700 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:53.650645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 424/846] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:53.656008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e76705-daa6-4d1b-b62f-4117c9d7ddeb None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:53.656400 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e76705-daa6-4d1b-b62f-4117c9d7ddeb None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:53.656564 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e76705-daa6-4d1b-b62f-4117c9d7ddeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:53.675445 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-20e76705-daa6-4d1b-b62f-4117c9d7ddeb None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:53.676636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-20e76705-daa6-4d1b-b62f-4117c9d7ddeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:53.687144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 423/847] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:53 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:53.709751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3066773-941b-45fb-a6f0-32c541f9d700 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:53.722178 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3066773-941b-45fb-a6f0-32c541f9d700 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:53.726838 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c91b4f-9c7c-446f-b345-a7b7dde361cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:53.727773 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c91b4f-9c7c-446f-b345-a7b7dde361cc admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:53.728147 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c91b4f-9c7c-446f-b345-a7b7dde361cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:53.728512 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c91b4f-9c7c-446f-b345-a7b7dde361cc admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:53.729282 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c91b4f-9c7c-446f-b345-a7b7dde361cc admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:53.731023 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c91b4f-9c7c-446f-b345-a7b7dde361cc admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:53.743568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-35c91b4f-9c7c-446f-b345-a7b7dde361cc admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 12 04:16:53.749567 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 425/848] 10.222.0.35 () {56 vars in 1153 bytes} [Sat Feb 12 04:16:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:53.750931 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e76705-daa6-4d1b-b62f-4117c9d7ddeb None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:53.760533 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e76705-daa6-4d1b-b62f-4117c9d7ddeb None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:53.765049 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8931b42c-cb9a-4cfa-9069-27f817503f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:53.765700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931b42c-cb9a-4cfa-9069-27f817503f73 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:53.765973 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931b42c-cb9a-4cfa-9069-27f817503f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:53.766245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931b42c-cb9a-4cfa-9069-27f817503f73 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:53.767532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931b42c-cb9a-4cfa-9069-27f817503f73 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:53.767830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931b42c-cb9a-4cfa-9069-27f817503f73 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:53.769399 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8931b42c-cb9a-4cfa-9069-27f817503f73 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:53.778680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 424/849] 10.222.0.35 () {56 vars in 1147 bytes} [Sat Feb 12 04:16:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:53.780144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c91b4f-9c7c-446f-b345-a7b7dde361cc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:53.790523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c91b4f-9c7c-446f-b345-a7b7dde361cc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:53.795047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f8502-4fdf-4b65-b700-9c3b17a2ffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:53.795728 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8502-4fdf-4b65-b700-9c3b17a2ffa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:53.796005 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8502-4fdf-4b65-b700-9c3b17a2ffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:53.796275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f8502-4fdf-4b65-b700-9c3b17a2ffa2 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:53.796994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f8502-4fdf-4b65-b700-9c3b17a2ffa2 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:53.797295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f8502-4fdf-4b65-b700-9c3b17a2ffa2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:53.799460 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f8502-4fdf-4b65-b700-9c3b17a2ffa2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:53.811381 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 426/850] 10.222.0.35 () {56 vars in 1147 bytes} [Sat Feb 12 04:16:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:54.184758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622863-70ab-4338-b0b5-86c61804630d None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.184758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622863-70ab-4338-b0b5-86c61804630d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.184758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4622863-70ab-4338-b0b5-86c61804630d None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.185538 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 425/851] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:54.191940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e91a-a6de-47f9-bd80-a32d96bbeab8 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.192468 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e91a-a6de-47f9-bd80-a32d96bbeab8 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.192958 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e91a-a6de-47f9-bd80-a32d96bbeab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.196016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579d2a6-ac99-42b2-869c-d9982c0db654 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.196305 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579d2a6-ac99-42b2-869c-d9982c0db654 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.196585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b579d2a6-ac99-42b2-869c-d9982c0db654 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.198617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 426/852] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:54.203816 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7012869-6cfa-45af-b0d9-41539d6a1870 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.204666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7012869-6cfa-45af-b0d9-41539d6a1870 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.205524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7012869-6cfa-45af-b0d9-41539d6a1870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.216743 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-b5c0e91a-a6de-47f9-bd80-a32d96bbeab8 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:54.218655 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b5c0e91a-a6de-47f9-bd80-a32d96bbeab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:54.223788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-e7012869-6cfa-45af-b0d9-41539d6a1870 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:54.224966 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e7012869-6cfa-45af-b0d9-41539d6a1870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:54.228140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 427/853] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:54 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:54.237125 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 427/854] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:54 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:16:54.251851 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e91a-a6de-47f9-bd80-a32d96bbeab8 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.261419 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e91a-a6de-47f9-bd80-a32d96bbeab8 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.261688 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7012869-6cfa-45af-b0d9-41539d6a1870 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.266667 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a2ac0-c031-42e6-aaa5-3c26a79620cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.268411 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a2ac0-c031-42e6-aaa5-3c26a79620cb admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.269075 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a2ac0-c031-42e6-aaa5-3c26a79620cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.269677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a2ac0-c031-42e6-aaa5-3c26a79620cb admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.270577 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a2ac0-c031-42e6-aaa5-3c26a79620cb admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:54.271574 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7012869-6cfa-45af-b0d9-41539d6a1870 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.272947 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a2ac0-c031-42e6-aaa5-3c26a79620cb admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:54.276884 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab017d-b157-43f0-b900-5fe2dad5928f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.277378 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab017d-b157-43f0-b900-5fe2dad5928f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.277664 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab017d-b157-43f0-b900-5fe2dad5928f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.277940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab017d-b157-43f0-b900-5fe2dad5928f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.289616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-286a2ac0-c031-42e6-aaa5-3c26a79620cb admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 12 04:16:54.290942 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab017d-b157-43f0-b900-5fe2dad5928f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:54.291938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 428/855] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:54.297739 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a2ac0-c031-42e6-aaa5-3c26a79620cb admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.298313 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-8fab017d-b157-43f0-b900-5fe2dad5928f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:16:54.300102 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 428/856] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:54.305895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab017d-b157-43f0-b900-5fe2dad5928f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.309136 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a2ac0-c031-42e6-aaa5-3c26a79620cb admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.314896 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf14ab-22c0-4475-8f7d-f8bda2c692ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.315849 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf14ab-22c0-4475-8f7d-f8bda2c692ee admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.316120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab017d-b157-43f0-b900-5fe2dad5928f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.316534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf14ab-22c0-4475-8f7d-f8bda2c692ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.317069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf14ab-22c0-4475-8f7d-f8bda2c692ee admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.318198 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf14ab-22c0-4475-8f7d-f8bda2c692ee admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:54.318762 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf14ab-22c0-4475-8f7d-f8bda2c692ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:54.320945 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf14ab-22c0-4475-8f7d-f8bda2c692ee admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:54.321140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc031c-5f5d-484d-ba92-e3a26c3d4d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.321784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc031c-5f5d-484d-ba92-e3a26c3d4d54 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.322114 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc031c-5f5d-484d-ba92-e3a26c3d4d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.322444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc031c-5f5d-484d-ba92-e3a26c3d4d54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.323206 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc031c-5f5d-484d-ba92-e3a26c3d4d54 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:54.323548 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc031c-5f5d-484d-ba92-e3a26c3d4d54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:54.325213 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc031c-5f5d-484d-ba92-e3a26c3d4d54 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:54.328178 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 429/857] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:54.334728 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf14ab-22c0-4475-8f7d-f8bda2c692ee admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.337312 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 429/858] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:54.342713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc031c-5f5d-484d-ba92-e3a26c3d4d54 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.345613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf14ab-22c0-4475-8f7d-f8bda2c692ee admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.351277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815c819-8649-4134-93a2-31b56eb5ea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.352140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815c819-8649-4134-93a2-31b56eb5ea64 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.352619 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815c819-8649-4134-93a2-31b56eb5ea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.352722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc031c-5f5d-484d-ba92-e3a26c3d4d54 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.353181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815c819-8649-4134-93a2-31b56eb5ea64 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.354271 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815c819-8649-4134-93a2-31b56eb5ea64 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:54.354856 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815c819-8649-4134-93a2-31b56eb5ea64 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:54.357097 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815c819-8649-4134-93a2-31b56eb5ea64 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:54.357503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091c08f-a891-4029-b042-1dfbefc4d49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.358264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091c08f-a891-4029-b042-1dfbefc4d49a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.358605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091c08f-a891-4029-b042-1dfbefc4d49a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.358887 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a091c08f-a891-4029-b042-1dfbefc4d49a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.364298 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 430/859] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:54.377002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091c08f-a891-4029-b042-1dfbefc4d49a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:54.378867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a091c08f-a891-4029-b042-1dfbefc4d49a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:54.398255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-a091c08f-a891-4029-b042-1dfbefc4d49a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:54.399735 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 430/860] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:54.405490 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815c819-8649-4134-93a2-31b56eb5ea64 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.417911 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815c819-8649-4134-93a2-31b56eb5ea64 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.423554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901fe60-90dd-4c59-aff6-ed1cca648963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.424222 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901fe60-90dd-4c59-aff6-ed1cca648963 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.424506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901fe60-90dd-4c59-aff6-ed1cca648963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.424785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901fe60-90dd-4c59-aff6-ed1cca648963 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.425537 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901fe60-90dd-4c59-aff6-ed1cca648963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:54.425895 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901fe60-90dd-4c59-aff6-ed1cca648963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:54.427631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901fe60-90dd-4c59-aff6-ed1cca648963 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:54.443648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 431/861] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:54.447487 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091c08f-a891-4029-b042-1dfbefc4d49a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.458586 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a091c08f-a891-4029-b042-1dfbefc4d49a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.463547 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059e572-a378-4154-a121-57412f40501f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.464350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059e572-a378-4154-a121-57412f40501f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.464688 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059e572-a378-4154-a121-57412f40501f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.464970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c059e572-a378-4154-a121-57412f40501f admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.473984 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059e572-a378-4154-a121-57412f40501f admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:54.476129 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c059e572-a378-4154-a121-57412f40501f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:54.492029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-c059e572-a378-4154-a121-57412f40501f admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Feb 12 04:16:54.493607 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 431/862] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:54.499318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901fe60-90dd-4c59-aff6-ed1cca648963 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.510291 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901fe60-90dd-4c59-aff6-ed1cca648963 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.515019 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86612e60-71dc-463e-b758-77f68d3d23a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.515773 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86612e60-71dc-463e-b758-77f68d3d23a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.516060 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86612e60-71dc-463e-b758-77f68d3d23a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.516335 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86612e60-71dc-463e-b758-77f68d3d23a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.517895 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86612e60-71dc-463e-b758-77f68d3d23a3 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:54.518211 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86612e60-71dc-463e-b758-77f68d3d23a3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:54.520383 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86612e60-71dc-463e-b758-77f68d3d23a3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:54.543640 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 432/863] 10.222.0.35 () {56 vars in 1156 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:54.549978 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059e572-a378-4154-a121-57412f40501f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.560571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c059e572-a378-4154-a121-57412f40501f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.565723 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085d93a-b932-4245-94d6-e0919a014a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.566373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085d93a-b932-4245-94d6-e0919a014a5a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.566656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085d93a-b932-4245-94d6-e0919a014a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.566933 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7085d93a-b932-4245-94d6-e0919a014a5a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.575522 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085d93a-b932-4245-94d6-e0919a014a5a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:54.577286 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7085d93a-b932-4245-94d6-e0919a014a5a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:54.586820 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 432/864] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:16:54.592371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86612e60-71dc-463e-b758-77f68d3d23a3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.602474 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86612e60-71dc-463e-b758-77f68d3d23a3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.607089 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c287304-c3c4-4755-8f0f-e3a0dfea09b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.607912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c287304-c3c4-4755-8f0f-e3a0dfea09b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.608194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c287304-c3c4-4755-8f0f-e3a0dfea09b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.608479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c287304-c3c4-4755-8f0f-e3a0dfea09b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.620174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c287304-c3c4-4755-8f0f-e3a0dfea09b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:54.622013 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c287304-c3c4-4755-8f0f-e3a0dfea09b9 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:54.640362 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-8c287304-c3c4-4755-8f0f-e3a0dfea09b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:54.641816 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 433/865] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:54.647360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085d93a-b932-4245-94d6-e0919a014a5a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.656260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7085d93a-b932-4245-94d6-e0919a014a5a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.661181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021318a2-e42c-4f8f-9340-ae74182eaa56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.661829 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021318a2-e42c-4f8f-9340-ae74182eaa56 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.662118 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021318a2-e42c-4f8f-9340-ae74182eaa56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.662390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021318a2-e42c-4f8f-9340-ae74182eaa56 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.663130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021318a2-e42c-4f8f-9340-ae74182eaa56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:54.663469 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021318a2-e42c-4f8f-9340-ae74182eaa56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:54.665046 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021318a2-e42c-4f8f-9340-ae74182eaa56 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:54.677494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 433/866] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:54.683138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c287304-c3c4-4755-8f0f-e3a0dfea09b9 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.693792 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c287304-c3c4-4755-8f0f-e3a0dfea09b9 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.698296 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d95232-68f0-403e-81c0-395566d4b514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.699143 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d95232-68f0-403e-81c0-395566d4b514 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.699459 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d95232-68f0-403e-81c0-395566d4b514 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.699739 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d95232-68f0-403e-81c0-395566d4b514 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.706983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d95232-68f0-403e-81c0-395566d4b514 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:54.709038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d95232-68f0-403e-81c0-395566d4b514 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:54.723647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-36d95232-68f0-403e-81c0-395566d4b514 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:54.724853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 434/867] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:54.730757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021318a2-e42c-4f8f-9340-ae74182eaa56 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.742756 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021318a2-e42c-4f8f-9340-ae74182eaa56 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.747531 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cd115-1292-43fd-9dd4-3e44445827bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.748430 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cd115-1292-43fd-9dd4-3e44445827bf admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.748911 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cd115-1292-43fd-9dd4-3e44445827bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.749383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cd115-1292-43fd-9dd4-3e44445827bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.750376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cd115-1292-43fd-9dd4-3e44445827bf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:54.750914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cd115-1292-43fd-9dd4-3e44445827bf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:54.753247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cd115-1292-43fd-9dd4-3e44445827bf admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:54.767117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 434/868] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:54.776624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d95232-68f0-403e-81c0-395566d4b514 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:54.787801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d95232-68f0-403e-81c0-395566d4b514 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:54.792397 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0399e1-087d-41fc-ba53-1b20634fd38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:54.793085 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0399e1-087d-41fc-ba53-1b20634fd38d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:54.793370 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0399e1-087d-41fc-ba53-1b20634fd38d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:54.793700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0399e1-087d-41fc-ba53-1b20634fd38d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:54.794548 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0399e1-087d-41fc-ba53-1b20634fd38d admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=3b37a10e3b5e404db7aad72e1772a2de) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:54.794871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0399e1-087d-41fc-ba53-1b20634fd38d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:54.796793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0399e1-087d-41fc-ba53-1b20634fd38d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:54.804023 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 435/869] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:54 2022] GET /identity/v3/role_assignments?user.id=3b37a10e3b5e404db7aad72e1772a2de&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:55.395890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c887b-fb30-46c8-a477-fb3d9412ab92 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:55.396510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c887b-fb30-46c8-a477-fb3d9412ab92 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:55.397741 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c887b-fb30-46c8-a477-fb3d9412ab92 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:55.399386 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 435/870] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:55.405032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2ba05-9e61-488b-98f8-394d25462c50 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:55.405578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2ba05-9e61-488b-98f8-394d25462c50 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:55.406071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2ba05-9e61-488b-98f8-394d25462c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:55.425184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-f1f2ba05-9e61-488b-98f8-394d25462c50 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:55.426715 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f1f2ba05-9e61-488b-98f8-394d25462c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:55.437064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 436/871] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:55 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:16:55.466498 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c887b-fb30-46c8-a477-fb3d9412ab92 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:55.479690 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c887b-fb30-46c8-a477-fb3d9412ab92 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:55.484283 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae7310-9918-4f05-9d81-f2b7774ed364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:55.485410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae7310-9918-4f05-9d81-f2b7774ed364 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:55.486359 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae7310-9918-4f05-9d81-f2b7774ed364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:55.486800 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae7310-9918-4f05-9d81-f2b7774ed364 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:55.497440 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cae7310-9918-4f05-9d81-f2b7774ed364 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:55.505073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-9cae7310-9918-4f05-9d81-f2b7774ed364 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 12 04:16:55.506772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 436/872] 10.222.0.35 () {56 vars in 1141 bytes} [Sat Feb 12 04:16:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:55.512591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2ba05-9e61-488b-98f8-394d25462c50 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:55.521915 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2ba05-9e61-488b-98f8-394d25462c50 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:55.526670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c961c4-41da-4905-babd-aa97f33be2c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:55.527564 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c961c4-41da-4905-babd-aa97f33be2c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:55.528016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c961c4-41da-4905-babd-aa97f33be2c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:55.528455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c961c4-41da-4905-babd-aa97f33be2c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:55.529435 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c961c4-41da-4905-babd-aa97f33be2c3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:55.529907 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c961c4-41da-4905-babd-aa97f33be2c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:55.531692 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c961c4-41da-4905-babd-aa97f33be2c3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:55.541316 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 437/873] 10.222.0.35 () {56 vars in 1136 bytes} [Sat Feb 12 04:16:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:55.546889 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae7310-9918-4f05-9d81-f2b7774ed364 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:55.557653 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae7310-9918-4f05-9d81-f2b7774ed364 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:55.562353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9ed4-5f59-4746-a506-000208571f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:55.563958 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9ed4-5f59-4746-a506-000208571f3f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:55.564415 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9ed4-5f59-4746-a506-000208571f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:55.564943 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee9ed4-5f59-4746-a506-000208571f3f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:55.694104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee9ed4-5f59-4746-a506-000208571f3f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:55.696693 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee9ed4-5f59-4746-a506-000208571f3f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:55.716472 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-00ee9ed4-5f59-4746-a506-000208571f3f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:55.718293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 437/874] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:55.725820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c961c4-41da-4905-babd-aa97f33be2c3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:55.737114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c961c4-41da-4905-babd-aa97f33be2c3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:55.741889 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d18032-399a-41bc-9a57-0a7fd57fd7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:55.742757 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d18032-399a-41bc-9a57-0a7fd57fd7ca admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:55.743218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d18032-399a-41bc-9a57-0a7fd57fd7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:55.743710 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d18032-399a-41bc-9a57-0a7fd57fd7ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:55.744621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d18032-399a-41bc-9a57-0a7fd57fd7ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:55.745107 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d18032-399a-41bc-9a57-0a7fd57fd7ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:55.746948 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d18032-399a-41bc-9a57-0a7fd57fd7ca admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:55.760371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 438/875] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:55.765990 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9ed4-5f59-4746-a506-000208571f3f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:55.778160 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee9ed4-5f59-4746-a506-000208571f3f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:55.783834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86be5b6-8474-4bac-9d9c-b4c504956549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:55.784903 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86be5b6-8474-4bac-9d9c-b4c504956549 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:55.785363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86be5b6-8474-4bac-9d9c-b4c504956549 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:55.785825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86be5b6-8474-4bac-9d9c-b4c504956549 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:55.794750 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86be5b6-8474-4bac-9d9c-b4c504956549 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:55.797189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86be5b6-8474-4bac-9d9c-b4c504956549 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:55.814294 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-b86be5b6-8474-4bac-9d9c-b4c504956549 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 12 04:16:55.816234 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 438/876] 10.222.0.35 () {56 vars in 1138 bytes} [Sat Feb 12 04:16:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:55.822160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d18032-399a-41bc-9a57-0a7fd57fd7ca admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:55.832298 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d18032-399a-41bc-9a57-0a7fd57fd7ca admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:55.836976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b916efd-0eb5-46c6-9e9c-e1be66deb25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:55.837881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b916efd-0eb5-46c6-9e9c-e1be66deb25f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:55.838382 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b916efd-0eb5-46c6-9e9c-e1be66deb25f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:55.838834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b916efd-0eb5-46c6-9e9c-e1be66deb25f admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:55.839898 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b916efd-0eb5-46c6-9e9c-e1be66deb25f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:55.840426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b916efd-0eb5-46c6-9e9c-e1be66deb25f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:55.842438 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b916efd-0eb5-46c6-9e9c-e1be66deb25f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:55.861177 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 439/877] 10.222.0.35 () {56 vars in 1170 bytes} [Sat Feb 12 04:16:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:55.866797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86be5b6-8474-4bac-9d9c-b4c504956549 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:55.877355 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86be5b6-8474-4bac-9d9c-b4c504956549 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:55.882069 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0899ac-2133-4446-8e6e-ab81f0d08ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:55.882989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0899ac-2133-4446-8e6e-ab81f0d08ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:55.883475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0899ac-2133-4446-8e6e-ab81f0d08ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:55.883936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0899ac-2133-4446-8e6e-ab81f0d08ec9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:55.892316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0899ac-2133-4446-8e6e-ab81f0d08ec9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:55.894324 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0899ac-2133-4446-8e6e-ab81f0d08ec9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:55.903620 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 439/878] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:16:55 2022] GET /identity/v3/auth/tokens => generated 1452 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:16:55.909325 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b916efd-0eb5-46c6-9e9c-e1be66deb25f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:55.919423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b916efd-0eb5-46c6-9e9c-e1be66deb25f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:55.925176 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8e870-4f6b-4e76-b994-995a692a0384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:55.925970 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8e870-4f6b-4e76-b994-995a692a0384 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:55.926253 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8e870-4f6b-4e76-b994-995a692a0384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:55.926527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8e870-4f6b-4e76-b994-995a692a0384 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:55.943174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8e870-4f6b-4e76-b994-995a692a0384 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:55.945054 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8e870-4f6b-4e76-b994-995a692a0384 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:55.962878 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-aef8e870-4f6b-4e76-b994-995a692a0384 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:55.964089 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 440/879] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:16:55.969605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0899ac-2133-4446-8e6e-ab81f0d08ec9 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:55.978645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0899ac-2133-4446-8e6e-ab81f0d08ec9 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:55.983187 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a87cde-d210-4c8b-a566-9cb999dc5891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:55.983864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a87cde-d210-4c8b-a566-9cb999dc5891 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:55.984147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a87cde-d210-4c8b-a566-9cb999dc5891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:55.984420 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a87cde-d210-4c8b-a566-9cb999dc5891 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:55.985159 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a87cde-d210-4c8b-a566-9cb999dc5891 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:55.985988 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a87cde-d210-4c8b-a566-9cb999dc5891 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:55.987751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a87cde-d210-4c8b-a566-9cb999dc5891 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:56.000150 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 440/880] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:56.005811 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8e870-4f6b-4e76-b994-995a692a0384 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:56.016302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8e870-4f6b-4e76-b994-995a692a0384 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:56.022140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a22063-0c7e-4de5-9126-1905de985b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:56.022948 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a22063-0c7e-4de5-9126-1905de985b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:56.023266 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a22063-0c7e-4de5-9126-1905de985b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:56.023545 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a22063-0c7e-4de5-9126-1905de985b84 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:56.031135 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a22063-0c7e-4de5-9126-1905de985b84 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:56.033235 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a22063-0c7e-4de5-9126-1905de985b84 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:56.046630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-f1a22063-0c7e-4de5-9126-1905de985b84 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:56.048595 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 441/881] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:56.054274 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a87cde-d210-4c8b-a566-9cb999dc5891 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:56.064867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a87cde-d210-4c8b-a566-9cb999dc5891 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:56.069429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59688e14-d92e-4a28-b05d-f56e7c1a07d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:56.070066 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59688e14-d92e-4a28-b05d-f56e7c1a07d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:56.070346 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59688e14-d92e-4a28-b05d-f56e7c1a07d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:56.070618 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59688e14-d92e-4a28-b05d-f56e7c1a07d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:56.071454 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59688e14-d92e-4a28-b05d-f56e7c1a07d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:56.071759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59688e14-d92e-4a28-b05d-f56e7c1a07d5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:56.073591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59688e14-d92e-4a28-b05d-f56e7c1a07d5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:56.086322 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 441/882] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:56.090823 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144de76-514b-4d88-bd37-aeb364aa1eae None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:56.091388 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144de76-514b-4d88-bd37-aeb364aa1eae None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:56.091709 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144de76-514b-4d88-bd37-aeb364aa1eae None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:56.092067 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59688e14-d92e-4a28-b05d-f56e7c1a07d5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:56.093723 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 442/883] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:56.099082 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa75d1-4cce-4e96-a883-5d5653c3d43d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:56.099395 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa75d1-4cce-4e96-a883-5d5653c3d43d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:56.099666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa75d1-4cce-4e96-a883-5d5653c3d43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:56.105623 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59688e14-d92e-4a28-b05d-f56e7c1a07d5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:56.115731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167de4a-48a2-4fff-9492-951ed70cff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:56.115731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167de4a-48a2-4fff-9492-951ed70cff9a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:56.115731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167de4a-48a2-4fff-9492-951ed70cff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:56.115731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3167de4a-48a2-4fff-9492-951ed70cff9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:56.116091 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167de4a-48a2-4fff-9492-951ed70cff9a admin admin] RBAC: Adding query filter params (role.id=b69fe879299a4dba8bb1feb6600f3943, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=560fd9efb8a04f449acaf2f3987ce81c) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:56.116091 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167de4a-48a2-4fff-9492-951ed70cff9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:56.117423 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3167de4a-48a2-4fff-9492-951ed70cff9a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:56.122635 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-9cfa75d1-4cce-4e96-a883-5d5653c3d43d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:56.123624 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 442/884] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:16:56 2022] GET /identity/v3/role_assignments?user.id=560fd9efb8a04f449acaf2f3987ce81c&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=b69fe879299a4dba8bb1feb6600f3943 => generated 259 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:56.124393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9cfa75d1-4cce-4e96-a883-5d5653c3d43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:56.143450 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 443/885] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:56 2022] POST /identity/v3/auth/tokens => generated 1452 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:16:56.161412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167de4a-48a2-4fff-9492-951ed70cff9a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:56.171803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3167de4a-48a2-4fff-9492-951ed70cff9a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:56.177462 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa0e32c-02a8-4fab-95d6-566b9cce27d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:56.178243 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0e32c-02a8-4fab-95d6-566b9cce27d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:56.178521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0e32c-02a8-4fab-95d6-566b9cce27d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:56.178790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa0e32c-02a8-4fab-95d6-566b9cce27d4 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:56.179898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0e32c-02a8-4fab-95d6-566b9cce27d4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:56.181094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-9fa0e32c-02a8-4fab-95d6-566b9cce27d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:16:56.181094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:16:56.181094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:16:56.181995 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa0e32c-02a8-4fab-95d6-566b9cce27d4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:56.265571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 443/886] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Feb 12 04:16:56 2022] POST /identity/v3/services => generated 269 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:56.767633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d88efe-ec40-4e83-9277-c74c31b37917 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:56.768670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d88efe-ec40-4e83-9277-c74c31b37917 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:56.769191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d88efe-ec40-4e83-9277-c74c31b37917 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:56.771412 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 444/887] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:56.776916 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e3cc0-a793-4d70-9f57-a2f99acafc03 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:56.777739 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e3cc0-a793-4d70-9f57-a2f99acafc03 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:56.778235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e3cc0-a793-4d70-9f57-a2f99acafc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:56.796738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-a38e3cc0-a793-4d70-9f57-a2f99acafc03 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:56.798323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a38e3cc0-a793-4d70-9f57-a2f99acafc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:56.814820 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 444/888] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:56 2022] POST /identity/v3/auth/tokens => generated 1562 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:56.838384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d88efe-ec40-4e83-9277-c74c31b37917 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:56.850928 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d88efe-ec40-4e83-9277-c74c31b37917 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:56.855559 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef24a9-b267-459f-92f4-fa6eeb9712db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:56.856425 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef24a9-b267-459f-92f4-fa6eeb9712db admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:56.856898 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef24a9-b267-459f-92f4-fa6eeb9712db admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:56.857360 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef24a9-b267-459f-92f4-fa6eeb9712db admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:56.858357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef24a9-b267-459f-92f4-fa6eeb9712db admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:56.860691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef24a9-b267-459f-92f4-fa6eeb9712db admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:56.960596 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 445/889] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Feb 12 04:16:56 2022] POST /identity/v3/services => generated 251 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:16:57.177053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bc846-2b27-4c53-a539-7957094cc0ef None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:57.177425 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bc846-2b27-4c53-a539-7957094cc0ef None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:57.177629 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bc846-2b27-4c53-a539-7957094cc0ef None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:57.179946 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 445/890] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:57.185295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83670ac0-afd8-44b9-b8c2-c923340ec5fd None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:57.185822 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83670ac0-afd8-44b9-b8c2-c923340ec5fd None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:57.186315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83670ac0-afd8-44b9-b8c2-c923340ec5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:57.205181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-83670ac0-afd8-44b9-b8c2-c923340ec5fd None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:57.206731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-83670ac0-afd8-44b9-b8c2-c923340ec5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:57.224865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 446/891] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:57 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:57.250645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bc846-2b27-4c53-a539-7957094cc0ef None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:57.264142 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bc846-2b27-4c53-a539-7957094cc0ef None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:57.269535 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd974ad8-39e2-4d68-9217-0f6c45689ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:57.270573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd974ad8-39e2-4d68-9217-0f6c45689ebd admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:57.271055 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd974ad8-39e2-4d68-9217-0f6c45689ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:57.271556 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd974ad8-39e2-4d68-9217-0f6c45689ebd admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:57.272451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd974ad8-39e2-4d68-9217-0f6c45689ebd admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:57.274248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd974ad8-39e2-4d68-9217-0f6c45689ebd admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:57.286835 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-cd974ad8-39e2-4d68-9217-0f6c45689ebd admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 12 04:16:57.288383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 446/892] 10.222.0.35 () {56 vars in 1147 bytes} [Sat Feb 12 04:16:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:57.294433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83670ac0-afd8-44b9-b8c2-c923340ec5fd None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:57.304916 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83670ac0-afd8-44b9-b8c2-c923340ec5fd None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:57.309697 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4354f3f-e2aa-4e0f-9d02-9db8e4b285ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:57.310374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354f3f-e2aa-4e0f-9d02-9db8e4b285ec admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:57.310660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354f3f-e2aa-4e0f-9d02-9db8e4b285ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:57.310939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4354f3f-e2aa-4e0f-9d02-9db8e4b285ec admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:57.311715 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4354f3f-e2aa-4e0f-9d02-9db8e4b285ec admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:57.312027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4354f3f-e2aa-4e0f-9d02-9db8e4b285ec admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:57.313686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4354f3f-e2aa-4e0f-9d02-9db8e4b285ec admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:57.319483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 447/893] 10.222.0.35 () {56 vars in 1143 bytes} [Sat Feb 12 04:16:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:57.325097 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd974ad8-39e2-4d68-9217-0f6c45689ebd admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:57.335891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd974ad8-39e2-4d68-9217-0f6c45689ebd admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:57.340610 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e086f-c8dc-4a97-84a6-dd73c3c42cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:57.341264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e086f-c8dc-4a97-84a6-dd73c3c42cf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:57.341599 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e086f-c8dc-4a97-84a6-dd73c3c42cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:57.341879 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e086f-c8dc-4a97-84a6-dd73c3c42cf6 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:57.342608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e086f-c8dc-4a97-84a6-dd73c3c42cf6 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:57.342911 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e086f-c8dc-4a97-84a6-dd73c3c42cf6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:57.344696 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e086f-c8dc-4a97-84a6-dd73c3c42cf6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:57.350515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 447/894] 10.222.0.35 () {56 vars in 1143 bytes} [Sat Feb 12 04:16:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:58.466846 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8945f4-334d-4021-9d7c-829c58531c4e None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.467403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8945f4-334d-4021-9d7c-829c58531c4e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.467481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8945f4-334d-4021-9d7c-829c58531c4e None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.469586 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 448/895] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:58.475464 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3a4ff-c7c0-4300-a4d4-95002bf0fc83 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.475860 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3a4ff-c7c0-4300-a4d4-95002bf0fc83 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.476039 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3a4ff-c7c0-4300-a4d4-95002bf0fc83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.494769 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-46a3a4ff-c7c0-4300-a4d4-95002bf0fc83 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:58.495998 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-46a3a4ff-c7c0-4300-a4d4-95002bf0fc83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:58.505309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 448/896] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:58 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:58.529820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8945f4-334d-4021-9d7c-829c58531c4e None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.542455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8945f4-334d-4021-9d7c-829c58531c4e None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:58.547013 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4f33f-d610-4fb0-9f49-07dc08a575d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:58.548046 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4f33f-d610-4fb0-9f49-07dc08a575d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.548550 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4f33f-d610-4fb0-9f49-07dc08a575d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.548976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb4f33f-d610-4fb0-9f49-07dc08a575d0 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.549391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6efb75-e805-4948-8ae3-350e1b1c8ed2 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.549975 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6efb75-e805-4948-8ae3-350e1b1c8ed2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.550447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6efb75-e805-4948-8ae3-350e1b1c8ed2 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.552690 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 449/897] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:16:58.558700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3e20a-6fe5-4e1e-a8b8-563757836736 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.559492 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3e20a-6fe5-4e1e-a8b8-563757836736 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.559894 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3e20a-6fe5-4e1e-a8b8-563757836736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.560671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb4f33f-d610-4fb0-9f49-07dc08a575d0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:16:58.569026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-1cb4f33f-d610-4fb0-9f49-07dc08a575d0 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 12 04:16:58.570720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 449/898] 10.222.0.35 () {56 vars in 1141 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:58.576503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4f33f-d610-4fb0-9f49-07dc08a575d0 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.578543 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-24e3e20a-6fe5-4e1e-a8b8-563757836736 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:58.580412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-24e3e20a-6fe5-4e1e-a8b8-563757836736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:58.588485 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb4f33f-d610-4fb0-9f49-07dc08a575d0 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:58.595396 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 450/899] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:58 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:58.598500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f7217-85a4-4c2d-984a-2be014ff8cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:58.599417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f7217-85a4-4c2d-984a-2be014ff8cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.599888 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f7217-85a4-4c2d-984a-2be014ff8cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.600331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f7217-85a4-4c2d-984a-2be014ff8cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.601262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f7217-85a4-4c2d-984a-2be014ff8cf1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:58.601755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f7217-85a4-4c2d-984a-2be014ff8cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:58.603524 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f7217-85a4-4c2d-984a-2be014ff8cf1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:58.612507 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 450/900] 10.222.0.35 () {56 vars in 1136 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:58.617156 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3e20a-6fe5-4e1e-a8b8-563757836736 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.618217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f7217-85a4-4c2d-984a-2be014ff8cf1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.623954 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3e20a-6fe5-4e1e-a8b8-563757836736 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:58.628543 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f7217-85a4-4c2d-984a-2be014ff8cf1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:58.630020 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e5ac-196e-488a-a942-6e8fc7a40cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:58.630974 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e5ac-196e-488a-a942-6e8fc7a40cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.631420 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e5ac-196e-488a-a942-6e8fc7a40cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.631776 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c9e5ac-196e-488a-a942-6e8fc7a40cd9 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.632602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9e5ac-196e-488a-a942-6e8fc7a40cd9 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:58.634281 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c4bb5-ce7f-4602-a889-1e47539c7c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:58.634401 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c9e5ac-196e-488a-a942-6e8fc7a40cd9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:58.635378 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4bb5-ce7f-4602-a889-1e47539c7c66 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.635854 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4bb5-ce7f-4602-a889-1e47539c7c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.636306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c4bb5-ce7f-4602-a889-1e47539c7c66 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.647333 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c4bb5-ce7f-4602-a889-1e47539c7c66 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:58.648144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-e6c9e5ac-196e-488a-a942-6e8fc7a40cd9 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 12 04:16:58.649634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c4bb5-ce7f-4602-a889-1e47539c7c66 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:58.651304 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 451/901] 10.222.0.35 () {56 vars in 1153 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:58.655529 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e5ac-196e-488a-a942-6e8fc7a40cd9 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.665683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c9e5ac-196e-488a-a942-6e8fc7a40cd9 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:58.670590 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd8b68-7e3f-4127-9f02-84a5148903aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:58.671605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd8b68-7e3f-4127-9f02-84a5148903aa admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.672102 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd8b68-7e3f-4127-9f02-84a5148903aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.672615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfd8b68-7e3f-4127-9f02-84a5148903aa admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.673551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd8b68-7e3f-4127-9f02-84a5148903aa admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:58.673758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-7c2c4bb5-ce7f-4602-a889-1e47539c7c66 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:58.674268 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd8b68-7e3f-4127-9f02-84a5148903aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:58.674954 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 451/902] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:58.676427 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfd8b68-7e3f-4127-9f02-84a5148903aa admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:58.680980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c4bb5-ce7f-4602-a889-1e47539c7c66 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.682352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 452/903] 10.222.0.35 () {56 vars in 1147 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:58.689261 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd8b68-7e3f-4127-9f02-84a5148903aa admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.693312 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c4bb5-ce7f-4602-a889-1e47539c7c66 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:58.697763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d31dc6-bd21-4ab2-85c9-8494c5baf004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:58.698413 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31dc6-bd21-4ab2-85c9-8494c5baf004 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.698689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31dc6-bd21-4ab2-85c9-8494c5baf004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.698957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d31dc6-bd21-4ab2-85c9-8494c5baf004 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.699782 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d31dc6-bd21-4ab2-85c9-8494c5baf004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:58.700083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d31dc6-bd21-4ab2-85c9-8494c5baf004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:58.701429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfd8b68-7e3f-4127-9f02-84a5148903aa admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:58.701653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d31dc6-bd21-4ab2-85c9-8494c5baf004 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:58.706578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e06de-8eb4-41bc-9c1e-5e85cd63a522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:58.707549 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e06de-8eb4-41bc-9c1e-5e85cd63a522 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.708088 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e06de-8eb4-41bc-9c1e-5e85cd63a522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.708569 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e06de-8eb4-41bc-9c1e-5e85cd63a522 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.709524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e06de-8eb4-41bc-9c1e-5e85cd63a522 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:58.710032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e06de-8eb4-41bc-9c1e-5e85cd63a522 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:58.711883 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e06de-8eb4-41bc-9c1e-5e85cd63a522 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:58.722409 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 452/905] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:58.722562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 453/905] 10.222.0.35 () {56 vars in 1147 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:58.722651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d31dc6-bd21-4ab2-85c9-8494c5baf004 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.724077 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e06de-8eb4-41bc-9c1e-5e85cd63a522 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.733261 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d31dc6-bd21-4ab2-85c9-8494c5baf004 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:58.738043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e06de-8eb4-41bc-9c1e-5e85cd63a522 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:58.738611 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3ebca-081d-428e-b9f6-1c472c449ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:58.739673 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3ebca-081d-428e-b9f6-1c472c449ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.740154 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3ebca-081d-428e-b9f6-1c472c449ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.740647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3ebca-081d-428e-b9f6-1c472c449ce8 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.742893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a325b7-29a5-4336-b790-7435c2cf8dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:58.743611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a325b7-29a5-4336-b790-7435c2cf8dd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.744398 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a325b7-29a5-4336-b790-7435c2cf8dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.744737 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a325b7-29a5-4336-b790-7435c2cf8dd1 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.745547 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a325b7-29a5-4336-b790-7435c2cf8dd1 admin admin] RBAC: Adding query filter params (interface=public, service_id=0d94102d6c1d40f58c9521af231996bf, region_id=RegionOne) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:58.745855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a325b7-29a5-4336-b790-7435c2cf8dd1 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:58.747552 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a325b7-29a5-4336-b790-7435c2cf8dd1 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:58.750424 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3ebca-081d-428e-b9f6-1c472c449ce8 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:58.753177 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea3ebca-081d-428e-b9f6-1c472c449ce8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:58.754545 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 454/906] 10.222.0.35 () {56 vars in 1272 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/endpoints?service_id=0d94102d6c1d40f58c9521af231996bf&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:58.759866 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a325b7-29a5-4336-b790-7435c2cf8dd1 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.770469 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a325b7-29a5-4336-b790-7435c2cf8dd1 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:58.774417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-5ea3ebca-081d-428e-b9f6-1c472c449ce8 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 12 04:16:58.775319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0120dd2-9a9f-4e83-be1b-8d8ad6e29695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:58.781137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0120dd2-9a9f-4e83-be1b-8d8ad6e29695 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.781137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0120dd2-9a9f-4e83-be1b-8d8ad6e29695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.781137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0120dd2-9a9f-4e83-be1b-8d8ad6e29695 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.781137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0120dd2-9a9f-4e83-be1b-8d8ad6e29695 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:58.781137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0120dd2-9a9f-4e83-be1b-8d8ad6e29695 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:58.781892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 453/907] 10.222.0.35 () {56 vars in 1138 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:58.783677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3ebca-081d-428e-b9f6-1c472c449ce8 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.788443 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 455/908] 10.222.0.35 () {56 vars in 1108 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/services => generated 1268 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:16:58.793648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3ebca-081d-428e-b9f6-1c472c449ce8 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:58.798829 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefc1df-a988-41a2-b8c6-e8bf02a5bbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:58.799558 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefc1df-a988-41a2-b8c6-e8bf02a5bbed admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.799841 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefc1df-a988-41a2-b8c6-e8bf02a5bbed admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.800117 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fefc1df-a988-41a2-b8c6-e8bf02a5bbed admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.801004 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefc1df-a988-41a2-b8c6-e8bf02a5bbed admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:58.801308 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefc1df-a988-41a2-b8c6-e8bf02a5bbed admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:58.803200 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fefc1df-a988-41a2-b8c6-e8bf02a5bbed admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:58.829035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 454/909] 10.222.0.35 () {56 vars in 1170 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:58.830899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0120dd2-9a9f-4e83-be1b-8d8ad6e29695 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.841749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0120dd2-9a9f-4e83-be1b-8d8ad6e29695 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:58.846691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2d9d4-6b62-434a-975d-ba88e14e6bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:58.847608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2d9d4-6b62-434a-975d-ba88e14e6bef admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.847899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2d9d4-6b62-434a-975d-ba88e14e6bef admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.848178 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2d9d4-6b62-434a-975d-ba88e14e6bef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.861607 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2d9d4-6b62-434a-975d-ba88e14e6bef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:58.863766 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2d9d4-6b62-434a-975d-ba88e14e6bef admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:58.884198 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-f9e2d9d4-6b62-434a-975d-ba88e14e6bef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:16:58.885816 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 456/910] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:58.891380 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefc1df-a988-41a2-b8c6-e8bf02a5bbed admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.901929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fefc1df-a988-41a2-b8c6-e8bf02a5bbed admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:58.906817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66055162-23f1-4094-8116-d5978e4ee5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:58.907854 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055162-23f1-4094-8116-d5978e4ee5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.908350 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055162-23f1-4094-8116-d5978e4ee5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.908846 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055162-23f1-4094-8116-d5978e4ee5f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.909789 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66055162-23f1-4094-8116-d5978e4ee5f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:58.910308 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66055162-23f1-4094-8116-d5978e4ee5f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:58.912152 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66055162-23f1-4094-8116-d5978e4ee5f0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:58.930441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 455/911] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:58.932198 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2d9d4-6b62-434a-975d-ba88e14e6bef admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.945546 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2d9d4-6b62-434a-975d-ba88e14e6bef admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:58.950366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfdc53-904b-485f-80bc-9d70be89013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:58.951165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfdc53-904b-485f-80bc-9d70be89013c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:58.951478 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfdc53-904b-485f-80bc-9d70be89013c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:58.951813 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfdc53-904b-485f-80bc-9d70be89013c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:58.960905 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfdc53-904b-485f-80bc-9d70be89013c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:58.962938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfdc53-904b-485f-80bc-9d70be89013c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:58.978092 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-93dfdc53-904b-485f-80bc-9d70be89013c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:16:58.979713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 457/912] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:58.986444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66055162-23f1-4094-8116-d5978e4ee5f0 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:58.997635 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66055162-23f1-4094-8116-d5978e4ee5f0 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:59.003318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070c839-f3fb-4363-aecc-9edb92926974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:59.003987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c839-f3fb-4363-aecc-9edb92926974 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:59.004273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c839-f3fb-4363-aecc-9edb92926974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:59.004551 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070c839-f3fb-4363-aecc-9edb92926974 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:59.005359 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070c839-f3fb-4363-aecc-9edb92926974 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:59.005667 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070c839-f3fb-4363-aecc-9edb92926974 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:59.007538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070c839-f3fb-4363-aecc-9edb92926974 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:59.020659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 456/913] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:59.026203 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfdc53-904b-485f-80bc-9d70be89013c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:59.036578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfdc53-904b-485f-80bc-9d70be89013c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:59.041154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50a14f-7cbe-4ed7-baad-dae969ef0922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:59.042028 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50a14f-7cbe-4ed7-baad-dae969ef0922 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:59.042311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50a14f-7cbe-4ed7-baad-dae969ef0922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:59.042585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50a14f-7cbe-4ed7-baad-dae969ef0922 admin admin] PATH_INFO: `/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/560fd9efb8a04f449acaf2f3987ce81c/roles/b69fe879299a4dba8bb1feb6600f3943` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:59.044964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50a14f-7cbe-4ed7-baad-dae969ef0922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e546ab571490aa0b23c0b22a35c4f, user_id=560fd9efb8a04f449acaf2f3987ce81c, role_id=b69fe879299a4dba8bb1feb6600f3943)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:59.048281 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50a14f-7cbe-4ed7-baad-dae969ef0922 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:59.129551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 458/914] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:16:59 2022] PUT /identity/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/560fd9efb8a04f449acaf2f3987ce81c/roles/b69fe879299a4dba8bb1feb6600f3943 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:16:59.261267 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994207-c4bc-4cb7-888a-eb738bd09c43 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:59.261623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994207-c4bc-4cb7-888a-eb738bd09c43 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:59.261817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02994207-c4bc-4cb7-888a-eb738bd09c43 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:59.263939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 457/915] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:59.269789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba34334-e6e7-4b35-9171-e15beb97f405 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:59.270101 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba34334-e6e7-4b35-9171-e15beb97f405 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:59.270346 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba34334-e6e7-4b35-9171-e15beb97f405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:59.290118 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-1ba34334-e6e7-4b35-9171-e15beb97f405 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:59.291251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-1ba34334-e6e7-4b35-9171-e15beb97f405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:59.351592 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 459/916] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:59 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:16:59.375771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02994207-c4bc-4cb7-888a-eb738bd09c43 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:59.388570 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02994207-c4bc-4cb7-888a-eb738bd09c43 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:59.393627 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d35c3-0aaf-4a1a-ad47-9ced5db13eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:59.394401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d35c3-0aaf-4a1a-ad47-9ced5db13eef admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:59.394741 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d35c3-0aaf-4a1a-ad47-9ced5db13eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:59.395023 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d35c3-0aaf-4a1a-ad47-9ced5db13eef admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:59.395720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d35c3-0aaf-4a1a-ad47-9ced5db13eef admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:59.397411 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d35c3-0aaf-4a1a-ad47-9ced5db13eef admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:59.409903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-d20d35c3-0aaf-4a1a-ad47-9ced5db13eef admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 12 04:16:59.411416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 458/917] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:16:59.417471 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba34334-e6e7-4b35-9171-e15beb97f405 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:59.427750 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba34334-e6e7-4b35-9171-e15beb97f405 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:59.437492 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649e945-0af6-4634-8be7-6d424ef434fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:59.437492 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649e945-0af6-4634-8be7-6d424ef434fe admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:59.437492 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649e945-0af6-4634-8be7-6d424ef434fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:59.437492 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649e945-0af6-4634-8be7-6d424ef434fe admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:59.438132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649e945-0af6-4634-8be7-6d424ef434fe admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:59.438132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649e945-0af6-4634-8be7-6d424ef434fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:59.438132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649e945-0af6-4634-8be7-6d424ef434fe admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:59.443983 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 460/918] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:59.450098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d35c3-0aaf-4a1a-ad47-9ced5db13eef admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:59.461043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d35c3-0aaf-4a1a-ad47-9ced5db13eef admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:59.465875 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97542a79-8b12-40fc-9808-244f51250467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:59.466534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97542a79-8b12-40fc-9808-244f51250467 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:59.466883 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97542a79-8b12-40fc-9808-244f51250467 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:59.467503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97542a79-8b12-40fc-9808-244f51250467 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:59.467948 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97542a79-8b12-40fc-9808-244f51250467 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:59.472419 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97542a79-8b12-40fc-9808-244f51250467 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:59.472419 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97542a79-8b12-40fc-9808-244f51250467 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:59.476232 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 459/919] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:16:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:16:59.482033 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649e945-0af6-4634-8be7-6d424ef434fe admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:59.492854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649e945-0af6-4634-8be7-6d424ef434fe admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:59.497519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c4bcf-bf2b-4591-af65-58494f7d2698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:59.498222 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c4bcf-bf2b-4591-af65-58494f7d2698 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:59.498512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c4bcf-bf2b-4591-af65-58494f7d2698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:59.498844 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c4bcf-bf2b-4591-af65-58494f7d2698 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:59.499695 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c4bcf-bf2b-4591-af65-58494f7d2698 admin admin] RBAC: Adding query filter params (interface=public, service_id=60ae126b109f40729dbe4ff5b0918c7e, region_id=RegionOne) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:16:59.500062 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c4bcf-bf2b-4591-af65-58494f7d2698 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:59.502706 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4c4bcf-bf2b-4591-af65-58494f7d2698 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:59.508661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 461/920] 10.222.0.35 () {56 vars in 1272 bytes} [Sat Feb 12 04:16:59 2022] GET /identity/v3/endpoints?service_id=60ae126b109f40729dbe4ff5b0918c7e&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:16:59.514138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97542a79-8b12-40fc-9808-244f51250467 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:59.524953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97542a79-8b12-40fc-9808-244f51250467 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:59.529861 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d8ddd8-7026-4c2b-b478-e4c01591062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:59.530518 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8ddd8-7026-4c2b-b478-e4c01591062f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:59.530863 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8ddd8-7026-4c2b-b478-e4c01591062f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:59.531204 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d8ddd8-7026-4c2b-b478-e4c01591062f admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:59.532641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8ddd8-7026-4c2b-b478-e4c01591062f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:59.534516 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d8ddd8-7026-4c2b-b478-e4c01591062f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:59.541201 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 460/921] 10.222.0.35 () {56 vars in 1108 bytes} [Sat Feb 12 04:16:59 2022] GET /identity/v3/services => generated 1268 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:16:59.726178 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a2c3e-7e81-458b-a6a9-2becf91cf67e None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:59.726178 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a2c3e-7e81-458b-a6a9-2becf91cf67e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:59.726421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a2c3e-7e81-458b-a6a9-2becf91cf67e None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:59.728368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 462/922] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:16:59.734840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe86fcb-2141-4ebf-bb3b-2ebed6ae2758 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:59.735724 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe86fcb-2141-4ebf-bb3b-2ebed6ae2758 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:59.736106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe86fcb-2141-4ebf-bb3b-2ebed6ae2758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:59.757909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-bbe86fcb-2141-4ebf-bb3b-2ebed6ae2758 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:16:59.759155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-bbe86fcb-2141-4ebf-bb3b-2ebed6ae2758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:16:59.768062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 461/923] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:16:59 2022] POST /identity/v3/auth/tokens => generated 1663 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:16:59.791847 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a2c3e-7e81-458b-a6a9-2becf91cf67e None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:16:59.804256 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a2c3e-7e81-458b-a6a9-2becf91cf67e None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:16:59.809163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a39b4f-717c-4001-b7fe-c7cc22a9dd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:16:59.809866 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a39b4f-717c-4001-b7fe-c7cc22a9dd82 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:16:59.810147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a39b4f-717c-4001-b7fe-c7cc22a9dd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:16:59.810424 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a39b4f-717c-4001-b7fe-c7cc22a9dd82 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:16:59.811239 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a39b4f-717c-4001-b7fe-c7cc22a9dd82 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:16:59.812885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a39b4f-717c-4001-b7fe-c7cc22a9dd82 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:16:59.886186 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 463/924] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Feb 12 04:16:59 2022] POST /identity/v3/services => generated 241 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:17:01.116528 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530d273-2696-47c7-ae13-a934b27a63c3 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.117064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530d273-2696-47c7-ae13-a934b27a63c3 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.117064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d530d273-2696-47c7-ae13-a934b27a63c3 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.119142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 462/925] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:01.125415 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ce255-c8b5-46c0-9afd-669bbfc338ff None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.126980 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ce255-c8b5-46c0-9afd-669bbfc338ff None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.127487 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ce255-c8b5-46c0-9afd-669bbfc338ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.149089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-c46ce255-c8b5-46c0-9afd-669bbfc338ff None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:01.150653 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c46ce255-c8b5-46c0-9afd-669bbfc338ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:01.171079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 464/926] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:01 2022] POST /identity/v3/auth/tokens => generated 1765 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:17:01.196738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530d273-2696-47c7-ae13-a934b27a63c3 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:01.212597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d530d273-2696-47c7-ae13-a934b27a63c3 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:01.217702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e03c7-f6d1-4208-817f-eaf7cd8a5748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:01.218809 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e03c7-f6d1-4208-817f-eaf7cd8a5748 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.219353 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e03c7-f6d1-4208-817f-eaf7cd8a5748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.219843 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e03c7-f6d1-4208-817f-eaf7cd8a5748 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.220710 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e03c7-f6d1-4208-817f-eaf7cd8a5748 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:01.222500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413e03c7-f6d1-4208-817f-eaf7cd8a5748 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:01.236527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-413e03c7-f6d1-4208-817f-eaf7cd8a5748 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Feb 12 04:17:01.238360 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 463/927] 10.222.0.35 () {56 vars in 1153 bytes} [Sat Feb 12 04:17:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:01.245390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ce255-c8b5-46c0-9afd-669bbfc338ff None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:01.256954 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ce255-c8b5-46c0-9afd-669bbfc338ff None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:01.264460 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b13216-c394-4cb9-a05e-7cb57b6813d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:01.265656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13216-c394-4cb9-a05e-7cb57b6813d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.266153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13216-c394-4cb9-a05e-7cb57b6813d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.266658 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b13216-c394-4cb9-a05e-7cb57b6813d6 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.267812 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b13216-c394-4cb9-a05e-7cb57b6813d6 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:01.268332 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b13216-c394-4cb9-a05e-7cb57b6813d6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:01.270151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b13216-c394-4cb9-a05e-7cb57b6813d6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:01.276303 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 465/928] 10.222.0.35 () {56 vars in 1147 bytes} [Sat Feb 12 04:17:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:01.287548 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e03c7-f6d1-4208-817f-eaf7cd8a5748 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:01.293088 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e03c7-f6d1-4208-817f-eaf7cd8a5748 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:01.298396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9abbda-1ddd-4989-98bd-465ae3c86ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:01.299050 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9abbda-1ddd-4989-98bd-465ae3c86ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.299367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9abbda-1ddd-4989-98bd-465ae3c86ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.299647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9abbda-1ddd-4989-98bd-465ae3c86ba3 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.300373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9abbda-1ddd-4989-98bd-465ae3c86ba3 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:01.300677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9abbda-1ddd-4989-98bd-465ae3c86ba3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:01.302895 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9abbda-1ddd-4989-98bd-465ae3c86ba3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:01.312035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 464/929] 10.222.0.35 () {56 vars in 1147 bytes} [Sat Feb 12 04:17:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:01.318554 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b13216-c394-4cb9-a05e-7cb57b6813d6 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:01.328471 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b13216-c394-4cb9-a05e-7cb57b6813d6 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:01.335162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f10206-9205-49e6-9dce-c76f43369d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:01.335162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f10206-9205-49e6-9dce-c76f43369d6c admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.335162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f10206-9205-49e6-9dce-c76f43369d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.335162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f10206-9205-49e6-9dce-c76f43369d6c admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.335514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f10206-9205-49e6-9dce-c76f43369d6c admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:01.337646 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f10206-9205-49e6-9dce-c76f43369d6c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:01.433495 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 466/930] 10.222.0.35 () {60 vars in 1165 bytes} [Sat Feb 12 04:17:01 2022] POST /identity/v3/endpoints => generated 347 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:17:01.469802 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bee85-159e-48d9-901b-f913add075c2 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.470437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bee85-159e-48d9-901b-f913add075c2 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.470800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03bee85-159e-48d9-901b-f913add075c2 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.472849 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 465/931] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:01.478987 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed776e-0198-4e4d-bf99-060645043f87 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.479522 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed776e-0198-4e4d-bf99-060645043f87 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.480020 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed776e-0198-4e4d-bf99-060645043f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.500716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-2eed776e-0198-4e4d-bf99-060645043f87 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:01.502856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2eed776e-0198-4e4d-bf99-060645043f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:01.534255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 467/932] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:01 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:01.558028 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bee85-159e-48d9-901b-f913add075c2 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:01.576946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03bee85-159e-48d9-901b-f913add075c2 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:01.582754 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09154533-d7c4-40ea-90a3-26774ca70ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:01.584452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154533-d7c4-40ea-90a3-26774ca70ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.585059 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154533-d7c4-40ea-90a3-26774ca70ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.585523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154533-d7c4-40ea-90a3-26774ca70ce1 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.600794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09154533-d7c4-40ea-90a3-26774ca70ce1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:17:01.614441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-09154533-d7c4-40ea-90a3-26774ca70ce1 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 12 04:17:01.616461 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 466/933] 10.222.0.35 () {56 vars in 1141 bytes} [Sat Feb 12 04:17:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:17:01.623057 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed776e-0198-4e4d-bf99-060645043f87 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:01.634072 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed776e-0198-4e4d-bf99-060645043f87 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:01.641882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930df0ef-42db-4a9b-9213-91dc24d9e374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:01.642655 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930df0ef-42db-4a9b-9213-91dc24d9e374 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.642984 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930df0ef-42db-4a9b-9213-91dc24d9e374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.644106 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930df0ef-42db-4a9b-9213-91dc24d9e374 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.644106 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930df0ef-42db-4a9b-9213-91dc24d9e374 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:01.644408 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930df0ef-42db-4a9b-9213-91dc24d9e374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:01.646002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930df0ef-42db-4a9b-9213-91dc24d9e374 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:01.657881 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 468/934] 10.222.0.35 () {56 vars in 1136 bytes} [Sat Feb 12 04:17:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:01.665241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09154533-d7c4-40ea-90a3-26774ca70ce1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:01.677445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09154533-d7c4-40ea-90a3-26774ca70ce1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:01.684946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e58830-42c5-4b50-9356-e1bc06acb5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:01.686496 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e58830-42c5-4b50-9356-e1bc06acb5ea admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.687311 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e58830-42c5-4b50-9356-e1bc06acb5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.687953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e58830-42c5-4b50-9356-e1bc06acb5ea admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.700269 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e58830-42c5-4b50-9356-e1bc06acb5ea admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:01.702331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e58830-42c5-4b50-9356-e1bc06acb5ea admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:01.721821 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-21e58830-42c5-4b50-9356-e1bc06acb5ea admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:17:01.727321 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 467/935] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:01.729862 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930df0ef-42db-4a9b-9213-91dc24d9e374 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:01.741581 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930df0ef-42db-4a9b-9213-91dc24d9e374 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:01.747586 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b662561-1178-4641-a039-24f7f5c2fa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:01.748528 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b662561-1178-4641-a039-24f7f5c2fa96 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.748897 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b662561-1178-4641-a039-24f7f5c2fa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.749251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b662561-1178-4641-a039-24f7f5c2fa96 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.750163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b662561-1178-4641-a039-24f7f5c2fa96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:01.750586 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b662561-1178-4641-a039-24f7f5c2fa96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:01.752418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b662561-1178-4641-a039-24f7f5c2fa96 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:01.765813 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 469/936] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:01.771871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e58830-42c5-4b50-9356-e1bc06acb5ea admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:01.786407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e58830-42c5-4b50-9356-e1bc06acb5ea admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:01.792585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451db27-f668-440c-95bb-970dc674356b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:01.793665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451db27-f668-440c-95bb-970dc674356b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.794162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451db27-f668-440c-95bb-970dc674356b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.794676 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451db27-f668-440c-95bb-970dc674356b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.804049 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451db27-f668-440c-95bb-970dc674356b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:01.806852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2451db27-f668-440c-95bb-970dc674356b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:01.823314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-2451db27-f668-440c-95bb-970dc674356b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Feb 12 04:17:01.830862 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 468/937] 10.222.0.35 () {56 vars in 1138 bytes} [Sat Feb 12 04:17:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:01.833945 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b662561-1178-4641-a039-24f7f5c2fa96 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:01.846483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b662561-1178-4641-a039-24f7f5c2fa96 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:01.852038 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4c2fa-01e3-4842-aadd-28b265ec9d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:01.852962 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4c2fa-01e3-4842-aadd-28b265ec9d91 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.853554 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4c2fa-01e3-4842-aadd-28b265ec9d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.854017 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4c2fa-01e3-4842-aadd-28b265ec9d91 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.855140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4c2fa-01e3-4842-aadd-28b265ec9d91 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:01.855667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4c2fa-01e3-4842-aadd-28b265ec9d91 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:01.857813 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4c2fa-01e3-4842-aadd-28b265ec9d91 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:01.883353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 470/938] 10.222.0.35 () {56 vars in 1170 bytes} [Sat Feb 12 04:17:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:01.885684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451db27-f668-440c-95bb-970dc674356b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:01.896064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451db27-f668-440c-95bb-970dc674356b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:01.900963 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fba452-8f33-434b-a69e-fe8bc66072d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:01.901859 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fba452-8f33-434b-a69e-fe8bc66072d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.902360 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fba452-8f33-434b-a69e-fe8bc66072d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.902836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fba452-8f33-434b-a69e-fe8bc66072d6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.911596 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fba452-8f33-434b-a69e-fe8bc66072d6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:01.913736 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fba452-8f33-434b-a69e-fe8bc66072d6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:01.927920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 469/939] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:17:01 2022] GET /identity/v3/auth/tokens => generated 1952 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:01.930719 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4c2fa-01e3-4842-aadd-28b265ec9d91 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:01.941462 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4c2fa-01e3-4842-aadd-28b265ec9d91 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:01.946229 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4f446-933f-46b2-b430-4c816f868c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:01.947267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4f446-933f-46b2-b430-4c816f868c8a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.947759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4f446-933f-46b2-b430-4c816f868c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.948253 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4f446-933f-46b2-b430-4c816f868c8a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.959022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4f446-933f-46b2-b430-4c816f868c8a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:01.961192 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4f446-933f-46b2-b430-4c816f868c8a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:01.984357 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-e3b4f446-933f-46b2-b430-4c816f868c8a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:17:01.991258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9778e-0ab6-437c-aa2a-db91189d15fa None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:01.991258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9778e-0ab6-437c-aa2a-db91189d15fa None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:01.991258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9778e-0ab6-437c-aa2a-db91189d15fa None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:01.991813 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 471/941] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:01.994481 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4f446-933f-46b2-b430-4c816f868c8a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:01.995010 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 470/941] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:01.999799 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc00b6-aae8-4c08-8101-e282dfd8f4d4 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.000314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc00b6-aae8-4c08-8101-e282dfd8f4d4 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.001345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc00b6-aae8-4c08-8101-e282dfd8f4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.008271 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4f446-933f-46b2-b430-4c816f868c8a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:02.018935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200854f-2f49-4ff3-be07-c898e42dd523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:02.020012 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200854f-2f49-4ff3-be07-c898e42dd523 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.020611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200854f-2f49-4ff3-be07-c898e42dd523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.021126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8200854f-2f49-4ff3-be07-c898e42dd523 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.022157 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200854f-2f49-4ff3-be07-c898e42dd523 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:02.022500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-bcbc00b6-aae8-4c08-8101-e282dfd8f4d4 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:02.022876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200854f-2f49-4ff3-be07-c898e42dd523 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:02.023758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-bcbc00b6-aae8-4c08-8101-e282dfd8f4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:02.025029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8200854f-2f49-4ff3-be07-c898e42dd523 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:02.039246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 471/942] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:01 2022] POST /identity/v3/auth/tokens => generated 1952 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:02.040601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 472/943] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:02.048880 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc00b6-aae8-4c08-8101-e282dfd8f4d4 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:02.058475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200854f-2f49-4ff3-be07-c898e42dd523 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:02.058759 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc00b6-aae8-4c08-8101-e282dfd8f4d4 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:02.063985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b15f4c-ee46-470f-a7e6-bbc3e697ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:02.064995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b15f4c-ee46-470f-a7e6-bbc3e697ac71 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.065277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b15f4c-ee46-470f-a7e6-bbc3e697ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.065548 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b15f4c-ee46-470f-a7e6-bbc3e697ac71 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.071554 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8200854f-2f49-4ff3-be07-c898e42dd523 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:02.073945 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b15f4c-ee46-470f-a7e6-bbc3e697ac71 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:02.075931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b15f4c-ee46-470f-a7e6-bbc3e697ac71 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:02.078673 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327f592-2358-4a47-ab58-6f559f7cc089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:02.079833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327f592-2358-4a47-ab58-6f559f7cc089 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.080336 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327f592-2358-4a47-ab58-6f559f7cc089 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.080800 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2327f592-2358-4a47-ab58-6f559f7cc089 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.082022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327f592-2358-4a47-ab58-6f559f7cc089 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:02.083845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2327f592-2358-4a47-ab58-6f559f7cc089 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:02.089796 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-a2b15f4c-ee46-470f-a7e6-bbc3e697ac71 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:17:02.091286 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 472/944] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:17:02.099339 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b15f4c-ee46-470f-a7e6-bbc3e697ac71 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:02.102164 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-2327f592-2358-4a47-ab58-6f559f7cc089 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Feb 12 04:17:02.107311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 473/945] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:17:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:17:02.111631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327f592-2358-4a47-ab58-6f559f7cc089 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:02.115043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b15f4c-ee46-470f-a7e6-bbc3e697ac71 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:02.120275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100eea10-71f3-4423-b4df-4973ba5d5374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:02.121245 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eea10-71f3-4423-b4df-4973ba5d5374 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.121617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eea10-71f3-4423-b4df-4973ba5d5374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.121982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eea10-71f3-4423-b4df-4973ba5d5374 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.122933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100eea10-71f3-4423-b4df-4973ba5d5374 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:02.123407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100eea10-71f3-4423-b4df-4973ba5d5374 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:02.123751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2327f592-2358-4a47-ab58-6f559f7cc089 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:02.126441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100eea10-71f3-4423-b4df-4973ba5d5374 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:02.129301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb5887-fcbd-439e-9e0a-db717bd0de68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:02.130385 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb5887-fcbd-439e-9e0a-db717bd0de68 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.130808 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb5887-fcbd-439e-9e0a-db717bd0de68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.131260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb5887-fcbd-439e-9e0a-db717bd0de68 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.132122 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb5887-fcbd-439e-9e0a-db717bd0de68 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:02.132566 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb5887-fcbd-439e-9e0a-db717bd0de68 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:02.134275 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb5887-fcbd-439e-9e0a-db717bd0de68 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:02.140317 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 474/947] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:17:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:02.145317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 473/947] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:17:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:02.146328 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100eea10-71f3-4423-b4df-4973ba5d5374 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:02.148320 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb5887-fcbd-439e-9e0a-db717bd0de68 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:02.156514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100eea10-71f3-4423-b4df-4973ba5d5374 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:02.158751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb5887-fcbd-439e-9e0a-db717bd0de68 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:02.161578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b2d8a-d7a1-42d0-9396-59f72327b727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:02.162278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b2d8a-d7a1-42d0-9396-59f72327b727 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.162748 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b2d8a-d7a1-42d0-9396-59f72327b727 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.163106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b2d8a-d7a1-42d0-9396-59f72327b727 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.164154 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b2d8a-d7a1-42d0-9396-59f72327b727 admin admin] RBAC: Adding query filter params (role.id=b69fe879299a4dba8bb1feb6600f3943, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=560fd9efb8a04f449acaf2f3987ce81c) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:02.164525 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b2d8a-d7a1-42d0-9396-59f72327b727 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:02.164764 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd3c253-532a-467d-9990-988e5b09e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:02.165582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3c253-532a-467d-9990-988e5b09e15e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.166032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3c253-532a-467d-9990-988e5b09e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.166473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd3c253-532a-467d-9990-988e5b09e15e admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.166830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b2d8a-d7a1-42d0-9396-59f72327b727 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:02.167611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3c253-532a-467d-9990-988e5b09e15e admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:02.168102 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3c253-532a-467d-9990-988e5b09e15e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:02.169824 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd3c253-532a-467d-9990-988e5b09e15e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:02.179475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 474/948] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:17:02 2022] GET /identity/v3/role_assignments?user.id=560fd9efb8a04f449acaf2f3987ce81c&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=b69fe879299a4dba8bb1feb6600f3943 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:02.181631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 475/949] 10.222.0.35 () {56 vars in 1135 bytes} [Sat Feb 12 04:17:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:02.183032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b2d8a-d7a1-42d0-9396-59f72327b727 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:02.198448 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b2d8a-d7a1-42d0-9396-59f72327b727 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:02.203343 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a4c958-442d-449e-8a7a-601bcdee449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:02.204091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4c958-442d-449e-8a7a-601bcdee449a admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.204378 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4c958-442d-449e-8a7a-601bcdee449a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.204694 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4c958-442d-449e-8a7a-601bcdee449a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.205480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4c958-442d-449e-8a7a-601bcdee449a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:02.207245 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a4c958-442d-449e-8a7a-601bcdee449a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:02.311794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 475/950] 10.222.0.35 () {60 vars in 1165 bytes} [Sat Feb 12 04:17:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:17:02.332542 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3d8a-5677-452b-bc04-43615a343c81 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.332888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3d8a-5677-452b-bc04-43615a343c81 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.333108 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3d8a-5677-452b-bc04-43615a343c81 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.335187 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 476/951] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:02.341318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b7c5-4400-4cb6-9711-c05c5c7bfe71 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.341625 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b7c5-4400-4cb6-9711-c05c5c7bfe71 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.341891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89b7c5-4400-4cb6-9711-c05c5c7bfe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.364940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-4b89b7c5-4400-4cb6-9711-c05c5c7bfe71 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:02.366170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-4b89b7c5-4400-4cb6-9711-c05c5c7bfe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:02.385903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 476/952] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:02 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:02.411504 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3d8a-5677-452b-bc04-43615a343c81 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:02.424876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3d8a-5677-452b-bc04-43615a343c81 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:02.429923 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb3947-3bc8-4af3-a777-508d450ffd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:02.430787 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb3947-3bc8-4af3-a777-508d450ffd44 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.431077 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb3947-3bc8-4af3-a777-508d450ffd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.431454 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb3947-3bc8-4af3-a777-508d450ffd44 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.432225 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb3947-3bc8-4af3-a777-508d450ffd44 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:02.433945 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb3947-3bc8-4af3-a777-508d450ffd44 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:02.447469 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-39bb3947-3bc8-4af3-a777-508d450ffd44 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 12 04:17:02.449176 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 477/953] 10.222.0.35 () {56 vars in 1147 bytes} [Sat Feb 12 04:17:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:02.456270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89b7c5-4400-4cb6-9711-c05c5c7bfe71 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:02.466069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b89b7c5-4400-4cb6-9711-c05c5c7bfe71 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:02.471169 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd9d69-80e4-41b1-ae00-16787550769c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:02.472068 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd9d69-80e4-41b1-ae00-16787550769c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.472503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd9d69-80e4-41b1-ae00-16787550769c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.472872 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fd9d69-80e4-41b1-ae00-16787550769c admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.473746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd9d69-80e4-41b1-ae00-16787550769c admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:02.474156 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd9d69-80e4-41b1-ae00-16787550769c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:02.476059 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fd9d69-80e4-41b1-ae00-16787550769c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:02.482027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 477/954] 10.222.0.35 () {56 vars in 1143 bytes} [Sat Feb 12 04:17:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:02.487657 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb3947-3bc8-4af3-a777-508d450ffd44 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:02.497519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb3947-3bc8-4af3-a777-508d450ffd44 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:02.502856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af322a3-5603-4db1-9083-c8fbe31728e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:02.503691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af322a3-5603-4db1-9083-c8fbe31728e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.504137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af322a3-5603-4db1-9083-c8fbe31728e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.504553 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af322a3-5603-4db1-9083-c8fbe31728e4 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.505418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af322a3-5603-4db1-9083-c8fbe31728e4 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:02.505865 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af322a3-5603-4db1-9083-c8fbe31728e4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:02.507610 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af322a3-5603-4db1-9083-c8fbe31728e4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:02.513183 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 478/955] 10.222.0.35 () {56 vars in 1143 bytes} [Sat Feb 12 04:17:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:02.519630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd9d69-80e4-41b1-ae00-16787550769c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:02.531885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fd9d69-80e4-41b1-ae00-16787550769c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:02.537379 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6b23f-e2a1-4bdf-bb7c-9ad39487b763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:02.538027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6b23f-e2a1-4bdf-bb7c-9ad39487b763 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.538306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6b23f-e2a1-4bdf-bb7c-9ad39487b763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.538577 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6b23f-e2a1-4bdf-bb7c-9ad39487b763 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.539407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6b23f-e2a1-4bdf-bb7c-9ad39487b763 admin admin] RBAC: Adding query filter params (interface=public, service_id=a61de38401304f4d80dd0a117b27dace, region_id=RegionOne) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:02.539712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6b23f-e2a1-4bdf-bb7c-9ad39487b763 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:02.541287 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6b23f-e2a1-4bdf-bb7c-9ad39487b763 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:02.546886 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 478/956] 10.222.0.35 () {56 vars in 1272 bytes} [Sat Feb 12 04:17:02 2022] GET /identity/v3/endpoints?service_id=a61de38401304f4d80dd0a117b27dace&interface=public®ion_id=RegionOne => generated 194 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:02.552979 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af322a3-5603-4db1-9083-c8fbe31728e4 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:02.564578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af322a3-5603-4db1-9083-c8fbe31728e4 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:02.569618 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56cbc9-d165-4231-b600-37f5a651f86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:02.570466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56cbc9-d165-4231-b600-37f5a651f86a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:02.570942 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56cbc9-d165-4231-b600-37f5a651f86a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:02.571421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56cbc9-d165-4231-b600-37f5a651f86a admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:02.572349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56cbc9-d165-4231-b600-37f5a651f86a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:02.574117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56cbc9-d165-4231-b600-37f5a651f86a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:02.581316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 479/957] 10.222.0.35 () {56 vars in 1108 bytes} [Sat Feb 12 04:17:02 2022] GET /identity/v3/services => generated 1497 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:17:03.831531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283bf35-bbe4-4768-8346-ef7db7096a18 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:03.832067 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283bf35-bbe4-4768-8346-ef7db7096a18 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:03.832067 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283bf35-bbe4-4768-8346-ef7db7096a18 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:03.834107 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 479/958] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:03.839552 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe08caf-29ed-4672-aca1-77829577ea7e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:03.839948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe08caf-29ed-4672-aca1-77829577ea7e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:03.840112 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe08caf-29ed-4672-aca1-77829577ea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:03.857612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-fbe08caf-29ed-4672-aca1-77829577ea7e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:03.858774 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-fbe08caf-29ed-4672-aca1-77829577ea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:03.871328 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 480/959] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:03 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:03.889319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283bf35-bbe4-4768-8346-ef7db7096a18 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:03.902084 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283bf35-bbe4-4768-8346-ef7db7096a18 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:03.906447 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ffa6-b5f8-4aab-b840-a1dbd6717ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:03.907764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ffa6-b5f8-4aab-b840-a1dbd6717ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:03.908042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ffa6-b5f8-4aab-b840-a1dbd6717ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:03.908307 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87ffa6-b5f8-4aab-b840-a1dbd6717ec5 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:03.908960 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87ffa6-b5f8-4aab-b840-a1dbd6717ec5 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:03.910583 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee87ffa6-b5f8-4aab-b840-a1dbd6717ec5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:03.921307 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-ee87ffa6-b5f8-4aab-b840-a1dbd6717ec5 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 12 04:17:03.927330 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 480/960] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:17:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:03.929635 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe08caf-29ed-4672-aca1-77829577ea7e None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:03.938562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe08caf-29ed-4672-aca1-77829577ea7e None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:03.943129 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f8988-80ac-4d57-b50e-6d9ca7c7a234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:03.943817 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f8988-80ac-4d57-b50e-6d9ca7c7a234 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:03.944093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f8988-80ac-4d57-b50e-6d9ca7c7a234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:03.944361 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f8988-80ac-4d57-b50e-6d9ca7c7a234 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:03.945076 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f8988-80ac-4d57-b50e-6d9ca7c7a234 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:03.945365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f8988-80ac-4d57-b50e-6d9ca7c7a234 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:03.946936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f8988-80ac-4d57-b50e-6d9ca7c7a234 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:03.956348 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 481/961] 10.222.0.35 () {56 vars in 1133 bytes} [Sat Feb 12 04:17:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:03.957666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ffa6-b5f8-4aab-b840-a1dbd6717ec5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:03.967297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87ffa6-b5f8-4aab-b840-a1dbd6717ec5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:03.972538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373f850d-14c6-45f2-8995-2f5c13a010ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:03.973236 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f850d-14c6-45f2-8995-2f5c13a010ba admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:03.973517 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f850d-14c6-45f2-8995-2f5c13a010ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:03.973789 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373f850d-14c6-45f2-8995-2f5c13a010ba admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:03.974508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f850d-14c6-45f2-8995-2f5c13a010ba admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:03.974803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f850d-14c6-45f2-8995-2f5c13a010ba admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:03.976415 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373f850d-14c6-45f2-8995-2f5c13a010ba admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:03.985743 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 481/962] 10.222.0.35 () {56 vars in 1133 bytes} [Sat Feb 12 04:17:03 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:04.545306 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859bfcf-05e7-4d07-ab55-e6fa250c7000 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:04.545487 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859bfcf-05e7-4d07-ab55-e6fa250c7000 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:04.545770 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0859bfcf-05e7-4d07-ab55-e6fa250c7000 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:04.548480 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 482/963] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:04.554554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf6649-83a6-4fe5-9138-4274e6afa0be None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:04.554844 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf6649-83a6-4fe5-9138-4274e6afa0be None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:04.555113 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf6649-83a6-4fe5-9138-4274e6afa0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:04.574597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-23bf6649-83a6-4fe5-9138-4274e6afa0be None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:04.575932 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-23bf6649-83a6-4fe5-9138-4274e6afa0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:04.584554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 482/964] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:04 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:17:04.607482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859bfcf-05e7-4d07-ab55-e6fa250c7000 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:04.620691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0859bfcf-05e7-4d07-ab55-e6fa250c7000 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:04.625152 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984a422-aea2-442e-851f-659d2e0f8141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:04.626577 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984a422-aea2-442e-851f-659d2e0f8141 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:04.626836 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984a422-aea2-442e-851f-659d2e0f8141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:04.627077 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984a422-aea2-442e-851f-659d2e0f8141 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:04.627798 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984a422-aea2-442e-851f-659d2e0f8141 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:04.629382 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984a422-aea2-442e-851f-659d2e0f8141 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:04.640625 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-6984a422-aea2-442e-851f-659d2e0f8141 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 12 04:17:04.642641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 483/965] 10.222.0.35 () {56 vars in 1126 bytes} [Sat Feb 12 04:17:04 2022] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:04.648537 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf6649-83a6-4fe5-9138-4274e6afa0be None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:04.657749 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf6649-83a6-4fe5-9138-4274e6afa0be None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:04.662373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caccd31-0970-4c3c-8089-8930eb040b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:04.663024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccd31-0970-4c3c-8089-8930eb040b87 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:04.663332 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccd31-0970-4c3c-8089-8930eb040b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:04.663612 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caccd31-0970-4c3c-8089-8930eb040b87 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:04.664337 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caccd31-0970-4c3c-8089-8930eb040b87 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:04.664637 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caccd31-0970-4c3c-8089-8930eb040b87 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:04.666218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caccd31-0970-4c3c-8089-8930eb040b87 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:04.671569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 483/966] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:04.677725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caccd31-0970-4c3c-8089-8930eb040b87 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:04.678641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628c09-32e8-47cf-80e3-479fc299a6af None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:04.679554 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628c09-32e8-47cf-80e3-479fc299a6af None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:04.680048 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32628c09-32e8-47cf-80e3-479fc299a6af None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:04.682296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 484/967] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:04.688941 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ffd5-79bb-4877-be09-3989cfa10672 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:04.689247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ffd5-79bb-4877-be09-3989cfa10672 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:04.689594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0ffd5-79bb-4877-be09-3989cfa10672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:04.693216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caccd31-0970-4c3c-8089-8930eb040b87 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:04.698136 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae63b4-2f35-4d5f-9f81-d8554f2be78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:04.699028 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae63b4-2f35-4d5f-9f81-d8554f2be78e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:04.699541 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae63b4-2f35-4d5f-9f81-d8554f2be78e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:04.700067 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeae63b4-2f35-4d5f-9f81-d8554f2be78e admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:04.701046 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae63b4-2f35-4d5f-9f81-d8554f2be78e admin admin] RBAC: Adding query filter params (type=image) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:04.701551 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae63b4-2f35-4d5f-9f81-d8554f2be78e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:04.703393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeae63b4-2f35-4d5f-9f81-d8554f2be78e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:04.708184 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-8ca0ffd5-79bb-4877-be09-3989cfa10672 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:04.709451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8ca0ffd5-79bb-4877-be09-3989cfa10672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:04.709765 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 484/968] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:04 2022] GET /identity/v3/services?type=image => generated 122 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:04.727292 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 485/969] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:04 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:04.752075 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae63b4-2f35-4d5f-9f81-d8554f2be78e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:04.762568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeae63b4-2f35-4d5f-9f81-d8554f2be78e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:04.768185 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca72fdb-db46-41f5-985f-8ccd205cc998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:04.768857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca72fdb-db46-41f5-985f-8ccd205cc998 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:04.769141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca72fdb-db46-41f5-985f-8ccd205cc998 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:04.769416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca72fdb-db46-41f5-985f-8ccd205cc998 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:04.770142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca72fdb-db46-41f5-985f-8ccd205cc998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:04.772052 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca72fdb-db46-41f5-985f-8ccd205cc998 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:04.773659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.common [None req-eca72fdb-db46-41f5-985f-8ccd205cc998 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Feb 12 04:17:04.832959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.sql.core [None req-eca72fdb-db46-41f5-985f-8ccd205cc998 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Feb 12 04:17:04.832959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Feb 12 04:17:04.832959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [parameters: {'id': '2563b25158be4548bd79c46d48499dea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Feb 12 04:17:04.832959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79266) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 12 04:17:04.848939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-eca72fdb-db46-41f5-985f-8ccd205cc998 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2563b25158be4548bd79c46d48499dea.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2563b25158be4548bd79c46d48499dea. Feb 12 04:17:04.850285 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d6850-f197-4cc3-a78c-0c6a9bfdc5ca None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:04.850720 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d6850-f197-4cc3-a78c-0c6a9bfdc5ca None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:04.850792 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 485/970] 10.222.0.35 () {60 vars in 1161 bytes} [Sat Feb 12 04:17:04 2022] POST /identity/v3/projects => generated 262 bytes in 100 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:04.850860 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3d6850-f197-4cc3-a78c-0c6a9bfdc5ca None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:04.852882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 486/971] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:17:04.857323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca72fdb-db46-41f5-985f-8ccd205cc998 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:04.858705 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a1b37-b556-4efd-9328-d79f451b28fe None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:04.858986 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a1b37-b556-4efd-9328-d79f451b28fe None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:04.859276 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a1b37-b556-4efd-9328-d79f451b28fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:04.871508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca72fdb-db46-41f5-985f-8ccd205cc998 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:04.877374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e56ee-f432-4524-9e78-66c3b8afa556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:04.878178 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e56ee-f432-4524-9e78-66c3b8afa556 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:04.878464 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e56ee-f432-4524-9e78-66c3b8afa556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:04.878742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e56ee-f432-4524-9e78-66c3b8afa556 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:04.879402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-733a1b37-b556-4efd-9328-d79f451b28fe None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:04.880794 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-733a1b37-b556-4efd-9328-d79f451b28fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:04.887406 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e56ee-f432-4524-9e78-66c3b8afa556 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:04.890873 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e56ee-f432-4524-9e78-66c3b8afa556 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:04.894254 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 487/972] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:04 2022] POST /identity/v3/auth/tokens => generated 2138 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:17:04.908338 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-110e56ee-f432-4524-9e78-66c3b8afa556 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:17:04.910049 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 486/973] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:04.911713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a1b37-b556-4efd-9328-d79f451b28fe None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:04.915730 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e56ee-f432-4524-9e78-66c3b8afa556 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:04.921084 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a1b37-b556-4efd-9328-d79f451b28fe None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:04.926263 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67a125-5942-4722-b126-f3d994cd5fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:04.927049 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67a125-5942-4722-b126-f3d994cd5fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:04.927370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67a125-5942-4722-b126-f3d994cd5fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:04.927643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67a125-5942-4722-b126-f3d994cd5fe4 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:04.928310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67a125-5942-4722-b126-f3d994cd5fe4 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:04.930134 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67a125-5942-4722-b126-f3d994cd5fe4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:04.930421 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e56ee-f432-4524-9e78-66c3b8afa556 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:04.935912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b761c3-8ed6-4c58-a290-201c6fc383d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:04.937562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b761c3-8ed6-4c58-a290-201c6fc383d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:04.937562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b761c3-8ed6-4c58-a290-201c6fc383d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:04.937562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b761c3-8ed6-4c58-a290-201c6fc383d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:04.937806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b761c3-8ed6-4c58-a290-201c6fc383d6 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:04.938702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b761c3-8ed6-4c58-a290-201c6fc383d6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:04.940761 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b761c3-8ed6-4c58-a290-201c6fc383d6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:04.945718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-6d67a125-5942-4722-b126-f3d994cd5fe4 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 12 04:17:04.947220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 488/974] 10.222.0.35 () {56 vars in 1147 bytes} [Sat Feb 12 04:17:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:04.954490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67a125-5942-4722-b126-f3d994cd5fe4 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:04.964770 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 487/975] 10.222.0.35 () {56 vars in 1133 bytes} [Sat Feb 12 04:17:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:04.965054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67a125-5942-4722-b126-f3d994cd5fe4 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:04.975678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb0784-7d18-406d-a2c5-c3a8c87aa6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:04.976795 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb0784-7d18-406d-a2c5-c3a8c87aa6f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:04.977277 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb0784-7d18-406d-a2c5-c3a8c87aa6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:04.977799 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eb0784-7d18-406d-a2c5-c3a8c87aa6f2 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:04.978757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb0784-7d18-406d-a2c5-c3a8c87aa6f2 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:04.979389 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb0784-7d18-406d-a2c5-c3a8c87aa6f2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:04.981293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10eb0784-7d18-406d-a2c5-c3a8c87aa6f2 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:04.988667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 489/976] 10.222.0.35 () {56 vars in 1143 bytes} [Sat Feb 12 04:17:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:04.996503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b761c3-8ed6-4c58-a290-201c6fc383d6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:05.008091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b761c3-8ed6-4c58-a290-201c6fc383d6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:05.013161 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863d05c-ae5e-4a16-a5f4-c431e22e34e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:05.013831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863d05c-ae5e-4a16-a5f4-c431e22e34e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:05.014170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863d05c-ae5e-4a16-a5f4-c431e22e34e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:05.014488 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863d05c-ae5e-4a16-a5f4-c431e22e34e8 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:05.015282 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863d05c-ae5e-4a16-a5f4-c431e22e34e8 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:05.015659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863d05c-ae5e-4a16-a5f4-c431e22e34e8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:05.018013 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863d05c-ae5e-4a16-a5f4-c431e22e34e8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:05.024569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 488/977] 10.222.0.35 () {56 vars in 1143 bytes} [Sat Feb 12 04:17:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:05.030615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb0784-7d18-406d-a2c5-c3a8c87aa6f2 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:05.041921 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eb0784-7d18-406d-a2c5-c3a8c87aa6f2 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:05.046972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00fb4b-d17b-4f2d-bc89-cac7cd54ff4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:05.047894 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00fb4b-d17b-4f2d-bc89-cac7cd54ff4d admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:05.048243 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00fb4b-d17b-4f2d-bc89-cac7cd54ff4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:05.048519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00fb4b-d17b-4f2d-bc89-cac7cd54ff4d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:05.049398 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00fb4b-d17b-4f2d-bc89-cac7cd54ff4d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:05.051082 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00fb4b-d17b-4f2d-bc89-cac7cd54ff4d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:05.121296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 490/978] 10.222.0.35 () {60 vars in 1165 bytes} [Sat Feb 12 04:17:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:17:06.272274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f83e5-ef8d-4b97-bf51-971014606ca1 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:06.272802 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f83e5-ef8d-4b97-bf51-971014606ca1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:06.272802 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f83e5-ef8d-4b97-bf51-971014606ca1 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:06.278239 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 489/979] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:06.286538 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6238e-74f3-4089-9c23-31f997361920 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:06.286977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6238e-74f3-4089-9c23-31f997361920 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:06.287155 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6238e-74f3-4089-9c23-31f997361920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:06.305275 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-a8a6238e-74f3-4089-9c23-31f997361920 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:06.306448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a8a6238e-74f3-4089-9c23-31f997361920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:06.327338 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 491/980] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:06 2022] POST /identity/v3/auth/tokens => generated 2327 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:17:06.346326 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f83e5-ef8d-4b97-bf51-971014606ca1 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:06.358562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f83e5-ef8d-4b97-bf51-971014606ca1 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:06.363843 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1bf27-0798-4d65-9a8b-d88ec225eadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:06.364484 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1bf27-0798-4d65-9a8b-d88ec225eadd admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:06.364763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1bf27-0798-4d65-9a8b-d88ec225eadd admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:06.365031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1bf27-0798-4d65-9a8b-d88ec225eadd admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:06.365772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1bf27-0798-4d65-9a8b-d88ec225eadd admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:06.367385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1bf27-0798-4d65-9a8b-d88ec225eadd admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:06.451411 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 490/981] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Feb 12 04:17:06 2022] POST /identity/v3/services => generated 242 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:17:07.011702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9fcfa-5b39-4f16-b892-884aa9d1f392 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.012090 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9fcfa-5b39-4f16-b892-884aa9d1f392 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.012259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9fcfa-5b39-4f16-b892-884aa9d1f392 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.014317 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 492/982] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:07.020515 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b891d6-7595-419e-b3d9-940cd31a9d75 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.020791 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b891d6-7595-419e-b3d9-940cd31a9d75 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.021118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b891d6-7595-419e-b3d9-940cd31a9d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.039692 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-15b891d6-7595-419e-b3d9-940cd31a9d75 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:07.041206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-15b891d6-7595-419e-b3d9-940cd31a9d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:07.062804 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 491/983] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:07 2022] POST /identity/v3/auth/tokens => generated 2423 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:07.086202 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9fcfa-5b39-4f16-b892-884aa9d1f392 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:07.099093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9fcfa-5b39-4f16-b892-884aa9d1f392 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:07.103554 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a24877-4390-416a-a2fb-ba84b112b59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:07.104196 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24877-4390-416a-a2fb-ba84b112b59b admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.104472 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24877-4390-416a-a2fb-ba84b112b59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.104742 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a24877-4390-416a-a2fb-ba84b112b59b admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.105479 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a24877-4390-416a-a2fb-ba84b112b59b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:07.107047 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a24877-4390-416a-a2fb-ba84b112b59b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:07.194314 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 493/984] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Feb 12 04:17:07 2022] POST /identity/v3/services => generated 242 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:17:07.295083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b75843-48dd-4eff-ba27-3183914055f9 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.295083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b75843-48dd-4eff-ba27-3183914055f9 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.295083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b75843-48dd-4eff-ba27-3183914055f9 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.296288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 492/985] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:07.302812 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e0c1-b857-42f0-a3dc-e5232432b18e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.303777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e0c1-b857-42f0-a3dc-e5232432b18e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.304532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd84e0c1-b857-42f0-a3dc-e5232432b18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.323937 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-cd84e0c1-b857-42f0-a3dc-e5232432b18e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:07.325521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-cd84e0c1-b857-42f0-a3dc-e5232432b18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:07.343632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 494/986] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:07 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:07.370080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b75843-48dd-4eff-ba27-3183914055f9 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:07.384436 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b75843-48dd-4eff-ba27-3183914055f9 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:07.388745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc68935-251d-4d44-ab4b-06335cc3ff49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:07.389399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc68935-251d-4d44-ab4b-06335cc3ff49 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.393183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc68935-251d-4d44-ab4b-06335cc3ff49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.393183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc68935-251d-4d44-ab4b-06335cc3ff49 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.393183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc68935-251d-4d44-ab4b-06335cc3ff49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:07.393183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc68935-251d-4d44-ab4b-06335cc3ff49 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:07.424904 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64aa58-b949-4602-9ad3-79b2d9f548e4 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.425195 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64aa58-b949-4602-9ad3-79b2d9f548e4 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.425468 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb64aa58-b949-4602-9ad3-79b2d9f548e4 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.427214 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 495/987] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:07.433109 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b1439-3288-43c0-9c07-cebb84dbfc19 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.433386 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b1439-3288-43c0-9c07-cebb84dbfc19 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.433660 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286b1439-3288-43c0-9c07-cebb84dbfc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.435971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.sql.core [None req-bfc68935-251d-4d44-ab4b-06335cc3ff49 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Feb 12 04:17:07.435971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Feb 12 04:17:07.435971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [parameters: {'user_id': 'acb922679c6441bc98e8ff16e0f1ea9c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Feb 12 04:17:07.435971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79266) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Feb 12 04:17:07.442372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-bfc68935-251d-4d44-ab4b-06335cc3ff49 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Feb 12 04:17:07.443676 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 493/988] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:17:07 2022] POST /identity/v3/users => generated 160 bytes in 74 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:07.450485 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc68935-251d-4d44-ab4b-06335cc3ff49 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:07.454272 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-286b1439-3288-43c0-9c07-cebb84dbfc19 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:07.455605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-286b1439-3288-43c0-9c07-cebb84dbfc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:07.463803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 496/989] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:07 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:07.464950 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc68935-251d-4d44-ab4b-06335cc3ff49 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:07.470622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202d12d-fbc8-4c55-8224-f6682aa1ea1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:07.471684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202d12d-fbc8-4c55-8224-f6682aa1ea1d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.472160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202d12d-fbc8-4c55-8224-f6682aa1ea1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.472764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6202d12d-fbc8-4c55-8224-f6682aa1ea1d admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.481881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202d12d-fbc8-4c55-8224-f6682aa1ea1d admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:07.484483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6202d12d-fbc8-4c55-8224-f6682aa1ea1d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:07.489709 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b1439-3288-43c0-9c07-cebb84dbfc19 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:07.499729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286b1439-3288-43c0-9c07-cebb84dbfc19 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:07.502316 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-6202d12d-fbc8-4c55-8224-f6682aa1ea1d admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Feb 12 04:17:07.504546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 494/990] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:17:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:17:07.508605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72873bc6-6c09-4892-97a4-1db4dd1bdc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:07.508804 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873bc6-6c09-4892-97a4-1db4dd1bdc59 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.509232 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873bc6-6c09-4892-97a4-1db4dd1bdc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.509577 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72873bc6-6c09-4892-97a4-1db4dd1bdc59 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.510467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72873bc6-6c09-4892-97a4-1db4dd1bdc59 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:07.511516 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202d12d-fbc8-4c55-8224-f6682aa1ea1d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:07.512360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72873bc6-6c09-4892-97a4-1db4dd1bdc59 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:07.523651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6202d12d-fbc8-4c55-8224-f6682aa1ea1d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:07.526141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-72873bc6-6c09-4892-97a4-1db4dd1bdc59 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 12 04:17:07.527830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 497/991] 10.222.0.35 () {56 vars in 1147 bytes} [Sat Feb 12 04:17:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:17:07.529121 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a54912-750c-43fe-a54d-5db5c56c1e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:07.530044 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54912-750c-43fe-a54d-5db5c56c1e58 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.530580 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54912-750c-43fe-a54d-5db5c56c1e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.531008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a54912-750c-43fe-a54d-5db5c56c1e58 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.532165 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a54912-750c-43fe-a54d-5db5c56c1e58 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:07.532686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a54912-750c-43fe-a54d-5db5c56c1e58 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:07.533959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72873bc6-6c09-4892-97a4-1db4dd1bdc59 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:07.535350 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a54912-750c-43fe-a54d-5db5c56c1e58 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:07.544024 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72873bc6-6c09-4892-97a4-1db4dd1bdc59 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:07.549878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518813c9-f90c-4c21-b38b-6c6f9f42e338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:07.550615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518813c9-f90c-4c21-b38b-6c6f9f42e338 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.550970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518813c9-f90c-4c21-b38b-6c6f9f42e338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.551356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518813c9-f90c-4c21-b38b-6c6f9f42e338 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.552157 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518813c9-f90c-4c21-b38b-6c6f9f42e338 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:07.552544 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518813c9-f90c-4c21-b38b-6c6f9f42e338 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:07.554448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518813c9-f90c-4c21-b38b-6c6f9f42e338 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:07.560361 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 498/992] 10.222.0.35 () {56 vars in 1143 bytes} [Sat Feb 12 04:17:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:07.567596 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518813c9-f90c-4c21-b38b-6c6f9f42e338 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:07.577886 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518813c9-f90c-4c21-b38b-6c6f9f42e338 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:07.583207 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4086ed-4046-4b7d-a014-6130567b2472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:07.583977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4086ed-4046-4b7d-a014-6130567b2472 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.584326 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4086ed-4046-4b7d-a014-6130567b2472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.584685 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4086ed-4046-4b7d-a014-6130567b2472 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.585608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4086ed-4046-4b7d-a014-6130567b2472 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:07.585806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 495/993] 10.222.0.35 () {56 vars in 1122 bytes} [Sat Feb 12 04:17:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:07.585918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4086ed-4046-4b7d-a014-6130567b2472 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:07.591608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4086ed-4046-4b7d-a014-6130567b2472 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:07.596770 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 499/994] 10.222.0.35 () {56 vars in 1143 bytes} [Sat Feb 12 04:17:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:07.602983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a54912-750c-43fe-a54d-5db5c56c1e58 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:07.618246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a54912-750c-43fe-a54d-5db5c56c1e58 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:07.623255 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81da42a-72ec-4346-845a-354cdc794b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:07.624105 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81da42a-72ec-4346-845a-354cdc794b16 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.624396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81da42a-72ec-4346-845a-354cdc794b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.624673 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81da42a-72ec-4346-845a-354cdc794b16 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.626272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81da42a-72ec-4346-845a-354cdc794b16 admin admin] RBAC: Adding query filter params (interface=admin, service_id=a61de38401304f4d80dd0a117b27dace, region_id=RegionOne) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:07.626700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81da42a-72ec-4346-845a-354cdc794b16 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:07.628620 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81da42a-72ec-4346-845a-354cdc794b16 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:07.635501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 496/995] 10.222.0.35 () {56 vars in 1270 bytes} [Sat Feb 12 04:17:07 2022] GET /identity/v3/endpoints?service_id=a61de38401304f4d80dd0a117b27dace&interface=admin®ion_id=RegionOne => generated 193 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:07.642182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4086ed-4046-4b7d-a014-6130567b2472 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:07.652434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4086ed-4046-4b7d-a014-6130567b2472 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:07.657551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a80eff-6047-4175-9229-da10a877ca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:07.658291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a80eff-6047-4175-9229-da10a877ca85 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:07.658572 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a80eff-6047-4175-9229-da10a877ca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:07.658895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a80eff-6047-4175-9229-da10a877ca85 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:07.659651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a80eff-6047-4175-9229-da10a877ca85 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:07.661293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a80eff-6047-4175-9229-da10a877ca85 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:07.668603 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 500/996] 10.222.0.35 () {56 vars in 1108 bytes} [Sat Feb 12 04:17:07 2022] GET /identity/v3/services => generated 1957 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:17:08.741912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0525ae5-0574-40d9-8e53-e395bac07646 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:08.742423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0525ae5-0574-40d9-8e53-e395bac07646 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:08.742501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0525ae5-0574-40d9-8e53-e395bac07646 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:08.744404 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 497/997] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:08.749579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246733a4-9e9a-4a1d-a4b6-0219d7fd067c None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:08.750021 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246733a4-9e9a-4a1d-a4b6-0219d7fd067c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:08.750195 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246733a4-9e9a-4a1d-a4b6-0219d7fd067c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:08.769565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-246733a4-9e9a-4a1d-a4b6-0219d7fd067c None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:08.770743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-246733a4-9e9a-4a1d-a4b6-0219d7fd067c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:08.778546 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 501/998] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:08 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:08.802280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0525ae5-0574-40d9-8e53-e395bac07646 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:08.815130 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0525ae5-0574-40d9-8e53-e395bac07646 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:08.819501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40b76d-7458-4c5d-9e45-702666e75a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:08.820285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40b76d-7458-4c5d-9e45-702666e75a39 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:08.820566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40b76d-7458-4c5d-9e45-702666e75a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:08.820837 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a40b76d-7458-4c5d-9e45-702666e75a39 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:08.821497 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40b76d-7458-4c5d-9e45-702666e75a39 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:08.823201 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a40b76d-7458-4c5d-9e45-702666e75a39 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:08.834884 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-6a40b76d-7458-4c5d-9e45-702666e75a39 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 12 04:17:08.836286 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 498/999] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:17:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:08.842043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246733a4-9e9a-4a1d-a4b6-0219d7fd067c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:08.851363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246733a4-9e9a-4a1d-a4b6-0219d7fd067c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:08.855786 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeb13d-2b47-4bd2-977e-ca99c32d42fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:08.856432 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeb13d-2b47-4bd2-977e-ca99c32d42fc admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:08.856709 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeb13d-2b47-4bd2-977e-ca99c32d42fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:08.856979 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aeb13d-2b47-4bd2-977e-ca99c32d42fc admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:08.857697 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeb13d-2b47-4bd2-977e-ca99c32d42fc admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:08.857997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeb13d-2b47-4bd2-977e-ca99c32d42fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:08.859592 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aeb13d-2b47-4bd2-977e-ca99c32d42fc admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:08.865182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 502/1000] 10.222.0.35 () {56 vars in 1133 bytes} [Sat Feb 12 04:17:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:08.870529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40b76d-7458-4c5d-9e45-702666e75a39 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:08.880389 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a40b76d-7458-4c5d-9e45-702666e75a39 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:08.884801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59e579-fe6d-45fe-bb19-57f1375a78e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:08.885439 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59e579-fe6d-45fe-bb19-57f1375a78e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:08.885720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59e579-fe6d-45fe-bb19-57f1375a78e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:08.885990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59e579-fe6d-45fe-bb19-57f1375a78e6 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:08.886842 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59e579-fe6d-45fe-bb19-57f1375a78e6 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:08.887146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59e579-fe6d-45fe-bb19-57f1375a78e6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:08.888758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da59e579-fe6d-45fe-bb19-57f1375a78e6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:08.894327 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 499/1001] 10.222.0.35 () {56 vars in 1133 bytes} [Sat Feb 12 04:17:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:08.899911 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeb13d-2b47-4bd2-977e-ca99c32d42fc admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:08.910243 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aeb13d-2b47-4bd2-977e-ca99c32d42fc admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:08.914846 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4044c-2dd2-4fe5-b7da-42bdc2457532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:08.915592 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4044c-2dd2-4fe5-b7da-42bdc2457532 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:08.915945 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4044c-2dd2-4fe5-b7da-42bdc2457532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:08.916227 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4044c-2dd2-4fe5-b7da-42bdc2457532 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:08.917029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4044c-2dd2-4fe5-b7da-42bdc2457532 admin admin] RBAC: Adding query filter params (interface=public, service_id=d927bd5406dd40998c4dd78e5ff842ff, region_id=RegionOne) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:08.917337 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4044c-2dd2-4fe5-b7da-42bdc2457532 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:08.918934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4044c-2dd2-4fe5-b7da-42bdc2457532 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:08.924105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 503/1002] 10.222.0.35 () {56 vars in 1272 bytes} [Sat Feb 12 04:17:08 2022] GET /identity/v3/endpoints?service_id=d927bd5406dd40998c4dd78e5ff842ff&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:08.929870 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59e579-fe6d-45fe-bb19-57f1375a78e6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:08.940007 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59e579-fe6d-45fe-bb19-57f1375a78e6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:08.944496 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd0366a-850b-4ce4-bd88-8cb37ead9098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:08.945137 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0366a-850b-4ce4-bd88-8cb37ead9098 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:08.945417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0366a-850b-4ce4-bd88-8cb37ead9098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:08.945689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd0366a-850b-4ce4-bd88-8cb37ead9098 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:08.946373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0366a-850b-4ce4-bd88-8cb37ead9098 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:08.947983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd0366a-850b-4ce4-bd88-8cb37ead9098 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:08.955373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 500/1003] 10.222.0.35 () {56 vars in 1108 bytes} [Sat Feb 12 04:17:08 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:17:09.478480 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38084cb2-4b12-40d6-9062-c28e4d41ba75 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:09.478848 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38084cb2-4b12-40d6-9062-c28e4d41ba75 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:09.479047 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38084cb2-4b12-40d6-9062-c28e4d41ba75 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:09.480867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 504/1004] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:09.486618 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5aad5-db92-4b5a-a015-1d5f2d025ca2 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:09.486900 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5aad5-db92-4b5a-a015-1d5f2d025ca2 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:09.487172 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5aad5-db92-4b5a-a015-1d5f2d025ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:09.505643 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-7df5aad5-db92-4b5a-a015-1d5f2d025ca2 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:09.507131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-7df5aad5-db92-4b5a-a015-1d5f2d025ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:09.514857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 501/1005] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:09 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:09.538039 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38084cb2-4b12-40d6-9062-c28e4d41ba75 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:09.550128 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38084cb2-4b12-40d6-9062-c28e4d41ba75 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:09.554756 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d939f-2b94-491d-be82-97ddf95a3efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:09.555564 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d939f-2b94-491d-be82-97ddf95a3efe admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:09.555846 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d939f-2b94-491d-be82-97ddf95a3efe admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:09.556120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d939f-2b94-491d-be82-97ddf95a3efe admin admin] PATH_INFO: `/v3/services/image` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:09.556789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d939f-2b94-491d-be82-97ddf95a3efe admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:09.558365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d939f-2b94-491d-be82-97ddf95a3efe admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:09.569245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-586d939f-2b94-491d-be82-97ddf95a3efe admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 12 04:17:09.570550 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 505/1006] 10.222.0.35 () {56 vars in 1126 bytes} [Sat Feb 12 04:17:09 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:17:09.576681 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5aad5-db92-4b5a-a015-1d5f2d025ca2 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:09.586302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5aad5-db92-4b5a-a015-1d5f2d025ca2 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:09.590929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df511a4a-61f2-4c9a-ad0c-f7d07e281712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:09.591701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df511a4a-61f2-4c9a-ad0c-f7d07e281712 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:09.592046 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df511a4a-61f2-4c9a-ad0c-f7d07e281712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:09.592386 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df511a4a-61f2-4c9a-ad0c-f7d07e281712 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:09.593177 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df511a4a-61f2-4c9a-ad0c-f7d07e281712 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:09.593556 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df511a4a-61f2-4c9a-ad0c-f7d07e281712 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:09.595996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df511a4a-61f2-4c9a-ad0c-f7d07e281712 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:09.601130 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 502/1007] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:09.606480 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d939f-2b94-491d-be82-97ddf95a3efe admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:09.616300 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d939f-2b94-491d-be82-97ddf95a3efe admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:09.620683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d3ada-5100-4d83-bfb3-e0f3c0831b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:09.621318 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d3ada-5100-4d83-bfb3-e0f3c0831b51 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:09.621592 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d3ada-5100-4d83-bfb3-e0f3c0831b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:09.621859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d3ada-5100-4d83-bfb3-e0f3c0831b51 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:09.622567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d3ada-5100-4d83-bfb3-e0f3c0831b51 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:09.622862 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d3ada-5100-4d83-bfb3-e0f3c0831b51 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:09.624449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d3ada-5100-4d83-bfb3-e0f3c0831b51 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:09.629371 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 506/1008] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:09.634839 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df511a4a-61f2-4c9a-ad0c-f7d07e281712 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:09.645550 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df511a4a-61f2-4c9a-ad0c-f7d07e281712 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:09.650455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b32609-ca2e-4e14-b9dc-31e17aa18d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:09.651133 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32609-ca2e-4e14-b9dc-31e17aa18d20 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:09.651468 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32609-ca2e-4e14-b9dc-31e17aa18d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:09.651746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b32609-ca2e-4e14-b9dc-31e17aa18d20 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:09.652573 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b32609-ca2e-4e14-b9dc-31e17aa18d20 admin admin] RBAC: Adding query filter params (interface=public, service_id=c43d3f3ba4bf46f89e35b7e5b228e6f7, region_id=RegionOne) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:09.652886 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b32609-ca2e-4e14-b9dc-31e17aa18d20 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:09.654530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b32609-ca2e-4e14-b9dc-31e17aa18d20 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:09.665636 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 503/1009] 10.222.0.35 () {56 vars in 1272 bytes} [Sat Feb 12 04:17:09 2022] GET /identity/v3/endpoints?service_id=c43d3f3ba4bf46f89e35b7e5b228e6f7&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:09.667024 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d3ada-5100-4d83-bfb3-e0f3c0831b51 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:09.677720 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d3ada-5100-4d83-bfb3-e0f3c0831b51 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:09.682447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4af2f5f-1adc-4fa8-987a-e24fb868f393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:09.683095 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af2f5f-1adc-4fa8-987a-e24fb868f393 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:09.683419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af2f5f-1adc-4fa8-987a-e24fb868f393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:09.683691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af2f5f-1adc-4fa8-987a-e24fb868f393 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:09.684385 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af2f5f-1adc-4fa8-987a-e24fb868f393 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:09.685949 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4af2f5f-1adc-4fa8-987a-e24fb868f393 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:09.699253 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 507/1010] 10.222.0.35 () {56 vars in 1108 bytes} [Sat Feb 12 04:17:09 2022] GET /identity/v3/services => generated 1957 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:17:09.938814 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eb275-9a46-4453-869b-811b9002b49b None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:09.939356 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eb275-9a46-4453-869b-811b9002b49b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:09.939433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92eb275-9a46-4453-869b-811b9002b49b None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:09.941290 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 504/1011] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:09.946576 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77390-a483-4ac7-8540-78164c391eff None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:09.947011 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77390-a483-4ac7-8540-78164c391eff None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:09.947330 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77390-a483-4ac7-8540-78164c391eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:09.965455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-4fd77390-a483-4ac7-8540-78164c391eff None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:09.966748 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4fd77390-a483-4ac7-8540-78164c391eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:09.974789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 508/1012] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:09 2022] POST /identity/v3/auth/tokens => generated 2519 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:17:09.997811 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92eb275-9a46-4453-869b-811b9002b49b None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:10.010589 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92eb275-9a46-4453-869b-811b9002b49b None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:10.014914 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d116f4-3b89-4694-9a90-5152173762f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:10.015849 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d116f4-3b89-4694-9a90-5152173762f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:10.016772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d116f4-3b89-4694-9a90-5152173762f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:10.017292 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d116f4-3b89-4694-9a90-5152173762f8 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:10.018057 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d116f4-3b89-4694-9a90-5152173762f8 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:10.019890 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d116f4-3b89-4694-9a90-5152173762f8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:10.031151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-d9d116f4-3b89-4694-9a90-5152173762f8 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Feb 12 04:17:10.035281 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 505/1013] 10.222.0.35 () {56 vars in 1147 bytes} [Sat Feb 12 04:17:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:10.039024 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd77390-a483-4ac7-8540-78164c391eff None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:10.048534 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd77390-a483-4ac7-8540-78164c391eff None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:10.052938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfcfca-2f3c-4473-b8cf-8c395ad3053f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:10.053586 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfcfca-2f3c-4473-b8cf-8c395ad3053f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:10.053863 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfcfca-2f3c-4473-b8cf-8c395ad3053f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:10.054397 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bfcfca-2f3c-4473-b8cf-8c395ad3053f admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:10.055109 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfcfca-2f3c-4473-b8cf-8c395ad3053f admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:10.055461 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfcfca-2f3c-4473-b8cf-8c395ad3053f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:10.057032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bfcfca-2f3c-4473-b8cf-8c395ad3053f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:10.062176 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 509/1014] 10.222.0.35 () {56 vars in 1143 bytes} [Sat Feb 12 04:17:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:10.067995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d116f4-3b89-4694-9a90-5152173762f8 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:10.078050 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d116f4-3b89-4694-9a90-5152173762f8 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:10.083417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403eb557-3f71-4524-9d0e-21ea9b58b28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:10.084075 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eb557-3f71-4524-9d0e-21ea9b58b28d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:10.084354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eb557-3f71-4524-9d0e-21ea9b58b28d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:10.084624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403eb557-3f71-4524-9d0e-21ea9b58b28d admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:10.085349 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403eb557-3f71-4524-9d0e-21ea9b58b28d admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:10.085650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403eb557-3f71-4524-9d0e-21ea9b58b28d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:10.087237 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403eb557-3f71-4524-9d0e-21ea9b58b28d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:10.092677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 506/1015] 10.222.0.35 () {56 vars in 1143 bytes} [Sat Feb 12 04:17:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:10.098668 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfcfca-2f3c-4473-b8cf-8c395ad3053f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:10.108569 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bfcfca-2f3c-4473-b8cf-8c395ad3053f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:10.113153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe50d49-2d37-422f-a980-a3f4f9e7dc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:10.113882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50d49-2d37-422f-a980-a3f4f9e7dc04 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:10.114233 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50d49-2d37-422f-a980-a3f4f9e7dc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:10.114577 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe50d49-2d37-422f-a980-a3f4f9e7dc04 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:10.115434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe50d49-2d37-422f-a980-a3f4f9e7dc04 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:10.117075 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe50d49-2d37-422f-a980-a3f4f9e7dc04 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:10.198584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 510/1016] 10.222.0.35 () {60 vars in 1165 bytes} [Sat Feb 12 04:17:10 2022] POST /identity/v3/endpoints => generated 325 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:17:11.176790 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e929e2d-0297-470e-a0b7-5f8a16188259 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:11.177311 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e929e2d-0297-470e-a0b7-5f8a16188259 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:11.177388 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e929e2d-0297-470e-a0b7-5f8a16188259 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:11.179562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 507/1017] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:11.184541 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca40c9-7cd9-4afb-8098-e3fb23fa69b7 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:11.184959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca40c9-7cd9-4afb-8098-e3fb23fa69b7 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:11.185124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca40c9-7cd9-4afb-8098-e3fb23fa69b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:11.203274 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-edca40c9-7cd9-4afb-8098-e3fb23fa69b7 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:11.204814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-edca40c9-7cd9-4afb-8098-e3fb23fa69b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:11.222221 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 511/1018] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:11 2022] POST /identity/v3/auth/tokens => generated 2668 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:11.247156 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e929e2d-0297-470e-a0b7-5f8a16188259 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:11.260098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e929e2d-0297-470e-a0b7-5f8a16188259 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:11.264477 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c490e4a-4eb9-4959-a097-77183c8dc37a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:11.265285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c490e4a-4eb9-4959-a097-77183c8dc37a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:11.265567 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c490e4a-4eb9-4959-a097-77183c8dc37a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:11.265868 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c490e4a-4eb9-4959-a097-77183c8dc37a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:11.266670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c490e4a-4eb9-4959-a097-77183c8dc37a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:11.268301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c490e4a-4eb9-4959-a097-77183c8dc37a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:11.279316 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-5c490e4a-4eb9-4959-a097-77183c8dc37a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Feb 12 04:17:11.280662 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 508/1019] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:17:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:11.287185 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca40c9-7cd9-4afb-8098-e3fb23fa69b7 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:11.296183 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca40c9-7cd9-4afb-8098-e3fb23fa69b7 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:11.301344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53b797-384b-49a4-9457-46f9a13f9ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:11.301990 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53b797-384b-49a4-9457-46f9a13f9ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:11.302270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53b797-384b-49a4-9457-46f9a13f9ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:11.302541 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53b797-384b-49a4-9457-46f9a13f9ec6 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:11.303285 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53b797-384b-49a4-9457-46f9a13f9ec6 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:11.303590 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53b797-384b-49a4-9457-46f9a13f9ec6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:11.305423 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53b797-384b-49a4-9457-46f9a13f9ec6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:11.310428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 512/1020] 10.222.0.35 () {56 vars in 1133 bytes} [Sat Feb 12 04:17:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:11.316139 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c490e4a-4eb9-4959-a097-77183c8dc37a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:11.326855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c490e4a-4eb9-4959-a097-77183c8dc37a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:11.331862 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e68f86-f4dc-4318-bd8f-bd618c155cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:11.332542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e68f86-f4dc-4318-bd8f-bd618c155cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:11.332822 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e68f86-f4dc-4318-bd8f-bd618c155cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:11.333096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e68f86-f4dc-4318-bd8f-bd618c155cb5 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:11.333835 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e68f86-f4dc-4318-bd8f-bd618c155cb5 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:11.334150 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e68f86-f4dc-4318-bd8f-bd618c155cb5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:11.335796 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e68f86-f4dc-4318-bd8f-bd618c155cb5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:11.342156 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 509/1021] 10.222.0.35 () {56 vars in 1133 bytes} [Sat Feb 12 04:17:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:11.347738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53b797-384b-49a4-9457-46f9a13f9ec6 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:11.357360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53b797-384b-49a4-9457-46f9a13f9ec6 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:11.362629 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9ba34-7313-482f-bc95-7c0f8c61e60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:11.363376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9ba34-7313-482f-bc95-7c0f8c61e60b admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:11.363727 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9ba34-7313-482f-bc95-7c0f8c61e60b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:11.364073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9ba34-7313-482f-bc95-7c0f8c61e60b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:11.364908 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9ba34-7313-482f-bc95-7c0f8c61e60b admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:11.366573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9ba34-7313-482f-bc95-7c0f8c61e60b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:11.491057 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 513/1022] 10.222.0.35 () {60 vars in 1165 bytes} [Sat Feb 12 04:17:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:17:11.941334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec69366-20c1-4622-aaa4-967f8f6ba2b5 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:11.941640 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec69366-20c1-4622-aaa4-967f8f6ba2b5 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:11.942008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec69366-20c1-4622-aaa4-967f8f6ba2b5 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:11.943842 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 510/1023] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:11.949122 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61213921-55be-4036-81f7-44e7c2ff3c40 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:11.949415 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61213921-55be-4036-81f7-44e7c2ff3c40 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:11.949693 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61213921-55be-4036-81f7-44e7c2ff3c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:11.967160 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-61213921-55be-4036-81f7-44e7c2ff3c40 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:11.968371 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-61213921-55be-4036-81f7-44e7c2ff3c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:11.986094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 514/1024] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:11 2022] POST /identity/v3/auth/tokens => generated 2824 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:12.008503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec69366-20c1-4622-aaa4-967f8f6ba2b5 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:12.020690 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec69366-20c1-4622-aaa4-967f8f6ba2b5 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:12.025008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf829a-0952-4267-85e1-4f4747c549c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:12.025774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf829a-0952-4267-85e1-4f4747c549c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:12.026053 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf829a-0952-4267-85e1-4f4747c549c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:12.026325 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf829a-0952-4267-85e1-4f4747c549c2 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:12.026985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf829a-0952-4267-85e1-4f4747c549c2 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:12.028606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf829a-0952-4267-85e1-4f4747c549c2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:12.039675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-ffdf829a-0952-4267-85e1-4f4747c549c2 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Feb 12 04:17:12.040994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 511/1025] 10.222.0.35 () {56 vars in 1126 bytes} [Sat Feb 12 04:17:12 2022] GET /identity/v3/services/image => generated 86 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:12.046708 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61213921-55be-4036-81f7-44e7c2ff3c40 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:12.056058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61213921-55be-4036-81f7-44e7c2ff3c40 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:12.060631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3c51e-cb6e-4865-a551-2f0f7ee5e45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:12.061345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3c51e-cb6e-4865-a551-2f0f7ee5e45c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:12.061696 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3c51e-cb6e-4865-a551-2f0f7ee5e45c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:12.062046 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa3c51e-cb6e-4865-a551-2f0f7ee5e45c admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:12.063580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3c51e-cb6e-4865-a551-2f0f7ee5e45c admin admin] RBAC: Adding query filter params (name=image) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:12.063998 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3c51e-cb6e-4865-a551-2f0f7ee5e45c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:12.065572 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa3c51e-cb6e-4865-a551-2f0f7ee5e45c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:12.070760 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 515/1026] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:12.076422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf829a-0952-4267-85e1-4f4747c549c2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:12.086789 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf829a-0952-4267-85e1-4f4747c549c2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:12.091297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2bf0c-69e0-4244-acee-37a2136cc473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:12.091936 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2bf0c-69e0-4244-acee-37a2136cc473 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:12.092219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2bf0c-69e0-4244-acee-37a2136cc473 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:12.092494 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2bf0c-69e0-4244-acee-37a2136cc473 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:12.093213 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2bf0c-69e0-4244-acee-37a2136cc473 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:12.093506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2bf0c-69e0-4244-acee-37a2136cc473 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:12.095215 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2bf0c-69e0-4244-acee-37a2136cc473 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:12.100217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 512/1027] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:12.105845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3c51e-cb6e-4865-a551-2f0f7ee5e45c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:12.115524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa3c51e-cb6e-4865-a551-2f0f7ee5e45c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:12.120033 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311b87d7-1634-472b-aff9-aba61009c78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:12.120669 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b87d7-1634-472b-aff9-aba61009c78a admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:12.120949 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b87d7-1634-472b-aff9-aba61009c78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:12.121220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311b87d7-1634-472b-aff9-aba61009c78a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:12.121972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b87d7-1634-472b-aff9-aba61009c78a admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:12.123584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311b87d7-1634-472b-aff9-aba61009c78a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:12.210811 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 516/1028] 10.222.0.35 () {60 vars in 1165 bytes} [Sat Feb 12 04:17:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:17:12.452422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1290f36-ded2-4120-a5a8-8c617cb4e3f6 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:12.452956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1290f36-ded2-4120-a5a8-8c617cb4e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:12.452956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1290f36-ded2-4120-a5a8-8c617cb4e3f6 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:12.455471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 513/1029] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:12.460716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136d0bb-79a0-47ba-b662-88d31f78a584 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:12.461059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136d0bb-79a0-47ba-b662-88d31f78a584 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:12.461287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0136d0bb-79a0-47ba-b662-88d31f78a584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:12.479399 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-0136d0bb-79a0-47ba-b662-88d31f78a584 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:12.480581 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0136d0bb-79a0-47ba-b662-88d31f78a584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:12.498223 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 517/1030] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:12 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:12.523465 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1290f36-ded2-4120-a5a8-8c617cb4e3f6 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:12.536280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1290f36-ded2-4120-a5a8-8c617cb4e3f6 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:12.540595 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968a3e94-f403-46dd-ba69-4d77443e42b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:12.541365 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3e94-f403-46dd-ba69-4d77443e42b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:12.541648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3e94-f403-46dd-ba69-4d77443e42b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:12.541921 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968a3e94-f403-46dd-ba69-4d77443e42b9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:12.543092 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a3e94-f403-46dd-ba69-4d77443e42b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:12.544801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968a3e94-f403-46dd-ba69-4d77443e42b9 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:12.546550 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 514/1031] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:12.552414 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136d0bb-79a0-47ba-b662-88d31f78a584 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:12.561768 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0136d0bb-79a0-47ba-b662-88d31f78a584 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:12.566408 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2f50a-f20f-4756-a6ca-86db2b319186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:12.567051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f50a-f20f-4756-a6ca-86db2b319186 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:12.567358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f50a-f20f-4756-a6ca-86db2b319186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:12.567631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2f50a-f20f-4756-a6ca-86db2b319186 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:12.568358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2f50a-f20f-4756-a6ca-86db2b319186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:12.570286 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a2f50a-f20f-4756-a6ca-86db2b319186 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:12.677727 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 518/1032] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Feb 12 04:17:12 2022] POST /identity/v3/projects => generated 311 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:17:13.820731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250d92f-c7e8-47e9-8f1f-ab24ab5fdd4a None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:13.821262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250d92f-c7e8-47e9-8f1f-ab24ab5fdd4a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:13.821262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250d92f-c7e8-47e9-8f1f-ab24ab5fdd4a None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:13.823083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 515/1033] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:13.829719 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30b101-d844-40e1-871e-04287910ebc4 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:13.830211 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30b101-d844-40e1-871e-04287910ebc4 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:13.830284 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac30b101-d844-40e1-871e-04287910ebc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:13.848335 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-ac30b101-d844-40e1-871e-04287910ebc4 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:13.849504 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ac30b101-d844-40e1-871e-04287910ebc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:13.904630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 519/1034] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:13 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:13.929438 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250d92f-c7e8-47e9-8f1f-ab24ab5fdd4a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:13.941700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250d92f-c7e8-47e9-8f1f-ab24ab5fdd4a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:13.945948 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91efdac-6108-498e-bdd0-8fd91405c7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:13.946724 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91efdac-6108-498e-bdd0-8fd91405c7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:13.946999 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91efdac-6108-498e-bdd0-8fd91405c7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:13.947289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91efdac-6108-498e-bdd0-8fd91405c7d4 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:13.958355 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91efdac-6108-498e-bdd0-8fd91405c7d4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:17:13.965609 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-b91efdac-6108-498e-bdd0-8fd91405c7d4 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 12 04:17:13.966800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 516/1035] 10.222.0.35 () {56 vars in 1141 bytes} [Sat Feb 12 04:17:13 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:13.973243 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30b101-d844-40e1-871e-04287910ebc4 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:13.981989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac30b101-d844-40e1-871e-04287910ebc4 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:13.987080 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082ccc2-7044-4d22-a794-3de3519433c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:13.987753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082ccc2-7044-4d22-a794-3de3519433c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:13.988026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082ccc2-7044-4d22-a794-3de3519433c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:13.988294 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6082ccc2-7044-4d22-a794-3de3519433c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:13.989043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082ccc2-7044-4d22-a794-3de3519433c8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:13.989342 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082ccc2-7044-4d22-a794-3de3519433c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:13.990895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6082ccc2-7044-4d22-a794-3de3519433c8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:13.998868 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 520/1036] 10.222.0.35 () {56 vars in 1136 bytes} [Sat Feb 12 04:17:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:14.004933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91efdac-6108-498e-bdd0-8fd91405c7d4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:14.014606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91efdac-6108-498e-bdd0-8fd91405c7d4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:14.019326 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca6469-b6c9-4cd6-9139-eec554b49a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:14.020124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6469-b6c9-4cd6-9139-eec554b49a00 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.020408 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6469-b6c9-4cd6-9139-eec554b49a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.020683 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca6469-b6c9-4cd6-9139-eec554b49a00 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.030746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca6469-b6c9-4cd6-9139-eec554b49a00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:14.032630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca6469-b6c9-4cd6-9139-eec554b49a00 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:14.049582 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-eeca6469-b6c9-4cd6-9139-eec554b49a00 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:17:14.050920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 517/1037] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:17:14.056636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082ccc2-7044-4d22-a794-3de3519433c8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:14.066939 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6082ccc2-7044-4d22-a794-3de3519433c8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:14.071599 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fbaf9-1e77-4374-949d-4cfb108f688a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:14.072261 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fbaf9-1e77-4374-949d-4cfb108f688a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.072622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fbaf9-1e77-4374-949d-4cfb108f688a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.072972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7fbaf9-1e77-4374-949d-4cfb108f688a admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.073780 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fbaf9-1e77-4374-949d-4cfb108f688a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:14.074157 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fbaf9-1e77-4374-949d-4cfb108f688a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:14.075850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7fbaf9-1e77-4374-949d-4cfb108f688a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:14.087817 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 521/1038] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:14.093463 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca6469-b6c9-4cd6-9139-eec554b49a00 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:14.103372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca6469-b6c9-4cd6-9139-eec554b49a00 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:14.107949 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a7e3-6eab-4143-9e06-4b8a4247204f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:14.108718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a7e3-6eab-4143-9e06-4b8a4247204f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.108998 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a7e3-6eab-4143-9e06-4b8a4247204f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.109270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6416a7e3-6eab-4143-9e06-4b8a4247204f admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.117209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416a7e3-6eab-4143-9e06-4b8a4247204f admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:14.119219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6416a7e3-6eab-4143-9e06-4b8a4247204f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:14.133497 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-6416a7e3-6eab-4143-9e06-4b8a4247204f admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 04:17:14.134855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 518/1039] 10.222.0.35 () {56 vars in 1114 bytes} [Sat Feb 12 04:17:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:14.140323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fbaf9-1e77-4374-949d-4cfb108f688a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:14.150009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7fbaf9-1e77-4374-949d-4cfb108f688a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:14.154448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bf86d-22a3-4379-9135-a33e5e3d70c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:14.155096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bf86d-22a3-4379-9135-a33e5e3d70c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.155405 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bf86d-22a3-4379-9135-a33e5e3d70c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.155680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27bf86d-22a3-4379-9135-a33e5e3d70c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.156687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27bf86d-22a3-4379-9135-a33e5e3d70c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:14.156999 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27bf86d-22a3-4379-9135-a33e5e3d70c5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:14.158816 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27bf86d-22a3-4379-9135-a33e5e3d70c5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:14.176474 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 522/1040] 10.222.0.35 () {56 vars in 1154 bytes} [Sat Feb 12 04:17:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:14.182110 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a7e3-6eab-4143-9e06-4b8a4247204f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:14.192691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6416a7e3-6eab-4143-9e06-4b8a4247204f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:14.197424 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6150fb1-2ede-4b30-a439-6e25372d28a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:14.198092 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6150fb1-2ede-4b30-a439-6e25372d28a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.198374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6150fb1-2ede-4b30-a439-6e25372d28a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.198647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6150fb1-2ede-4b30-a439-6e25372d28a5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.207594 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6150fb1-2ede-4b30-a439-6e25372d28a5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:14.209474 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6150fb1-2ede-4b30-a439-6e25372d28a5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:14.220788 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 519/1041] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:17:14 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:14.226643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bf86d-22a3-4379-9135-a33e5e3d70c5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:14.237904 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27bf86d-22a3-4379-9135-a33e5e3d70c5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:14.242540 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd9c39-0d1b-4d1d-a15d-124e89efd047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:14.243447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd9c39-0d1b-4d1d-a15d-124e89efd047 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.243801 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd9c39-0d1b-4d1d-a15d-124e89efd047 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.244085 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd9c39-0d1b-4d1d-a15d-124e89efd047 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.254760 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd9c39-0d1b-4d1d-a15d-124e89efd047 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:14.256602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd9c39-0d1b-4d1d-a15d-124e89efd047 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:14.273612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-dfbd9c39-0d1b-4d1d-a15d-124e89efd047 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:17:14.277263 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 523/1042] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:14.280454 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6150fb1-2ede-4b30-a439-6e25372d28a5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:14.290013 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6150fb1-2ede-4b30-a439-6e25372d28a5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:14.294532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a11811-06fb-4b8e-a183-d84f954d67b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:14.295285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a11811-06fb-4b8e-a183-d84f954d67b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.295633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a11811-06fb-4b8e-a183-d84f954d67b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.295966 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a11811-06fb-4b8e-a183-d84f954d67b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.296752 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a11811-06fb-4b8e-a183-d84f954d67b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:14.297662 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a11811-06fb-4b8e-a183-d84f954d67b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:14.299425 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a11811-06fb-4b8e-a183-d84f954d67b3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:14.310965 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 520/1043] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:17:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:14.319333 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd9c39-0d1b-4d1d-a15d-124e89efd047 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:14.328688 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd9c39-0d1b-4d1d-a15d-124e89efd047 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:14.333105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7c729-c4e2-4386-8485-b790b0f7fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:14.333881 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7c729-c4e2-4386-8485-b790b0f7fd3b admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.334163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7c729-c4e2-4386-8485-b790b0f7fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.334436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f7c729-c4e2-4386-8485-b790b0f7fd3b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.341381 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7c729-c4e2-4386-8485-b790b0f7fd3b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:14.343342 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f7c729-c4e2-4386-8485-b790b0f7fd3b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:14.356825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-a6f7c729-c4e2-4386-8485-b790b0f7fd3b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:17:14.358144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 524/1044] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:17:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:14.364305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a11811-06fb-4b8e-a183-d84f954d67b3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:14.374043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a11811-06fb-4b8e-a183-d84f954d67b3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:14.378929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b050e7ab-c28b-4c5e-89df-12e73f46d82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:14.379603 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e7ab-c28b-4c5e-89df-12e73f46d82e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.379887 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e7ab-c28b-4c5e-89df-12e73f46d82e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.380164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b050e7ab-c28b-4c5e-89df-12e73f46d82e admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.380963 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050e7ab-c28b-4c5e-89df-12e73f46d82e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:14.381270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050e7ab-c28b-4c5e-89df-12e73f46d82e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:14.383110 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b050e7ab-c28b-4c5e-89df-12e73f46d82e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:14.397355 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 521/1045] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:17:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:14.403205 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7c729-c4e2-4386-8485-b790b0f7fd3b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:14.414605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f7c729-c4e2-4386-8485-b790b0f7fd3b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:14.419130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3225ad80-dade-445e-9373-12c366ce1929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:14.419794 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225ad80-dade-445e-9373-12c366ce1929 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.420075 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225ad80-dade-445e-9373-12c366ce1929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.420352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3225ad80-dade-445e-9373-12c366ce1929 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.421190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225ad80-dade-445e-9373-12c366ce1929 admin admin] RBAC: Adding query filter params (role.id=b69fe879299a4dba8bb1feb6600f3943, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=362ab4aeb88746d8b8a14a238c877a53) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:14.421502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225ad80-dade-445e-9373-12c366ce1929 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:14.423618 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3225ad80-dade-445e-9373-12c366ce1929 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:14.429621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 525/1046] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:17:14 2022] GET /identity/v3/role_assignments?user.id=362ab4aeb88746d8b8a14a238c877a53&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=b69fe879299a4dba8bb1feb6600f3943 => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:14.486282 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2718-befc-4ee7-a7e2-54075e6d2359 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.486633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2718-befc-4ee7-a7e2-54075e6d2359 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.486845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2718-befc-4ee7-a7e2-54075e6d2359 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.488854 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 522/1047] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:14.494949 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236f205-32ca-47f9-9544-e6df3d40304d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.495273 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236f205-32ca-47f9-9544-e6df3d40304d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.495524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8236f205-32ca-47f9-9544-e6df3d40304d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.514227 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-8236f205-32ca-47f9-9544-e6df3d40304d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:14.515546 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8236f205-32ca-47f9-9544-e6df3d40304d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:14.524470 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 526/1048] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:14.548026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e2718-befc-4ee7-a7e2-54075e6d2359 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:14.560870 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e2718-befc-4ee7-a7e2-54075e6d2359 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:14.566026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de7d900-18b4-41a5-8fc2-a42cac1cb3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:14.566710 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7d900-18b4-41a5-8fc2-a42cac1cb3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.566983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7d900-18b4-41a5-8fc2-a42cac1cb3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.567275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de7d900-18b4-41a5-8fc2-a42cac1cb3bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.576075 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7d900-18b4-41a5-8fc2-a42cac1cb3bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:14.577902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de7d900-18b4-41a5-8fc2-a42cac1cb3bf admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:14.588072 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 523/1049] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:17:14 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:14.593566 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236f205-32ca-47f9-9544-e6df3d40304d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:14.603104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8236f205-32ca-47f9-9544-e6df3d40304d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:14.608425 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb540df5-9dfa-4e54-a415-f3aeb749e7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:14.609199 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb540df5-9dfa-4e54-a415-f3aeb749e7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.610018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb540df5-9dfa-4e54-a415-f3aeb749e7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.610328 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb540df5-9dfa-4e54-a415-f3aeb749e7b0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.611580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb540df5-9dfa-4e54-a415-f3aeb749e7b0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:14.613260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb540df5-9dfa-4e54-a415-f3aeb749e7b0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:14.615000 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 527/1050] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:14.954641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e160a7a-afce-49f9-91ab-bb3915b9c1dc None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.955160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e160a7a-afce-49f9-91ab-bb3915b9c1dc None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.955160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e160a7a-afce-49f9-91ab-bb3915b9c1dc None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.957007 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 524/1051] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:14.962348 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f82d59-cfec-4d29-8fc3-89ec4cad738a None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:14.962784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f82d59-cfec-4d29-8fc3-89ec4cad738a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:14.962887 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f82d59-cfec-4d29-8fc3-89ec4cad738a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:14.980754 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-27f82d59-cfec-4d29-8fc3-89ec4cad738a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:14.981920 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-27f82d59-cfec-4d29-8fc3-89ec4cad738a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:14.990050 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 528/1052] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:14 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:17:15.014437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e160a7a-afce-49f9-91ab-bb3915b9c1dc None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:15.026272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e160a7a-afce-49f9-91ab-bb3915b9c1dc None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:15.030520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5ec28f-41bb-4b29-8982-4f636484a50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:15.031801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec28f-41bb-4b29-8982-4f636484a50e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:15.032081 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec28f-41bb-4b29-8982-4f636484a50e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:15.032350 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5ec28f-41bb-4b29-8982-4f636484a50e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:15.033509 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ec28f-41bb-4b29-8982-4f636484a50e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:15.035156 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5ec28f-41bb-4b29-8982-4f636484a50e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:15.036713 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 525/1053] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:15.042024 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f82d59-cfec-4d29-8fc3-89ec4cad738a None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:15.051503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f82d59-cfec-4d29-8fc3-89ec4cad738a None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:15.056245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28702f7c-578c-4f5f-b967-4ce1d5d3131c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:15.056888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28702f7c-578c-4f5f-b967-4ce1d5d3131c admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:15.057168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28702f7c-578c-4f5f-b967-4ce1d5d3131c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:15.057440 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28702f7c-578c-4f5f-b967-4ce1d5d3131c admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:15.058154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28702f7c-578c-4f5f-b967-4ce1d5d3131c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:15.060059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28702f7c-578c-4f5f-b967-4ce1d5d3131c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:15.167489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 529/1054] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:17:15 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:17:16.641180 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e08d6d-583c-4d73-9de8-febd186960cb None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:16.641699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e08d6d-583c-4d73-9de8-febd186960cb None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:16.641699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e08d6d-583c-4d73-9de8-febd186960cb None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:16.643420 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 526/1055] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:16.648497 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6016e02-c524-4347-9d99-c4deca0cf3bc None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:16.648898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6016e02-c524-4347-9d99-c4deca0cf3bc None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:16.649047 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6016e02-c524-4347-9d99-c4deca0cf3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:16.667637 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-f6016e02-c524-4347-9d99-c4deca0cf3bc None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:16.668794 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f6016e02-c524-4347-9d99-c4deca0cf3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:16.677092 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 530/1056] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:16 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:16.699803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e08d6d-583c-4d73-9de8-febd186960cb None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:16.711629 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e08d6d-583c-4d73-9de8-febd186960cb None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:16.715875 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb764ca3-b301-4142-920d-23a3be9b2168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:16.716647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb764ca3-b301-4142-920d-23a3be9b2168 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:16.716922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb764ca3-b301-4142-920d-23a3be9b2168 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:16.717190 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb764ca3-b301-4142-920d-23a3be9b2168 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:16.727565 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb764ca3-b301-4142-920d-23a3be9b2168 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:17:16.735458 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-cb764ca3-b301-4142-920d-23a3be9b2168 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 12 04:17:16.736756 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 527/1057] 10.222.0.35 () {56 vars in 1141 bytes} [Sat Feb 12 04:17:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:16.742403 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6016e02-c524-4347-9d99-c4deca0cf3bc None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:16.751495 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6016e02-c524-4347-9d99-c4deca0cf3bc None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:16.755947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabbeb4-3352-4967-9ef8-3d41755029a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:16.756590 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabbeb4-3352-4967-9ef8-3d41755029a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:16.756866 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabbeb4-3352-4967-9ef8-3d41755029a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:16.757135 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaabbeb4-3352-4967-9ef8-3d41755029a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:16.757893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabbeb4-3352-4967-9ef8-3d41755029a6 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:16.758193 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabbeb4-3352-4967-9ef8-3d41755029a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:16.759790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaabbeb4-3352-4967-9ef8-3d41755029a6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:16.767997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 531/1058] 10.222.0.35 () {56 vars in 1136 bytes} [Sat Feb 12 04:17:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:16.773924 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb764ca3-b301-4142-920d-23a3be9b2168 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:16.902098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb764ca3-b301-4142-920d-23a3be9b2168 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:16.907199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327bb5b-403e-4675-ac46-08cf7ed9ae07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:16.907972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327bb5b-403e-4675-ac46-08cf7ed9ae07 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:16.908249 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327bb5b-403e-4675-ac46-08cf7ed9ae07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:16.908518 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327bb5b-403e-4675-ac46-08cf7ed9ae07 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:16.919301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327bb5b-403e-4675-ac46-08cf7ed9ae07 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:16.921096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327bb5b-403e-4675-ac46-08cf7ed9ae07 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:16.936905 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-c327bb5b-403e-4675-ac46-08cf7ed9ae07 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:17:16.938315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 528/1059] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:16.944229 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabbeb4-3352-4967-9ef8-3d41755029a6 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:16.954290 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaabbeb4-3352-4967-9ef8-3d41755029a6 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:16.958725 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcdc1d-1d3b-4702-91ca-c89789beb1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:16.959396 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcdc1d-1d3b-4702-91ca-c89789beb1ee admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:16.959676 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcdc1d-1d3b-4702-91ca-c89789beb1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:16.959949 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcdc1d-1d3b-4702-91ca-c89789beb1ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:16.960673 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcdc1d-1d3b-4702-91ca-c89789beb1ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:16.960975 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcdc1d-1d3b-4702-91ca-c89789beb1ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:16.962543 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcdc1d-1d3b-4702-91ca-c89789beb1ee admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:16.974766 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 532/1060] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:16.980339 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327bb5b-403e-4675-ac46-08cf7ed9ae07 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:16.989897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327bb5b-403e-4675-ac46-08cf7ed9ae07 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:16.994299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a9e9d-df84-448c-8a73-39d3779f7bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:16.995061 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a9e9d-df84-448c-8a73-39d3779f7bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:16.995371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a9e9d-df84-448c-8a73-39d3779f7bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:16.995643 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a9e9d-df84-448c-8a73-39d3779f7bb3 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.003262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a9e9d-df84-448c-8a73-39d3779f7bb3 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:17.005371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a9e9d-df84-448c-8a73-39d3779f7bb3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:17.018671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-013a9e9d-df84-448c-8a73-39d3779f7bb3 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 04:17:17.019814 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 529/1061] 10.222.0.35 () {56 vars in 1114 bytes} [Sat Feb 12 04:17:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:17:17.025592 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcdc1d-1d3b-4702-91ca-c89789beb1ee admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:17.035904 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcdc1d-1d3b-4702-91ca-c89789beb1ee admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:17.040366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974158ee-1198-4542-8547-7def1ad0b6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:17.041010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974158ee-1198-4542-8547-7def1ad0b6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.041289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974158ee-1198-4542-8547-7def1ad0b6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.041560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974158ee-1198-4542-8547-7def1ad0b6a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.042401 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974158ee-1198-4542-8547-7def1ad0b6a5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:17.042703 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974158ee-1198-4542-8547-7def1ad0b6a5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:17.044561 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974158ee-1198-4542-8547-7def1ad0b6a5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:17.061529 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 533/1062] 10.222.0.35 () {56 vars in 1154 bytes} [Sat Feb 12 04:17:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:17.067341 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a9e9d-df84-448c-8a73-39d3779f7bb3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:17.076771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a9e9d-df84-448c-8a73-39d3779f7bb3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:17.081689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2651d-1d2b-4d07-a20e-ad766b7c2311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:17.082450 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2651d-1d2b-4d07-a20e-ad766b7c2311 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.082726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2651d-1d2b-4d07-a20e-ad766b7c2311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.082995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2651d-1d2b-4d07-a20e-ad766b7c2311 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.093571 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2651d-1d2b-4d07-a20e-ad766b7c2311 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:17.096216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2651d-1d2b-4d07-a20e-ad766b7c2311 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:17.112124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-28d2651d-1d2b-4d07-a20e-ad766b7c2311 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:17:17.113302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 530/1063] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:17:17.118873 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974158ee-1198-4542-8547-7def1ad0b6a5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:17.128346 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974158ee-1198-4542-8547-7def1ad0b6a5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:17.132787 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648f2ee-2748-46ae-98c8-2d8a857b0c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:17.133420 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648f2ee-2748-46ae-98c8-2d8a857b0c6f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.133699 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648f2ee-2748-46ae-98c8-2d8a857b0c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.133970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648f2ee-2748-46ae-98c8-2d8a857b0c6f admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.134694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648f2ee-2748-46ae-98c8-2d8a857b0c6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:17.134993 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648f2ee-2748-46ae-98c8-2d8a857b0c6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:17.136583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648f2ee-2748-46ae-98c8-2d8a857b0c6f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:17.148591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 534/1064] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:17.154296 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2651d-1d2b-4d07-a20e-ad766b7c2311 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:17.165318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2651d-1d2b-4d07-a20e-ad766b7c2311 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:17.169981 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f56b4-db4a-4d44-a688-80e7ffe075bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:17.170793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f56b4-db4a-4d44-a688-80e7ffe075bc admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.171069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f56b4-db4a-4d44-a688-80e7ffe075bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.171392 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f56b4-db4a-4d44-a688-80e7ffe075bc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.180182 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f56b4-db4a-4d44-a688-80e7ffe075bc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:17.182140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f56b4-db4a-4d44-a688-80e7ffe075bc admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:17.196025 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-293f56b4-db4a-4d44-a688-80e7ffe075bc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:17:17.197196 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 531/1065] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:17:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:17.203809 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648f2ee-2748-46ae-98c8-2d8a857b0c6f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:17.213453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648f2ee-2748-46ae-98c8-2d8a857b0c6f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:17.217928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda0d82-238d-47a1-b6eb-0607eb2badd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:17.218562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda0d82-238d-47a1-b6eb-0607eb2badd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.218897 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda0d82-238d-47a1-b6eb-0607eb2badd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.219175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda0d82-238d-47a1-b6eb-0607eb2badd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.220003 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda0d82-238d-47a1-b6eb-0607eb2badd4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:17.220310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda0d82-238d-47a1-b6eb-0607eb2badd4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:17.222158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda0d82-238d-47a1-b6eb-0607eb2badd4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:17.233814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 535/1066] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:17:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:17.239722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f56b4-db4a-4d44-a688-80e7ffe075bc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:17.249164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f56b4-db4a-4d44-a688-80e7ffe075bc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:17.254254 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb456ee-2f8c-4a39-a6b8-e4786d156de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:17.255113 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb456ee-2f8c-4a39-a6b8-e4786d156de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.255413 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb456ee-2f8c-4a39-a6b8-e4786d156de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.255680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb456ee-2f8c-4a39-a6b8-e4786d156de0 admin admin] PATH_INFO: `/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/362ab4aeb88746d8b8a14a238c877a53/roles/b69fe879299a4dba8bb1feb6600f3943` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.257857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb456ee-2f8c-4a39-a6b8-e4786d156de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e546ab571490aa0b23c0b22a35c4f, user_id=362ab4aeb88746d8b8a14a238c877a53, role_id=b69fe879299a4dba8bb1feb6600f3943)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:17.260516 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb456ee-2f8c-4a39-a6b8-e4786d156de0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:17.352597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 532/1067] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:17:17 2022] PUT /identity/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/362ab4aeb88746d8b8a14a238c877a53/roles/b69fe879299a4dba8bb1feb6600f3943 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:17:17.435709 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a79f5-095f-4457-aa97-919ddec03cf2 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.435889 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a79f5-095f-4457-aa97-919ddec03cf2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.436163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a79f5-095f-4457-aa97-919ddec03cf2 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.438553 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 536/1068] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:17.444530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d23c86-794b-4573-9cda-da59d1a3d9e1 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.444819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d23c86-794b-4573-9cda-da59d1a3d9e1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.445099 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d23c86-794b-4573-9cda-da59d1a3d9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.464755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-a0d23c86-794b-4573-9cda-da59d1a3d9e1 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:17.466031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a0d23c86-794b-4573-9cda-da59d1a3d9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:17.528191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 533/1069] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:17 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:17.552863 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a79f5-095f-4457-aa97-919ddec03cf2 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:17.565874 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a79f5-095f-4457-aa97-919ddec03cf2 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:17.570177 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf499b9-560b-4b03-9dde-6c9f71faa7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:17.570943 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf499b9-560b-4b03-9dde-6c9f71faa7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.571239 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf499b9-560b-4b03-9dde-6c9f71faa7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.571518 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf499b9-560b-4b03-9dde-6c9f71faa7e8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.581610 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf499b9-560b-4b03-9dde-6c9f71faa7e8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:17:17.588585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-faf499b9-560b-4b03-9dde-6c9f71faa7e8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:17:17.589753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 537/1070] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:17:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:17.595936 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d23c86-794b-4573-9cda-da59d1a3d9e1 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:17.605242 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d23c86-794b-4573-9cda-da59d1a3d9e1 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:17.610526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05519329-fe05-484d-a1ce-03e236b94039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:17.611178 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05519329-fe05-484d-a1ce-03e236b94039 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.611495 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05519329-fe05-484d-a1ce-03e236b94039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.611772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05519329-fe05-484d-a1ce-03e236b94039 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.612533 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05519329-fe05-484d-a1ce-03e236b94039 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:17.612838 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05519329-fe05-484d-a1ce-03e236b94039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:17.614472 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05519329-fe05-484d-a1ce-03e236b94039 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:17.622952 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 534/1071] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:17:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:17.629428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf499b9-560b-4b03-9dde-6c9f71faa7e8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:17.639841 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf499b9-560b-4b03-9dde-6c9f71faa7e8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:17.644524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2a425-9706-49d7-bd19-90403224442e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:17.645360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2a425-9706-49d7-bd19-90403224442e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.645638 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2a425-9706-49d7-bd19-90403224442e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.645908 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2a425-9706-49d7-bd19-90403224442e admin admin] PATH_INFO: `/v3/users/2aef4a5372d64fd0b81ebe199972f5e6` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.659349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2a425-9706-49d7-bd19-90403224442e admin admin] RBAC: Authorizing `identity:get_user(user_id=2aef4a5372d64fd0b81ebe199972f5e6)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:17.661463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2a425-9706-49d7-bd19-90403224442e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:17.663379 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 538/1072] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:17:17 2022] GET /identity/v3/users/2aef4a5372d64fd0b81ebe199972f5e6 => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:17.668853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05519329-fe05-484d-a1ce-03e236b94039 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:17.680000 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05519329-fe05-484d-a1ce-03e236b94039 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:17.684500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f007e-8aa3-41ef-896f-443d29c66416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:17.685160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f007e-8aa3-41ef-896f-443d29c66416 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.685438 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f007e-8aa3-41ef-896f-443d29c66416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.685706 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f007e-8aa3-41ef-896f-443d29c66416 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.694443 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f007e-8aa3-41ef-896f-443d29c66416 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:17.696143 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f007e-8aa3-41ef-896f-443d29c66416 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:17.705049 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 535/1073] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:17:17 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:17.710864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2a425-9706-49d7-bd19-90403224442e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:17.720625 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2a425-9706-49d7-bd19-90403224442e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:17.725245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ea45f-2196-4a59-8129-f41583e2c297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:17.726120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ea45f-2196-4a59-8129-f41583e2c297 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.726400 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ea45f-2196-4a59-8129-f41583e2c297 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.726670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ea45f-2196-4a59-8129-f41583e2c297 admin admin] PATH_INFO: `/v3/projects/e6177fb5c3654323844dc3a1c11abc0a` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.727886 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ea45f-2196-4a59-8129-f41583e2c297 admin admin] RBAC: Authorizing `identity:get_project(project_id=e6177fb5c3654323844dc3a1c11abc0a)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:17.729913 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ea45f-2196-4a59-8129-f41583e2c297 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:17.731568 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 539/1074] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:17:17 2022] GET /identity/v3/projects/e6177fb5c3654323844dc3a1c11abc0a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:17.738063 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f007e-8aa3-41ef-896f-443d29c66416 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:17.746914 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f007e-8aa3-41ef-896f-443d29c66416 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:17.751803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9f08b-a5cf-48d2-86b2-b708531904b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:17.752434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9f08b-a5cf-48d2-86b2-b708531904b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:17.752714 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9f08b-a5cf-48d2-86b2-b708531904b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:17.752985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9f08b-a5cf-48d2-86b2-b708531904b7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:17.753872 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9f08b-a5cf-48d2-86b2-b708531904b7 admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=e6177fb5c3654323844dc3a1c11abc0a, user.id=2aef4a5372d64fd0b81ebe199972f5e6) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:17.754182 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9f08b-a5cf-48d2-86b2-b708531904b7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:17.756023 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9f08b-a5cf-48d2-86b2-b708531904b7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:17.761356 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 536/1075] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:17:17 2022] GET /identity/v3/role_assignments?user.id=2aef4a5372d64fd0b81ebe199972f5e6&scope.project.id=e6177fb5c3654323844dc3a1c11abc0a&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:19.561930 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32f1f-3167-48d0-bac3-2562dcec35d1 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:19.563028 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32f1f-3167-48d0-bac3-2562dcec35d1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:19.563028 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe32f1f-3167-48d0-bac3-2562dcec35d1 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:19.564783 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 540/1076] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:19.570091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792abb3-d08f-477d-ba2e-5914022925c6 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:19.570520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792abb3-d08f-477d-ba2e-5914022925c6 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:19.570616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4792abb3-d08f-477d-ba2e-5914022925c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:19.588887 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-4792abb3-d08f-477d-ba2e-5914022925c6 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:19.590052 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-4792abb3-d08f-477d-ba2e-5914022925c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:19.598371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 537/1077] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:19.624632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe32f1f-3167-48d0-bac3-2562dcec35d1 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:19.639362 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe32f1f-3167-48d0-bac3-2562dcec35d1 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:19.644130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d267b1-2b14-48d9-8e1c-d5dd57e1e076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:19.644952 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d267b1-2b14-48d9-8e1c-d5dd57e1e076 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:19.645336 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d267b1-2b14-48d9-8e1c-d5dd57e1e076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:19.645702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d267b1-2b14-48d9-8e1c-d5dd57e1e076 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:19.657633 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d267b1-2b14-48d9-8e1c-d5dd57e1e076 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:17:19.665195 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-a1d267b1-2b14-48d9-8e1c-d5dd57e1e076 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Feb 12 04:17:19.666474 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 541/1078] 10.222.0.35 () {56 vars in 1141 bytes} [Sat Feb 12 04:17:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:19.673569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792abb3-d08f-477d-ba2e-5914022925c6 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:19.683107 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4792abb3-d08f-477d-ba2e-5914022925c6 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:19.687780 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eeb6c-a40c-452a-9e2a-3eb3cc601f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:19.688446 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eeb6c-a40c-452a-9e2a-3eb3cc601f66 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:19.688724 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eeb6c-a40c-452a-9e2a-3eb3cc601f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:19.688993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804eeb6c-a40c-452a-9e2a-3eb3cc601f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:19.689750 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804eeb6c-a40c-452a-9e2a-3eb3cc601f66 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:19.690047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804eeb6c-a40c-452a-9e2a-3eb3cc601f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:19.691662 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804eeb6c-a40c-452a-9e2a-3eb3cc601f66 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:19.700030 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 538/1079] 10.222.0.35 () {56 vars in 1136 bytes} [Sat Feb 12 04:17:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:19.705815 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d267b1-2b14-48d9-8e1c-d5dd57e1e076 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:19.715990 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d267b1-2b14-48d9-8e1c-d5dd57e1e076 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:19.721001 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca669a6-f42b-4f4c-a0d8-3798afbe9388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:19.721763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca669a6-f42b-4f4c-a0d8-3798afbe9388 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:19.722039 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca669a6-f42b-4f4c-a0d8-3798afbe9388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:19.722309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca669a6-f42b-4f4c-a0d8-3798afbe9388 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:19.732205 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca669a6-f42b-4f4c-a0d8-3798afbe9388 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:19.733987 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca669a6-f42b-4f4c-a0d8-3798afbe9388 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:19.750656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-dca669a6-f42b-4f4c-a0d8-3798afbe9388 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:17:19.751810 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 542/1080] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:19.757423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eeb6c-a40c-452a-9e2a-3eb3cc601f66 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:19.766986 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804eeb6c-a40c-452a-9e2a-3eb3cc601f66 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:19.771438 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3df70-a211-4988-844e-6a63c9bb9ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:19.772069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3df70-a211-4988-844e-6a63c9bb9ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:19.772385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3df70-a211-4988-844e-6a63c9bb9ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:19.772661 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3df70-a211-4988-844e-6a63c9bb9ee1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:19.773378 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3df70-a211-4988-844e-6a63c9bb9ee1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:19.773676 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3df70-a211-4988-844e-6a63c9bb9ee1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:19.775260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3df70-a211-4988-844e-6a63c9bb9ee1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:19.787407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 539/1081] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:19.793003 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca669a6-f42b-4f4c-a0d8-3798afbe9388 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:19.803124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca669a6-f42b-4f4c-a0d8-3798afbe9388 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:19.807914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb57a5-4436-46fb-9cd4-74113f2a5741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:19.808678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb57a5-4436-46fb-9cd4-74113f2a5741 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:19.808958 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb57a5-4436-46fb-9cd4-74113f2a5741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:19.809230 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb57a5-4436-46fb-9cd4-74113f2a5741 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:19.816611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb57a5-4436-46fb-9cd4-74113f2a5741 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:19.818527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb57a5-4436-46fb-9cd4-74113f2a5741 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:19.832445 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-8cfb57a5-4436-46fb-9cd4-74113f2a5741 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Feb 12 04:17:19.833584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 543/1082] 10.222.0.35 () {56 vars in 1114 bytes} [Sat Feb 12 04:17:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:17:19.839340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3df70-a211-4988-844e-6a63c9bb9ee1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:19.849450 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3df70-a211-4988-844e-6a63c9bb9ee1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:19.853833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcd943-2762-499f-9367-f2bd8cfdd5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:19.854471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd943-2762-499f-9367-f2bd8cfdd5ef admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:19.854749 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd943-2762-499f-9367-f2bd8cfdd5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:19.855020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcd943-2762-499f-9367-f2bd8cfdd5ef admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:19.855892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcd943-2762-499f-9367-f2bd8cfdd5ef admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:19.856192 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcd943-2762-499f-9367-f2bd8cfdd5ef admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:19.858008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcd943-2762-499f-9367-f2bd8cfdd5ef admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:19.880993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 540/1083] 10.222.0.35 () {56 vars in 1154 bytes} [Sat Feb 12 04:17:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:19.886717 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb57a5-4436-46fb-9cd4-74113f2a5741 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:19.898054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb57a5-4436-46fb-9cd4-74113f2a5741 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:19.902646 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a50811-c285-4936-b32b-6a16c025c6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:19.903303 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a50811-c285-4936-b32b-6a16c025c6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:19.903584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a50811-c285-4936-b32b-6a16c025c6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:19.903855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a50811-c285-4936-b32b-6a16c025c6d5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:19.912563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a50811-c285-4936-b32b-6a16c025c6d5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:19.914272 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a50811-c285-4936-b32b-6a16c025c6d5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:19.923071 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 544/1084] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:17:19 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:17:19.928597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcd943-2762-499f-9367-f2bd8cfdd5ef admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:19.938610 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcd943-2762-499f-9367-f2bd8cfdd5ef admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:19.942250 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af68350-7364-4d01-b08c-94a24b6dcd91 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:19.942538 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af68350-7364-4d01-b08c-94a24b6dcd91 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:19.942810 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af68350-7364-4d01-b08c-94a24b6dcd91 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:19.943259 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec94926-adb8-4c7c-9888-1d4720d07377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:19.944035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec94926-adb8-4c7c-9888-1d4720d07377 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:19.944318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec94926-adb8-4c7c-9888-1d4720d07377 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:19.944593 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec94926-adb8-4c7c-9888-1d4720d07377 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:19.946776 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 545/1085] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:17:19.954573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea48362-815f-42a4-8afd-c1f0b22a14d5 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:19.954857 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea48362-815f-42a4-8afd-c1f0b22a14d5 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:19.955140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea48362-815f-42a4-8afd-c1f0b22a14d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:19.956444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec94926-adb8-4c7c-9888-1d4720d07377 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:19.958300 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec94926-adb8-4c7c-9888-1d4720d07377 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:19.974762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-fea48362-815f-42a4-8afd-c1f0b22a14d5 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:19.975401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-2ec94926-adb8-4c7c-9888-1d4720d07377 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:17:19.976141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-fea48362-815f-42a4-8afd-c1f0b22a14d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:19.981258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 541/1086] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:19.982221 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec94926-adb8-4c7c-9888-1d4720d07377 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:19.984350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 546/1087] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:19 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:17:19.991619 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec94926-adb8-4c7c-9888-1d4720d07377 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:19.996129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d10e55-73ee-4598-8445-109a4761981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:19.996742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d10e55-73ee-4598-8445-109a4761981c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:19.997024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d10e55-73ee-4598-8445-109a4761981c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:19.997300 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d10e55-73ee-4598-8445-109a4761981c admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:19.998026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d10e55-73ee-4598-8445-109a4761981c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:19.998328 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d10e55-73ee-4598-8445-109a4761981c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:19.999934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d10e55-73ee-4598-8445-109a4761981c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:20.007589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea48362-815f-42a4-8afd-c1f0b22a14d5 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:20.012185 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 542/1088] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:20.018412 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d10e55-73ee-4598-8445-109a4761981c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:20.018559 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea48362-815f-42a4-8afd-c1f0b22a14d5 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:20.022860 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4e269-1210-400b-b35e-df26db047c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:20.023678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4e269-1210-400b-b35e-df26db047c08 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:20.023938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4e269-1210-400b-b35e-df26db047c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:20.024205 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4e269-1210-400b-b35e-df26db047c08 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:20.028157 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d10e55-73ee-4598-8445-109a4761981c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:20.033578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e51457-1eef-4252-9e0b-bfd87d8464bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:20.034348 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e51457-1eef-4252-9e0b-bfd87d8464bd admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:20.034629 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e51457-1eef-4252-9e0b-bfd87d8464bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:20.034903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e51457-1eef-4252-9e0b-bfd87d8464bd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:20.035697 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4e269-1210-400b-b35e-df26db047c08 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:17:20.041766 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e51457-1eef-4252-9e0b-bfd87d8464bd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:20.042384 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-7ed4e269-1210-400b-b35e-df26db047c08 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:17:20.043587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 547/1089] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:17:20.043751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e51457-1eef-4252-9e0b-bfd87d8464bd admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:20.049474 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4e269-1210-400b-b35e-df26db047c08 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:20.057066 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-35e51457-1eef-4252-9e0b-bfd87d8464bd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:17:20.062991 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 543/1090] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:17:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:17:20.063131 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4e269-1210-400b-b35e-df26db047c08 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:20.063968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cfcf9-0128-4032-9b08-6e97d302e60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:20.064102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e51457-1eef-4252-9e0b-bfd87d8464bd admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:20.064590 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cfcf9-0128-4032-9b08-6e97d302e60e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:20.064888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cfcf9-0128-4032-9b08-6e97d302e60e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:20.065140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1cfcf9-0128-4032-9b08-6e97d302e60e admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:20.065889 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cfcf9-0128-4032-9b08-6e97d302e60e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:20.066190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cfcf9-0128-4032-9b08-6e97d302e60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:20.067830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1cfcf9-0128-4032-9b08-6e97d302e60e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:20.074739 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e51457-1eef-4252-9e0b-bfd87d8464bd admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:20.076191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 548/1091] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:17:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:20.080154 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01accd12-f639-4077-8906-17526862cfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:20.080769 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01accd12-f639-4077-8906-17526862cfbe admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:20.081046 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01accd12-f639-4077-8906-17526862cfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:20.081315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01accd12-f639-4077-8906-17526862cfbe admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:20.082101 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01accd12-f639-4077-8906-17526862cfbe admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:20.082396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01accd12-f639-4077-8906-17526862cfbe admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:20.082560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cfcf9-0128-4032-9b08-6e97d302e60e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:20.084234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01accd12-f639-4077-8906-17526862cfbe admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:20.091549 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1cfcf9-0128-4032-9b08-6e97d302e60e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:20.100977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 544/1092] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:17:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:20.101115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cded3-55d1-48dd-959a-8ebae9d29cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:20.101115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cded3-55d1-48dd-959a-8ebae9d29cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:20.101115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cded3-55d1-48dd-959a-8ebae9d29cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:20.101115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2cded3-55d1-48dd-959a-8ebae9d29cd1 admin admin] PATH_INFO: `/v3/users/2aef4a5372d64fd0b81ebe199972f5e6` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:20.101465 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2cded3-55d1-48dd-959a-8ebae9d29cd1 admin admin] RBAC: Authorizing `identity:get_user(user_id=2aef4a5372d64fd0b81ebe199972f5e6)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:20.101465 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2cded3-55d1-48dd-959a-8ebae9d29cd1 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:20.101892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01accd12-f639-4077-8906-17526862cfbe admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:20.102904 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 549/1093] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:17:20 2022] GET /identity/v3/users/2aef4a5372d64fd0b81ebe199972f5e6 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:20.107966 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cded3-55d1-48dd-959a-8ebae9d29cd1 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:20.111345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01accd12-f639-4077-8906-17526862cfbe admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:20.115767 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da047b7a-5ecc-4300-bd66-f0f6495370a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:20.116369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da047b7a-5ecc-4300-bd66-f0f6495370a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:20.116644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da047b7a-5ecc-4300-bd66-f0f6495370a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:20.116913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da047b7a-5ecc-4300-bd66-f0f6495370a0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:20.117002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2cded3-55d1-48dd-959a-8ebae9d29cd1 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:20.117733 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da047b7a-5ecc-4300-bd66-f0f6495370a0 admin admin] RBAC: Adding query filter params (role.id=b69fe879299a4dba8bb1feb6600f3943, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=362ab4aeb88746d8b8a14a238c877a53) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:20.118033 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da047b7a-5ecc-4300-bd66-f0f6495370a0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:20.119845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da047b7a-5ecc-4300-bd66-f0f6495370a0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:20.121500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0c5e2-6ccf-4b50-9faf-6dd72620cc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:20.122276 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0c5e2-6ccf-4b50-9faf-6dd72620cc1b admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:20.122556 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0c5e2-6ccf-4b50-9faf-6dd72620cc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:20.122830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0c5e2-6ccf-4b50-9faf-6dd72620cc1b admin admin] PATH_INFO: `/v3/projects/e6177fb5c3654323844dc3a1c11abc0a` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:20.124011 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0c5e2-6ccf-4b50-9faf-6dd72620cc1b admin admin] RBAC: Authorizing `identity:get_project(project_id=e6177fb5c3654323844dc3a1c11abc0a)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:20.125703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 545/1094] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:17:20 2022] GET /identity/v3/role_assignments?user.id=362ab4aeb88746d8b8a14a238c877a53&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=b69fe879299a4dba8bb1feb6600f3943 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:20.126106 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0c5e2-6ccf-4b50-9faf-6dd72620cc1b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:20.132380 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 550/1095] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:17:20 2022] GET /identity/v3/projects/e6177fb5c3654323844dc3a1c11abc0a => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:20.133505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da047b7a-5ecc-4300-bd66-f0f6495370a0 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:20.144374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da047b7a-5ecc-4300-bd66-f0f6495370a0 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:20.149126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9d296-f698-4af7-b1a7-80318e65a66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:20.150144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9d296-f698-4af7-b1a7-80318e65a66d admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:20.150485 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9d296-f698-4af7-b1a7-80318e65a66d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:20.150818 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9d296-f698-4af7-b1a7-80318e65a66d admin admin] PATH_INFO: `/v3/projects/e6177fb5c3654323844dc3a1c11abc0a/users/2aef4a5372d64fd0b81ebe199972f5e6/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:20.152971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9d296-f698-4af7-b1a7-80318e65a66d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6177fb5c3654323844dc3a1c11abc0a, user_id=2aef4a5372d64fd0b81ebe199972f5e6, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:20.155705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9d296-f698-4af7-b1a7-80318e65a66d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:20.236515 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 546/1096] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:17:20 2022] PUT /identity/v3/projects/e6177fb5c3654323844dc3a1c11abc0a/users/2aef4a5372d64fd0b81ebe199972f5e6/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:17:22.433207 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75594506-d71a-4017-8c50-3a6e8e6f5967 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:22.433713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75594506-d71a-4017-8c50-3a6e8e6f5967 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:22.433798 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75594506-d71a-4017-8c50-3a6e8e6f5967 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:22.435519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 551/1097] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:22.441580 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451392c6-d7fa-45a9-86b9-b45745135b26 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:22.441981 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451392c6-d7fa-45a9-86b9-b45745135b26 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:22.442131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451392c6-d7fa-45a9-86b9-b45745135b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:22.459471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-451392c6-d7fa-45a9-86b9-b45745135b26 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:22.460650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-451392c6-d7fa-45a9-86b9-b45745135b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:22.516128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 547/1098] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:22 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:22.541549 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75594506-d71a-4017-8c50-3a6e8e6f5967 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:22.554104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75594506-d71a-4017-8c50-3a6e8e6f5967 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:22.558352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183871b-9e92-42e4-a058-cb6f84e78100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:22.559207 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183871b-9e92-42e4-a058-cb6f84e78100 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:22.559513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183871b-9e92-42e4-a058-cb6f84e78100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:22.559784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183871b-9e92-42e4-a058-cb6f84e78100 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:22.569702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183871b-9e92-42e4-a058-cb6f84e78100 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:17:22.576447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-9183871b-9e92-42e4-a058-cb6f84e78100 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:17:22.577640 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 552/1099] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:17:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:22.583505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451392c6-d7fa-45a9-86b9-b45745135b26 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:22.592265 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451392c6-d7fa-45a9-86b9-b45745135b26 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:22.597418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2481aaa-f5f6-4077-b36c-e2fc8acbdc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:22.598056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2481aaa-f5f6-4077-b36c-e2fc8acbdc84 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:22.598339 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2481aaa-f5f6-4077-b36c-e2fc8acbdc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:22.598613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2481aaa-f5f6-4077-b36c-e2fc8acbdc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:22.599404 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2481aaa-f5f6-4077-b36c-e2fc8acbdc84 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:22.599710 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2481aaa-f5f6-4077-b36c-e2fc8acbdc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:22.601296 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2481aaa-f5f6-4077-b36c-e2fc8acbdc84 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:22.609909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 548/1100] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:17:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:22.615124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183871b-9e92-42e4-a058-cb6f84e78100 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:22.625466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183871b-9e92-42e4-a058-cb6f84e78100 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:22.629838 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e011a1b-840d-4b6f-99a2-522e3d354121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:22.630653 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e011a1b-840d-4b6f-99a2-522e3d354121 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:22.630928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e011a1b-840d-4b6f-99a2-522e3d354121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:22.631195 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e011a1b-840d-4b6f-99a2-522e3d354121 admin admin] PATH_INFO: `/v3/users/2aef4a5372d64fd0b81ebe199972f5e6` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:22.632397 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e011a1b-840d-4b6f-99a2-522e3d354121 admin admin] RBAC: Authorizing `identity:get_user(user_id=2aef4a5372d64fd0b81ebe199972f5e6)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:22.634450 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e011a1b-840d-4b6f-99a2-522e3d354121 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:22.636023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 553/1101] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:17:22 2022] GET /identity/v3/users/2aef4a5372d64fd0b81ebe199972f5e6 => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:22.642502 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2481aaa-f5f6-4077-b36c-e2fc8acbdc84 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:22.651774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2481aaa-f5f6-4077-b36c-e2fc8acbdc84 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:22.656330 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fc167-ae9d-4e92-8744-9b057d82741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:22.656943 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fc167-ae9d-4e92-8744-9b057d82741c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:22.657226 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fc167-ae9d-4e92-8744-9b057d82741c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:22.657503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429fc167-ae9d-4e92-8744-9b057d82741c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:22.665156 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fc167-ae9d-4e92-8744-9b057d82741c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:22.666868 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429fc167-ae9d-4e92-8744-9b057d82741c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:22.676087 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 549/1102] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:17:22 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:22.681870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e011a1b-840d-4b6f-99a2-522e3d354121 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:22.691924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e011a1b-840d-4b6f-99a2-522e3d354121 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:22.696621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a30aef-b54f-435f-a1fa-e6737497a329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:22.697449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a30aef-b54f-435f-a1fa-e6737497a329 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:22.698977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a30aef-b54f-435f-a1fa-e6737497a329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:22.698977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a30aef-b54f-435f-a1fa-e6737497a329 admin admin] PATH_INFO: `/v3/projects/e6177fb5c3654323844dc3a1c11abc0a` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:22.699157 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a30aef-b54f-435f-a1fa-e6737497a329 admin admin] RBAC: Authorizing `identity:get_project(project_id=e6177fb5c3654323844dc3a1c11abc0a)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:22.701208 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a30aef-b54f-435f-a1fa-e6737497a329 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:22.703866 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 554/1103] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:17:22 2022] GET /identity/v3/projects/e6177fb5c3654323844dc3a1c11abc0a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:22.709186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fc167-ae9d-4e92-8744-9b057d82741c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:22.717753 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429fc167-ae9d-4e92-8744-9b057d82741c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:22.722353 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156ef53-41e2-4688-ad4b-a121ce5056c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:22.722972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156ef53-41e2-4688-ad4b-a121ce5056c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:22.723283 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156ef53-41e2-4688-ad4b-a121ce5056c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:22.723560 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156ef53-41e2-4688-ad4b-a121ce5056c8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:22.724392 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156ef53-41e2-4688-ad4b-a121ce5056c8 admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=e6177fb5c3654323844dc3a1c11abc0a, user.id=2aef4a5372d64fd0b81ebe199972f5e6) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:22.724699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156ef53-41e2-4688-ad4b-a121ce5056c8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:22.726520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156ef53-41e2-4688-ad4b-a121ce5056c8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:22.732135 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 550/1104] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:17:22 2022] GET /identity/v3/role_assignments?user.id=2aef4a5372d64fd0b81ebe199972f5e6&scope.project.id=e6177fb5c3654323844dc3a1c11abc0a&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:24.943908 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31117257-9fc2-43d3-9786-3c5169cf98ca None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:24.944459 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31117257-9fc2-43d3-9786-3c5169cf98ca None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:24.944459 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31117257-9fc2-43d3-9786-3c5169cf98ca None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:24.946184 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 555/1105] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:24.951523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0387293-1f46-4ffa-a8d8-ecae6c8117c5 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:24.951951 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0387293-1f46-4ffa-a8d8-ecae6c8117c5 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:24.952073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0387293-1f46-4ffa-a8d8-ecae6c8117c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:24.970233 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-d0387293-1f46-4ffa-a8d8-ecae6c8117c5 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:24.971436 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d0387293-1f46-4ffa-a8d8-ecae6c8117c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:24.978934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 551/1106] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:24 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:25.004169 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31117257-9fc2-43d3-9786-3c5169cf98ca None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:25.016013 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31117257-9fc2-43d3-9786-3c5169cf98ca None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:25.020275 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0314a4-22e9-4a00-87e4-3375633e965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:25.021053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0314a4-22e9-4a00-87e4-3375633e965f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:25.021327 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0314a4-22e9-4a00-87e4-3375633e965f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:25.021597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0314a4-22e9-4a00-87e4-3375633e965f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:25.022747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0314a4-22e9-4a00-87e4-3375633e965f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:25.024441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0314a4-22e9-4a00-87e4-3375633e965f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:25.025949 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 556/1107] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:25.031645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0387293-1f46-4ffa-a8d8-ecae6c8117c5 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:25.040314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0387293-1f46-4ffa-a8d8-ecae6c8117c5 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:25.044785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ff156-fcc1-4dc8-8f1a-91d450279cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:25.045428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ff156-fcc1-4dc8-8f1a-91d450279cc6 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:25.045709 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ff156-fcc1-4dc8-8f1a-91d450279cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:25.045981 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ff156-fcc1-4dc8-8f1a-91d450279cc6 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:25.047334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ff156-fcc1-4dc8-8f1a-91d450279cc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:25.049210 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ff156-fcc1-4dc8-8f1a-91d450279cc6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:25.147109 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 552/1108] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:17:25 2022] POST /identity/v3/users => generated 286 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:17:27.400103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68479c5a-cd50-4cfc-bd77-0c533c991f5d None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:27.402602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68479c5a-cd50-4cfc-bd77-0c533c991f5d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:27.402602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68479c5a-cd50-4cfc-bd77-0c533c991f5d None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:27.402602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 557/1109] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:27.409055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edce411-a881-4da0-9eaa-83582d64c868 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:27.409514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edce411-a881-4da0-9eaa-83582d64c868 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:27.409614 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edce411-a881-4da0-9eaa-83582d64c868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:27.427523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-3edce411-a881-4da0-9eaa-83582d64c868 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:27.429010 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3edce411-a881-4da0-9eaa-83582d64c868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:27.436572 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 553/1110] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:27 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:27.460274 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68479c5a-cd50-4cfc-bd77-0c533c991f5d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:27.472148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68479c5a-cd50-4cfc-bd77-0c533c991f5d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:27.476616 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f7627-ffa5-411f-92c2-87ae51ea4fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:27.477437 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f7627-ffa5-411f-92c2-87ae51ea4fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:27.477712 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f7627-ffa5-411f-92c2-87ae51ea4fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:27.477978 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f7627-ffa5-411f-92c2-87ae51ea4fc3 admin admin] PATH_INFO: `/v3/roles/b9252c31847f4513a49cd10bb4f9cdaa` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:27.479477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f7627-ffa5-411f-92c2-87ae51ea4fc3 admin admin] RBAC: Authorizing `identity:get_role(role_id=b9252c31847f4513a49cd10bb4f9cdaa)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:27.480474 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-947f7627-ffa5-411f-92c2-87ae51ea4fc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:17:27.480474 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:17:27.480474 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:17:27.481337 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f7627-ffa5-411f-92c2-87ae51ea4fc3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:27.482614 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 558/1111] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:17:27 2022] GET /identity/v3/roles/b9252c31847f4513a49cd10bb4f9cdaa => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:27.488428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edce411-a881-4da0-9eaa-83582d64c868 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:27.497111 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edce411-a881-4da0-9eaa-83582d64c868 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:27.502097 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686cadd-73f8-4895-aabf-eecb63462ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:27.502927 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686cadd-73f8-4895-aabf-eecb63462ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:27.503206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686cadd-73f8-4895-aabf-eecb63462ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:27.503507 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9686cadd-73f8-4895-aabf-eecb63462ba5 admin admin] PATH_INFO: `/v3/users/55e52f8967a3475c9c8e9f8ae50a4a24` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:27.516471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686cadd-73f8-4895-aabf-eecb63462ba5 admin admin] RBAC: Authorizing `identity:get_user(user_id=55e52f8967a3475c9c8e9f8ae50a4a24)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:27.518565 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9686cadd-73f8-4895-aabf-eecb63462ba5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:27.520200 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 554/1112] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:17:27 2022] GET /identity/v3/users/55e52f8967a3475c9c8e9f8ae50a4a24 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:27.525526 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f7627-ffa5-411f-92c2-87ae51ea4fc3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:27.534833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f7627-ffa5-411f-92c2-87ae51ea4fc3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:27.539175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffbc2d-3da8-46ee-b183-14793ccbd0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:27.539807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffbc2d-3da8-46ee-b183-14793ccbd0a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:27.540084 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffbc2d-3da8-46ee-b183-14793ccbd0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:27.540353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ffbc2d-3da8-46ee-b183-14793ccbd0a2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:27.548491 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffbc2d-3da8-46ee-b183-14793ccbd0a2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:27.550171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ffbc2d-3da8-46ee-b183-14793ccbd0a2 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:27.558894 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 559/1113] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:17:27 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:27.564755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686cadd-73f8-4895-aabf-eecb63462ba5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:27.573933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9686cadd-73f8-4895-aabf-eecb63462ba5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:27.578374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bdd137-7626-4ec4-ab33-fa30a93b1e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:27.579173 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd137-7626-4ec4-ab33-fa30a93b1e81 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:27.579489 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd137-7626-4ec4-ab33-fa30a93b1e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:27.579762 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bdd137-7626-4ec4-ab33-fa30a93b1e81 admin admin] PATH_INFO: `/v3/projects/e6177fb5c3654323844dc3a1c11abc0a` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:27.580929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdd137-7626-4ec4-ab33-fa30a93b1e81 admin admin] RBAC: Authorizing `identity:get_project(project_id=e6177fb5c3654323844dc3a1c11abc0a)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:27.582893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bdd137-7626-4ec4-ab33-fa30a93b1e81 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:27.584517 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 555/1114] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:17:27 2022] GET /identity/v3/projects/e6177fb5c3654323844dc3a1c11abc0a => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:27.589869 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffbc2d-3da8-46ee-b183-14793ccbd0a2 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:27.598257 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ffbc2d-3da8-46ee-b183-14793ccbd0a2 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:27.602650 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef76e73-e365-4619-acd7-e008951dac72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:27.603306 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef76e73-e365-4619-acd7-e008951dac72 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:27.603586 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef76e73-e365-4619-acd7-e008951dac72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:27.603856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef76e73-e365-4619-acd7-e008951dac72 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:27.604668 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef76e73-e365-4619-acd7-e008951dac72 admin admin] RBAC: Adding query filter params (role.id=b9252c31847f4513a49cd10bb4f9cdaa, scope.project.id=e6177fb5c3654323844dc3a1c11abc0a, user.id=55e52f8967a3475c9c8e9f8ae50a4a24) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:27.605005 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef76e73-e365-4619-acd7-e008951dac72 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:27.606750 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef76e73-e365-4619-acd7-e008951dac72 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:27.612589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 560/1115] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:17:27 2022] GET /identity/v3/role_assignments?user.id=55e52f8967a3475c9c8e9f8ae50a4a24&scope.project.id=e6177fb5c3654323844dc3a1c11abc0a&role.id=b9252c31847f4513a49cd10bb4f9cdaa => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:29.777650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812bbfe-7fc5-467f-ba3e-5d0b19a2841a None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:29.778195 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812bbfe-7fc5-467f-ba3e-5d0b19a2841a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:29.778195 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812bbfe-7fc5-467f-ba3e-5d0b19a2841a None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:29.780005 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 556/1116] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:29.785462 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb07e9-3464-457d-89d0-88b5930c5746 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:29.785878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb07e9-3464-457d-89d0-88b5930c5746 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:29.785984 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb07e9-3464-457d-89d0-88b5930c5746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:29.803884 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-a3eb07e9-3464-457d-89d0-88b5930c5746 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:29.805042 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a3eb07e9-3464-457d-89d0-88b5930c5746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:29.813240 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 561/1117] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:29.836286 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812bbfe-7fc5-467f-ba3e-5d0b19a2841a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:29.848545 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812bbfe-7fc5-467f-ba3e-5d0b19a2841a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:29.852912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621be26-6802-4b79-8a46-9242cc493038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:29.853728 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621be26-6802-4b79-8a46-9242cc493038 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:29.854008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621be26-6802-4b79-8a46-9242cc493038 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:29.854280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5621be26-6802-4b79-8a46-9242cc493038 admin admin] PATH_INFO: `/v3/roles/b9252c31847f4513a49cd10bb4f9cdaa` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:29.855771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621be26-6802-4b79-8a46-9242cc493038 admin admin] RBAC: Authorizing `identity:get_role(role_id=b9252c31847f4513a49cd10bb4f9cdaa)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:29.856776 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-5621be26-6802-4b79-8a46-9242cc493038 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:17:29.856776 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:17:29.856776 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:17:29.857641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5621be26-6802-4b79-8a46-9242cc493038 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:29.859598 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 557/1118] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:17:29 2022] GET /identity/v3/roles/b9252c31847f4513a49cd10bb4f9cdaa => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:29.864957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb07e9-3464-457d-89d0-88b5930c5746 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:29.873619 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb07e9-3464-457d-89d0-88b5930c5746 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:29.878944 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90022948-10e1-40e1-a8db-5c701e5d80a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:29.879820 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90022948-10e1-40e1-a8db-5c701e5d80a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:29.880102 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90022948-10e1-40e1-a8db-5c701e5d80a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:29.880378 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90022948-10e1-40e1-a8db-5c701e5d80a7 admin admin] PATH_INFO: `/v3/users/55e52f8967a3475c9c8e9f8ae50a4a24` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:29.881579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90022948-10e1-40e1-a8db-5c701e5d80a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=55e52f8967a3475c9c8e9f8ae50a4a24)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:29.883711 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90022948-10e1-40e1-a8db-5c701e5d80a7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:29.885255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 562/1119] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:17:29 2022] GET /identity/v3/users/55e52f8967a3475c9c8e9f8ae50a4a24 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:29.890575 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621be26-6802-4b79-8a46-9242cc493038 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:29.900070 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5621be26-6802-4b79-8a46-9242cc493038 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:29.904483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4831e7f-82f7-4d87-b533-e61d7e42ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:29.905278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4831e7f-82f7-4d87-b533-e61d7e42ce1a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:29.905552 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4831e7f-82f7-4d87-b533-e61d7e42ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:29.905931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4831e7f-82f7-4d87-b533-e61d7e42ce1a admin admin] PATH_INFO: `/v3/projects/e6177fb5c3654323844dc3a1c11abc0a` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:29.907153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4831e7f-82f7-4d87-b533-e61d7e42ce1a admin admin] RBAC: Authorizing `identity:get_project(project_id=e6177fb5c3654323844dc3a1c11abc0a)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:29.909157 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4831e7f-82f7-4d87-b533-e61d7e42ce1a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:29.910748 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 558/1120] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:17:29 2022] GET /identity/v3/projects/e6177fb5c3654323844dc3a1c11abc0a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:29.916124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90022948-10e1-40e1-a8db-5c701e5d80a7 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:29.925975 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90022948-10e1-40e1-a8db-5c701e5d80a7 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:29.930601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcee560-a168-4649-a885-ce3abfc2ca30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:29.931472 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcee560-a168-4649-a885-ce3abfc2ca30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:29.931757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcee560-a168-4649-a885-ce3abfc2ca30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:29.932031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcee560-a168-4649-a885-ce3abfc2ca30 admin admin] PATH_INFO: `/v3/projects/e6177fb5c3654323844dc3a1c11abc0a/users/55e52f8967a3475c9c8e9f8ae50a4a24/roles/b9252c31847f4513a49cd10bb4f9cdaa` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:29.934223 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcee560-a168-4649-a885-ce3abfc2ca30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6177fb5c3654323844dc3a1c11abc0a, user_id=55e52f8967a3475c9c8e9f8ae50a4a24, role_id=b9252c31847f4513a49cd10bb4f9cdaa)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:29.936832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcee560-a168-4649-a885-ce3abfc2ca30 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:30.014278 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 563/1121] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:17:29 2022] PUT /identity/v3/projects/e6177fb5c3654323844dc3a1c11abc0a/users/55e52f8967a3475c9c8e9f8ae50a4a24/roles/b9252c31847f4513a49cd10bb4f9cdaa => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:17:32.180074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c15e6-a18b-42df-8e92-32a71bb89462 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:32.180633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c15e6-a18b-42df-8e92-32a71bb89462 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:32.180633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47c15e6-a18b-42df-8e92-32a71bb89462 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:32.182355 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 559/1122] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:32.188061 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1af45-948b-4c3d-aae2-8264edccddd0 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:32.188506 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1af45-948b-4c3d-aae2-8264edccddd0 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:32.188601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1af45-948b-4c3d-aae2-8264edccddd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:32.206640 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-49b1af45-948b-4c3d-aae2-8264edccddd0 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:32.207853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-49b1af45-948b-4c3d-aae2-8264edccddd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:32.262759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 564/1123] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:32 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:17:32.287472 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c15e6-a18b-42df-8e92-32a71bb89462 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:32.300099 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47c15e6-a18b-42df-8e92-32a71bb89462 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:32.304712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d78a6-9295-441b-99fb-494f0895960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:32.305534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d78a6-9295-441b-99fb-494f0895960a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:32.305817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d78a6-9295-441b-99fb-494f0895960a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:32.306090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919d78a6-9295-441b-99fb-494f0895960a admin admin] PATH_INFO: `/v3/roles/b9252c31847f4513a49cd10bb4f9cdaa` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:32.307580 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d78a6-9295-441b-99fb-494f0895960a admin admin] RBAC: Authorizing `identity:get_role(role_id=b9252c31847f4513a49cd10bb4f9cdaa)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:32.309160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919d78a6-9295-441b-99fb-494f0895960a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:32.310471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 560/1124] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:17:32 2022] GET /identity/v3/roles/b9252c31847f4513a49cd10bb4f9cdaa => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:32.315843 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1af45-948b-4c3d-aae2-8264edccddd0 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:32.324431 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1af45-948b-4c3d-aae2-8264edccddd0 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:32.328942 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b0a42-cca9-4c36-9172-68f111b5920d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:32.329772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b0a42-cca9-4c36-9172-68f111b5920d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:32.330049 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b0a42-cca9-4c36-9172-68f111b5920d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:32.330319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1b0a42-cca9-4c36-9172-68f111b5920d admin admin] PATH_INFO: `/v3/users/55e52f8967a3475c9c8e9f8ae50a4a24` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:32.331528 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b0a42-cca9-4c36-9172-68f111b5920d admin admin] RBAC: Authorizing `identity:get_user(user_id=55e52f8967a3475c9c8e9f8ae50a4a24)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:32.333594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1b0a42-cca9-4c36-9172-68f111b5920d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:32.335114 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 565/1125] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:17:32 2022] GET /identity/v3/users/55e52f8967a3475c9c8e9f8ae50a4a24 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:32.340335 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d78a6-9295-441b-99fb-494f0895960a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:32.350199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919d78a6-9295-441b-99fb-494f0895960a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:32.354666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2c59d-f0a6-47cb-a22d-b309ca26620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:32.355283 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2c59d-f0a6-47cb-a22d-b309ca26620c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:32.355568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2c59d-f0a6-47cb-a22d-b309ca26620c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:32.355846 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2c59d-f0a6-47cb-a22d-b309ca26620c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:32.364019 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2c59d-f0a6-47cb-a22d-b309ca26620c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:32.365707 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2c59d-f0a6-47cb-a22d-b309ca26620c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:32.374322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 561/1126] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:17:32 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:32.379765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b0a42-cca9-4c36-9172-68f111b5920d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:32.388975 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1b0a42-cca9-4c36-9172-68f111b5920d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:32.393614 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9499ad-aacc-4b50-bec6-34efba024a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:32.394400 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9499ad-aacc-4b50-bec6-34efba024a1a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:32.394677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9499ad-aacc-4b50-bec6-34efba024a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:32.394946 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9499ad-aacc-4b50-bec6-34efba024a1a admin admin] PATH_INFO: `/v3/projects/e6177fb5c3654323844dc3a1c11abc0a` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:32.396145 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9499ad-aacc-4b50-bec6-34efba024a1a admin admin] RBAC: Authorizing `identity:get_project(project_id=e6177fb5c3654323844dc3a1c11abc0a)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:32.398117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9499ad-aacc-4b50-bec6-34efba024a1a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:32.399735 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 566/1127] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:17:32 2022] GET /identity/v3/projects/e6177fb5c3654323844dc3a1c11abc0a => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:32.405141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2c59d-f0a6-47cb-a22d-b309ca26620c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:32.414206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2c59d-f0a6-47cb-a22d-b309ca26620c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:32.418606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcf59d-27dc-4b8e-9d36-617aa9b7658f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:32.419207 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcf59d-27dc-4b8e-9d36-617aa9b7658f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:32.419517 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcf59d-27dc-4b8e-9d36-617aa9b7658f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:32.419790 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcf59d-27dc-4b8e-9d36-617aa9b7658f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:32.420606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcf59d-27dc-4b8e-9d36-617aa9b7658f admin admin] RBAC: Adding query filter params (role.id=b9252c31847f4513a49cd10bb4f9cdaa, scope.project.id=e6177fb5c3654323844dc3a1c11abc0a, user.id=55e52f8967a3475c9c8e9f8ae50a4a24) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:32.420909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcf59d-27dc-4b8e-9d36-617aa9b7658f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:32.423421 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcf59d-27dc-4b8e-9d36-617aa9b7658f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:32.429210 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 562/1128] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:17:32 2022] GET /identity/v3/role_assignments?user.id=55e52f8967a3475c9c8e9f8ae50a4a24&scope.project.id=e6177fb5c3654323844dc3a1c11abc0a&role.id=b9252c31847f4513a49cd10bb4f9cdaa => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:34.647376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bf6e2-115b-4b35-a4ca-e06997a5a010 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:34.647888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bf6e2-115b-4b35-a4ca-e06997a5a010 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:34.647888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17bf6e2-115b-4b35-a4ca-e06997a5a010 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:34.649585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 567/1129] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:34.655014 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ddb52-ff45-4d68-a77b-bacb442ddc6c None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:34.656002 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ddb52-ff45-4d68-a77b-bacb442ddc6c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:34.656131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ddb52-ff45-4d68-a77b-bacb442ddc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:34.673800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-d91ddb52-ff45-4d68-a77b-bacb442ddc6c None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:34.674976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d91ddb52-ff45-4d68-a77b-bacb442ddc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:34.682789 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 563/1130] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:34.705918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bf6e2-115b-4b35-a4ca-e06997a5a010 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:34.717623 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17bf6e2-115b-4b35-a4ca-e06997a5a010 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:34.722460 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44cee71-c9a3-42b1-9266-a0c0e0bd1897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:34.723215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cee71-c9a3-42b1-9266-a0c0e0bd1897 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:34.723516 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cee71-c9a3-42b1-9266-a0c0e0bd1897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:34.723782 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44cee71-c9a3-42b1-9266-a0c0e0bd1897 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:34.724939 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cee71-c9a3-42b1-9266-a0c0e0bd1897 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:34.726631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44cee71-c9a3-42b1-9266-a0c0e0bd1897 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:34.728175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 568/1131] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:34.733358 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ddb52-ff45-4d68-a77b-bacb442ddc6c None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:34.742769 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ddb52-ff45-4d68-a77b-bacb442ddc6c None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:34.747116 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8b3cd-19a3-4a98-92b0-50a6f13ea4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:34.747781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8b3cd-19a3-4a98-92b0-50a6f13ea4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:34.748069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8b3cd-19a3-4a98-92b0-50a6f13ea4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:34.748328 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8b3cd-19a3-4a98-92b0-50a6f13ea4f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:34.749029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8b3cd-19a3-4a98-92b0-50a6f13ea4f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:34.751021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a8b3cd-19a3-4a98-92b0-50a6f13ea4f4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:34.835651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 564/1132] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Feb 12 04:17:34 2022] POST /identity/v3/projects => generated 311 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:17:37.041833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64040ee3-53cc-4eae-b264-b13c9b088cca None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:37.042363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64040ee3-53cc-4eae-b264-b13c9b088cca None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:37.042363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64040ee3-53cc-4eae-b264-b13c9b088cca None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:37.044122 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 569/1133] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:37.050103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47807dc-74e6-41b9-9240-c9a3e1a69790 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:37.050509 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47807dc-74e6-41b9-9240-c9a3e1a69790 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:37.050661 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47807dc-74e6-41b9-9240-c9a3e1a69790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:37.068219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c47807dc-74e6-41b9-9240-c9a3e1a69790 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:37.069390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c47807dc-74e6-41b9-9240-c9a3e1a69790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:37.124470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 565/1134] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:37.149674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64040ee3-53cc-4eae-b264-b13c9b088cca None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:37.162016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64040ee3-53cc-4eae-b264-b13c9b088cca None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:37.166215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e02ad8-2e16-4a6f-8185-97fb82bc3bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:37.166963 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e02ad8-2e16-4a6f-8185-97fb82bc3bfe admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:37.167262 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e02ad8-2e16-4a6f-8185-97fb82bc3bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:37.167534 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e02ad8-2e16-4a6f-8185-97fb82bc3bfe admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:37.168686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e02ad8-2e16-4a6f-8185-97fb82bc3bfe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:37.170338 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e02ad8-2e16-4a6f-8185-97fb82bc3bfe admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:37.172078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 570/1135] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:17:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:37.177401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47807dc-74e6-41b9-9240-c9a3e1a69790 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:37.186374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47807dc-74e6-41b9-9240-c9a3e1a69790 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:37.190839 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef97bce9-7fb8-4ccf-ae47-d88dbb068026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:37.191510 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97bce9-7fb8-4ccf-ae47-d88dbb068026 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:37.191794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97bce9-7fb8-4ccf-ae47-d88dbb068026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:37.192070 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97bce9-7fb8-4ccf-ae47-d88dbb068026 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:37.192785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97bce9-7fb8-4ccf-ae47-d88dbb068026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:37.194677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef97bce9-7fb8-4ccf-ae47-d88dbb068026 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:37.298164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 566/1136] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:17:37 2022] POST /identity/v3/users => generated 286 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:17:39.543551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac980bcc-6160-4461-91c8-5d9237198c9a None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:39.544061 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac980bcc-6160-4461-91c8-5d9237198c9a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:39.544061 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac980bcc-6160-4461-91c8-5d9237198c9a None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:39.545759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 571/1137] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:39.551624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338cb20-9245-43c5-a571-1a31250c07ca None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:39.552058 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338cb20-9245-43c5-a571-1a31250c07ca None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:39.552162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6338cb20-9245-43c5-a571-1a31250c07ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:39.570399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-6338cb20-9245-43c5-a571-1a31250c07ca None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:39.571605 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-6338cb20-9245-43c5-a571-1a31250c07ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:39.579247 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 567/1138] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:39.602641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac980bcc-6160-4461-91c8-5d9237198c9a None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:39.614986 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac980bcc-6160-4461-91c8-5d9237198c9a None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:39.619245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8d221-54f7-4078-8f29-ea5e3eb6d7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:39.620007 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8d221-54f7-4078-8f29-ea5e3eb6d7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:39.620283 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8d221-54f7-4078-8f29-ea5e3eb6d7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:39.620553 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8d221-54f7-4078-8f29-ea5e3eb6d7f0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:39.630976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8d221-54f7-4078-8f29-ea5e3eb6d7f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:17:39.637752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-1fe8d221-54f7-4078-8f29-ea5e3eb6d7f0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:17:39.638867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 572/1139] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:17:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:39.644623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338cb20-9245-43c5-a571-1a31250c07ca None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:39.653270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6338cb20-9245-43c5-a571-1a31250c07ca None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:39.657854 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce8ad4-cce1-44f9-9630-b062feebd598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:39.658490 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce8ad4-cce1-44f9-9630-b062feebd598 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:39.658771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce8ad4-cce1-44f9-9630-b062feebd598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:39.659046 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce8ad4-cce1-44f9-9630-b062feebd598 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:39.659840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce8ad4-cce1-44f9-9630-b062feebd598 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:39.660146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce8ad4-cce1-44f9-9630-b062feebd598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:39.661708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce8ad4-cce1-44f9-9630-b062feebd598 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:39.669666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 568/1140] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:17:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:39.675589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8d221-54f7-4078-8f29-ea5e3eb6d7f0 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:39.685520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8d221-54f7-4078-8f29-ea5e3eb6d7f0 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:39.690560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd96043-3a2b-43da-803e-a6d2d198a6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:39.691406 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd96043-3a2b-43da-803e-a6d2d198a6bf admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:39.691680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd96043-3a2b-43da-803e-a6d2d198a6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:39.691948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd96043-3a2b-43da-803e-a6d2d198a6bf admin admin] PATH_INFO: `/v3/users/e444c9ecf4be4cd49f00fc69ec9d8dbc` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:39.704696 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd96043-3a2b-43da-803e-a6d2d198a6bf admin admin] RBAC: Authorizing `identity:get_user(user_id=e444c9ecf4be4cd49f00fc69ec9d8dbc)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:39.706761 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd96043-3a2b-43da-803e-a6d2d198a6bf admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:39.708338 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 573/1141] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:17:39 2022] GET /identity/v3/users/e444c9ecf4be4cd49f00fc69ec9d8dbc => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:39.713738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce8ad4-cce1-44f9-9630-b062feebd598 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:39.723511 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce8ad4-cce1-44f9-9630-b062feebd598 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:39.727954 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb445d-3851-480b-97ae-204fb74269f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:39.728559 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb445d-3851-480b-97ae-204fb74269f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:39.728837 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb445d-3851-480b-97ae-204fb74269f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:39.729109 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb445d-3851-480b-97ae-204fb74269f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:39.737308 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb445d-3851-480b-97ae-204fb74269f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:39.739003 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb445d-3851-480b-97ae-204fb74269f6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:39.747468 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 569/1142] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:17:39 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:39.752916 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd96043-3a2b-43da-803e-a6d2d198a6bf admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:39.761979 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd96043-3a2b-43da-803e-a6d2d198a6bf admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:39.766739 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729412c-674d-4737-8810-ecb6847c6024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:39.767582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729412c-674d-4737-8810-ecb6847c6024 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:39.767855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729412c-674d-4737-8810-ecb6847c6024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:39.768123 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729412c-674d-4737-8810-ecb6847c6024 admin admin] PATH_INFO: `/v3/projects/1332a53419554e9eb69fa7cc98ea918a` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:39.769266 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729412c-674d-4737-8810-ecb6847c6024 admin admin] RBAC: Authorizing `identity:get_project(project_id=1332a53419554e9eb69fa7cc98ea918a)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:39.771249 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729412c-674d-4737-8810-ecb6847c6024 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:39.773015 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 574/1143] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:17:39 2022] GET /identity/v3/projects/1332a53419554e9eb69fa7cc98ea918a => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:39.778171 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb445d-3851-480b-97ae-204fb74269f6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:39.787040 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb445d-3851-480b-97ae-204fb74269f6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:39.791481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd5006-cd99-4d35-b82c-d5510cd4a4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:39.792077 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd5006-cd99-4d35-b82c-d5510cd4a4b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:39.792354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd5006-cd99-4d35-b82c-d5510cd4a4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:39.792625 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd5006-cd99-4d35-b82c-d5510cd4a4b3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:39.793441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd5006-cd99-4d35-b82c-d5510cd4a4b3 admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=1332a53419554e9eb69fa7cc98ea918a, user.id=e444c9ecf4be4cd49f00fc69ec9d8dbc) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:39.793787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd5006-cd99-4d35-b82c-d5510cd4a4b3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:39.795531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd5006-cd99-4d35-b82c-d5510cd4a4b3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:39.801233 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 570/1144] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:17:39 2022] GET /identity/v3/role_assignments?user.id=e444c9ecf4be4cd49f00fc69ec9d8dbc&scope.project.id=1332a53419554e9eb69fa7cc98ea918a&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:41.964477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295c0d6-2e66-4c20-adfc-276df4c4f2d1 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:41.965038 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295c0d6-2e66-4c20-adfc-276df4c4f2d1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:41.965038 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295c0d6-2e66-4c20-adfc-276df4c4f2d1 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:41.966751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 575/1145] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:41.972560 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f8683-120a-442c-89ec-f9058b574ea6 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:41.972980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f8683-120a-442c-89ec-f9058b574ea6 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:41.973121 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f8683-120a-442c-89ec-f9058b574ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:41.991109 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-8e8f8683-120a-442c-89ec-f9058b574ea6 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:41.992322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-8e8f8683-120a-442c-89ec-f9058b574ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:42.000583 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 571/1146] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:41 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:42.024076 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295c0d6-2e66-4c20-adfc-276df4c4f2d1 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:42.036427 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d295c0d6-2e66-4c20-adfc-276df4c4f2d1 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:42.040683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf7be1-013a-41f8-ac9f-7b42dabbfd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:42.041435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf7be1-013a-41f8-ac9f-7b42dabbfd7f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:42.041708 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf7be1-013a-41f8-ac9f-7b42dabbfd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:42.041976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf7be1-013a-41f8-ac9f-7b42dabbfd7f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:42.052604 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf7be1-013a-41f8-ac9f-7b42dabbfd7f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:17:42.059528 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-18cf7be1-013a-41f8-ac9f-7b42dabbfd7f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:17:42.060637 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 576/1147] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:17:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:42.066232 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f8683-120a-442c-89ec-f9058b574ea6 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:42.075078 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f8683-120a-442c-89ec-f9058b574ea6 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:42.079757 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd4d32-22f9-4370-8ad5-935f05a0bd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:42.080400 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd4d32-22f9-4370-8ad5-935f05a0bd4b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:42.080682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd4d32-22f9-4370-8ad5-935f05a0bd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:42.080957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd4d32-22f9-4370-8ad5-935f05a0bd4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:42.081707 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd4d32-22f9-4370-8ad5-935f05a0bd4b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:42.082013 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd4d32-22f9-4370-8ad5-935f05a0bd4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:42.083618 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd4d32-22f9-4370-8ad5-935f05a0bd4b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:42.091576 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 572/1148] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:17:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:42.097671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf7be1-013a-41f8-ac9f-7b42dabbfd7f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:42.107574 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf7be1-013a-41f8-ac9f-7b42dabbfd7f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:42.112677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6f7a5-2763-491b-9d48-64b30b30b27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:42.113489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6f7a5-2763-491b-9d48-64b30b30b27d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:42.113766 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6f7a5-2763-491b-9d48-64b30b30b27d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:42.114034 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6f7a5-2763-491b-9d48-64b30b30b27d admin admin] PATH_INFO: `/v3/users/e444c9ecf4be4cd49f00fc69ec9d8dbc` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:42.115220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6f7a5-2763-491b-9d48-64b30b30b27d admin admin] RBAC: Authorizing `identity:get_user(user_id=e444c9ecf4be4cd49f00fc69ec9d8dbc)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:42.117329 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6f7a5-2763-491b-9d48-64b30b30b27d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:42.118854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 577/1149] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:17:42 2022] GET /identity/v3/users/e444c9ecf4be4cd49f00fc69ec9d8dbc => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:42.123982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd4d32-22f9-4370-8ad5-935f05a0bd4b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:42.133254 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd4d32-22f9-4370-8ad5-935f05a0bd4b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:42.137717 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73674c7c-3fe4-467d-b8eb-50178688b07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:42.138531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73674c7c-3fe4-467d-b8eb-50178688b07e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:42.138835 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73674c7c-3fe4-467d-b8eb-50178688b07e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:42.139107 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73674c7c-3fe4-467d-b8eb-50178688b07e admin admin] PATH_INFO: `/v3/projects/1332a53419554e9eb69fa7cc98ea918a` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:42.140308 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73674c7c-3fe4-467d-b8eb-50178688b07e admin admin] RBAC: Authorizing `identity:get_project(project_id=1332a53419554e9eb69fa7cc98ea918a)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:42.142330 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73674c7c-3fe4-467d-b8eb-50178688b07e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:42.143966 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 573/1150] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:17:42 2022] GET /identity/v3/projects/1332a53419554e9eb69fa7cc98ea918a => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:42.149096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6f7a5-2763-491b-9d48-64b30b30b27d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:42.158757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6f7a5-2763-491b-9d48-64b30b30b27d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:42.163264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe1a7a-55a0-4783-b491-d2ae1d25daf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:42.164094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe1a7a-55a0-4783-b491-d2ae1d25daf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:42.164372 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe1a7a-55a0-4783-b491-d2ae1d25daf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:42.164644 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe1a7a-55a0-4783-b491-d2ae1d25daf1 admin admin] PATH_INFO: `/v3/projects/1332a53419554e9eb69fa7cc98ea918a/users/e444c9ecf4be4cd49f00fc69ec9d8dbc/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:42.166675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe1a7a-55a0-4783-b491-d2ae1d25daf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1332a53419554e9eb69fa7cc98ea918a, user_id=e444c9ecf4be4cd49f00fc69ec9d8dbc, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:42.169271 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe1a7a-55a0-4783-b491-d2ae1d25daf1 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:42.256710 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 578/1151] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:17:42 2022] PUT /identity/v3/projects/1332a53419554e9eb69fa7cc98ea918a/users/e444c9ecf4be4cd49f00fc69ec9d8dbc/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:17:44.419217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3157-efea-4704-bc64-ce04cfaff263 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:44.419777 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3157-efea-4704-bc64-ce04cfaff263 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:44.419906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d3157-efea-4704-bc64-ce04cfaff263 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:44.422304 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 574/1152] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:44.427453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a296b-3950-4905-a064-5ccf0768b6a9 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:44.428102 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a296b-3950-4905-a064-5ccf0768b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:44.428264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2a296b-3950-4905-a064-5ccf0768b6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:44.445424 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-7d2a296b-3950-4905-a064-5ccf0768b6a9 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:44.446582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7d2a296b-3950-4905-a064-5ccf0768b6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:44.500014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 579/1153] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:44 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:44.523163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d3157-efea-4704-bc64-ce04cfaff263 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:44.535839 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d3157-efea-4704-bc64-ce04cfaff263 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:44.540058 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de1a22-0165-4cd0-8186-b399da7c677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:44.540817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de1a22-0165-4cd0-8186-b399da7c677b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:44.541097 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de1a22-0165-4cd0-8186-b399da7c677b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:44.541370 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de1a22-0165-4cd0-8186-b399da7c677b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:44.551930 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de1a22-0165-4cd0-8186-b399da7c677b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:17:44.558920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-69de1a22-0165-4cd0-8186-b399da7c677b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:17:44.560067 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 575/1154] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:17:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:44.565547 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a296b-3950-4905-a064-5ccf0768b6a9 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:44.574072 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2a296b-3950-4905-a064-5ccf0768b6a9 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:44.579021 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66203fde-47aa-402f-9605-2a31d81e4ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:44.579684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66203fde-47aa-402f-9605-2a31d81e4ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:44.579960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66203fde-47aa-402f-9605-2a31d81e4ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:44.580228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66203fde-47aa-402f-9605-2a31d81e4ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:44.580973 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66203fde-47aa-402f-9605-2a31d81e4ba5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:44.581269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66203fde-47aa-402f-9605-2a31d81e4ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:44.582814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66203fde-47aa-402f-9605-2a31d81e4ba5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:44.590666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 580/1155] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:17:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:44.596669 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de1a22-0165-4cd0-8186-b399da7c677b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:44.606416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de1a22-0165-4cd0-8186-b399da7c677b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:44.611688 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3a2ad-5195-4ef0-8d7e-2868649cc9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:44.612500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3a2ad-5195-4ef0-8d7e-2868649cc9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:44.612777 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3a2ad-5195-4ef0-8d7e-2868649cc9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:44.613048 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3a2ad-5195-4ef0-8d7e-2868649cc9f6 admin admin] PATH_INFO: `/v3/users/e444c9ecf4be4cd49f00fc69ec9d8dbc` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:44.614226 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3a2ad-5195-4ef0-8d7e-2868649cc9f6 admin admin] RBAC: Authorizing `identity:get_user(user_id=e444c9ecf4be4cd49f00fc69ec9d8dbc)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:44.616367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3a2ad-5195-4ef0-8d7e-2868649cc9f6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:44.617895 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 576/1156] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:17:44 2022] GET /identity/v3/users/e444c9ecf4be4cd49f00fc69ec9d8dbc => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:44.622904 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66203fde-47aa-402f-9605-2a31d81e4ba5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:44.632660 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66203fde-47aa-402f-9605-2a31d81e4ba5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:44.637038 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff71a90-7188-4a4d-85fc-fe8e470f0365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:44.637634 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff71a90-7188-4a4d-85fc-fe8e470f0365 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:44.637909 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff71a90-7188-4a4d-85fc-fe8e470f0365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:44.638177 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff71a90-7188-4a4d-85fc-fe8e470f0365 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:44.645695 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff71a90-7188-4a4d-85fc-fe8e470f0365 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:44.647390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff71a90-7188-4a4d-85fc-fe8e470f0365 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:44.655826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 581/1157] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:17:44 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:44.661198 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3a2ad-5195-4ef0-8d7e-2868649cc9f6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:44.670429 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3a2ad-5195-4ef0-8d7e-2868649cc9f6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:44.675438 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db7925-03eb-4494-b623-864d6f4c0c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:44.676239 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db7925-03eb-4494-b623-864d6f4c0c45 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:44.676518 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db7925-03eb-4494-b623-864d6f4c0c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:44.676788 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db7925-03eb-4494-b623-864d6f4c0c45 admin admin] PATH_INFO: `/v3/projects/1332a53419554e9eb69fa7cc98ea918a` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:44.678204 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db7925-03eb-4494-b623-864d6f4c0c45 admin admin] RBAC: Authorizing `identity:get_project(project_id=1332a53419554e9eb69fa7cc98ea918a)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:44.680244 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db7925-03eb-4494-b623-864d6f4c0c45 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:44.681848 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 577/1158] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:17:44 2022] GET /identity/v3/projects/1332a53419554e9eb69fa7cc98ea918a => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:44.687872 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff71a90-7188-4a4d-85fc-fe8e470f0365 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:44.696096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff71a90-7188-4a4d-85fc-fe8e470f0365 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:44.700463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d44610-4489-4573-bfb9-709e3bcfe4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:44.701058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d44610-4489-4573-bfb9-709e3bcfe4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:44.701332 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d44610-4489-4573-bfb9-709e3bcfe4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:44.701600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d44610-4489-4573-bfb9-709e3bcfe4f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:44.702520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d44610-4489-4573-bfb9-709e3bcfe4f0 admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=1332a53419554e9eb69fa7cc98ea918a, user.id=e444c9ecf4be4cd49f00fc69ec9d8dbc) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:44.702819 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d44610-4489-4573-bfb9-709e3bcfe4f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:44.704600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d44610-4489-4573-bfb9-709e3bcfe4f0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:44.710066 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 582/1159] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:17:44 2022] GET /identity/v3/role_assignments?user.id=e444c9ecf4be4cd49f00fc69ec9d8dbc&scope.project.id=1332a53419554e9eb69fa7cc98ea918a&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:46.926976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd2442-2fd5-4c3a-8964-cefed22c872d None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:46.927530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd2442-2fd5-4c3a-8964-cefed22c872d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:46.927621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fd2442-2fd5-4c3a-8964-cefed22c872d None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:46.929582 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 578/1160] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:46.934858 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015385-ade2-41c5-a3c9-2770aa2a93e9 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:46.935279 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015385-ade2-41c5-a3c9-2770aa2a93e9 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:46.935434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98015385-ade2-41c5-a3c9-2770aa2a93e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:46.953545 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-98015385-ade2-41c5-a3c9-2770aa2a93e9 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:46.954776 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-98015385-ade2-41c5-a3c9-2770aa2a93e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:46.962366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 583/1161] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:46 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:46.985491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd2442-2fd5-4c3a-8964-cefed22c872d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:46.997502 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fd2442-2fd5-4c3a-8964-cefed22c872d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:47.001877 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d2354-7298-4d25-9ec6-11691340afb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:47.002498 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d2354-7298-4d25-9ec6-11691340afb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:47.002780 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d2354-7298-4d25-9ec6-11691340afb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:47.003055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d2354-7298-4d25-9ec6-11691340afb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:47.010610 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d2354-7298-4d25-9ec6-11691340afb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:47.012383 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d2354-7298-4d25-9ec6-11691340afb7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:47.021681 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 579/1162] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:17:46 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:47.027389 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98015385-ade2-41c5-a3c9-2770aa2a93e9 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:47.037131 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98015385-ade2-41c5-a3c9-2770aa2a93e9 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:47.041566 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd04dc-5e51-461e-be29-f006372d9bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:47.042367 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd04dc-5e51-461e-be29-f006372d9bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:47.042646 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd04dc-5e51-461e-be29-f006372d9bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:47.042920 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd04dc-5e51-461e-be29-f006372d9bb9 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:47.050035 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd04dc-5e51-461e-be29-f006372d9bb9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:47.051874 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd04dc-5e51-461e-be29-f006372d9bb9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:47.066437 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-51bd04dc-5e51-461e-be29-f006372d9bb9 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Feb 12 04:17:47.067584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 584/1163] 10.222.0.35 () {56 vars in 1138 bytes} [Sat Feb 12 04:17:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:47.073246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d2354-7298-4d25-9ec6-11691340afb7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:47.082606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d2354-7298-4d25-9ec6-11691340afb7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:47.087102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67e1b2-10ea-4392-8854-22688e2bf6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:47.087764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67e1b2-10ea-4392-8854-22688e2bf6cf admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:47.088045 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67e1b2-10ea-4392-8854-22688e2bf6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:47.088317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67e1b2-10ea-4392-8854-22688e2bf6cf admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:47.089037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67e1b2-10ea-4392-8854-22688e2bf6cf admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:47.089338 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67e1b2-10ea-4392-8854-22688e2bf6cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:47.090881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67e1b2-10ea-4392-8854-22688e2bf6cf admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:47.098478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 580/1164] 10.222.0.35 () {56 vars in 1136 bytes} [Sat Feb 12 04:17:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:49.336700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849c871-5806-4dbf-8d86-9a44162d5739 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:49.337169 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849c871-5806-4dbf-8d86-9a44162d5739 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:49.337287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849c871-5806-4dbf-8d86-9a44162d5739 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:49.338988 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 585/1165] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:49.345010 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a4803-10d1-40a8-9457-da77f0fff5c0 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:49.345380 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a4803-10d1-40a8-9457-da77f0fff5c0 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:49.345556 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a4803-10d1-40a8-9457-da77f0fff5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:49.363521 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-d73a4803-10d1-40a8-9457-da77f0fff5c0 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:49.364684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d73a4803-10d1-40a8-9457-da77f0fff5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:49.372104 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 581/1166] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:49 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:49.396536 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849c871-5806-4dbf-8d86-9a44162d5739 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:49.409002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849c871-5806-4dbf-8d86-9a44162d5739 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:49.413246 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0da668a-b690-4bca-8516-bcb208222b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:49.413872 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da668a-b690-4bca-8516-bcb208222b1b admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:49.414147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da668a-b690-4bca-8516-bcb208222b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:49.414417 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0da668a-b690-4bca-8516-bcb208222b1b admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:49.415163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da668a-b690-4bca-8516-bcb208222b1b admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:49.416190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-c0da668a-b690-4bca-8516-bcb208222b1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:17:49.416190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:17:49.416190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:17:49.417051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0da668a-b690-4bca-8516-bcb208222b1b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:49.504596 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 586/1167] 10.222.0.35 () {60 vars in 1159 bytes} [Sat Feb 12 04:17:49 2022] POST /identity/v3/domains => generated 267 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:17:51.715590 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11980aa-4c7e-48d6-88d6-25955b483647 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:51.716112 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11980aa-4c7e-48d6-88d6-25955b483647 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:51.716112 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11980aa-4c7e-48d6-88d6-25955b483647 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:51.717898 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 582/1168] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:51.723306 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3839-d807-4014-9984-ea1220eea710 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:51.723718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3839-d807-4014-9984-ea1220eea710 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:51.723867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb3839-d807-4014-9984-ea1220eea710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:51.741302 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-2cdb3839-d807-4014-9984-ea1220eea710 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:51.742466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2cdb3839-d807-4014-9984-ea1220eea710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:51.797120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 587/1169] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:51 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:51.821154 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11980aa-4c7e-48d6-88d6-25955b483647 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:51.834007 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11980aa-4c7e-48d6-88d6-25955b483647 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:51.838474 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3433b78d-51de-47f4-af09-fa8de130215f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:51.839336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433b78d-51de-47f4-af09-fa8de130215f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:51.839617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433b78d-51de-47f4-af09-fa8de130215f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:51.839887 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3433b78d-51de-47f4-af09-fa8de130215f admin admin] PATH_INFO: `/v3/domains/2a03cd5b60754795becedf1815fdb64b` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:51.850278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433b78d-51de-47f4-af09-fa8de130215f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=2a03cd5b60754795becedf1815fdb64b)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:51.852243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3433b78d-51de-47f4-af09-fa8de130215f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:51.853815 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 583/1170] 10.222.0.35 () {56 vars in 1204 bytes} [Sat Feb 12 04:17:51 2022] GET /identity/v3/domains/2a03cd5b60754795becedf1815fdb64b => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:51.859491 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb3839-d807-4014-9984-ea1220eea710 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:51.868204 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb3839-d807-4014-9984-ea1220eea710 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:51.872645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724066d0-0e3c-4296-8eff-e475ccd44fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:51.873276 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724066d0-0e3c-4296-8eff-e475ccd44fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:51.874075 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724066d0-0e3c-4296-8eff-e475ccd44fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:51.874350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724066d0-0e3c-4296-8eff-e475ccd44fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:51.875062 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724066d0-0e3c-4296-8eff-e475ccd44fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:51.876964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724066d0-0e3c-4296-8eff-e475ccd44fc4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:51.999436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 588/1171] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Feb 12 04:17:51 2022] POST /identity/v3/projects => generated 361 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:17:54.218096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f558668-8631-448c-a434-c5edc79bb182 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:54.218623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f558668-8631-448c-a434-c5edc79bb182 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:54.218623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f558668-8631-448c-a434-c5edc79bb182 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:54.221091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 584/1172] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:54.226421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e085ad5-ba3c-42e3-82fe-6100651fe627 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:54.226831 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e085ad5-ba3c-42e3-82fe-6100651fe627 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:54.226981 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e085ad5-ba3c-42e3-82fe-6100651fe627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:54.244989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-9e085ad5-ba3c-42e3-82fe-6100651fe627 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:54.246166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9e085ad5-ba3c-42e3-82fe-6100651fe627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:54.301422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 589/1173] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:54 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:54.326009 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f558668-8631-448c-a434-c5edc79bb182 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:54.338474 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f558668-8631-448c-a434-c5edc79bb182 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:54.343557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dfa9a3-7346-4825-aafa-cc1dce913b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:54.344371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfa9a3-7346-4825-aafa-cc1dce913b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:54.344646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfa9a3-7346-4825-aafa-cc1dce913b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:54.344913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dfa9a3-7346-4825-aafa-cc1dce913b0a admin admin] PATH_INFO: `/v3/domains/2a03cd5b60754795becedf1815fdb64b` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:54.346079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfa9a3-7346-4825-aafa-cc1dce913b0a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=2a03cd5b60754795becedf1815fdb64b)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:54.348021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dfa9a3-7346-4825-aafa-cc1dce913b0a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:54.349550 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 585/1174] 10.222.0.35 () {56 vars in 1204 bytes} [Sat Feb 12 04:17:54 2022] GET /identity/v3/domains/2a03cd5b60754795becedf1815fdb64b => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:54.355002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e085ad5-ba3c-42e3-82fe-6100651fe627 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:54.364006 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e085ad5-ba3c-42e3-82fe-6100651fe627 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:54.368503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f06bc5-d289-403b-9dba-9b5295af2a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:54.369146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f06bc5-d289-403b-9dba-9b5295af2a43 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:54.369428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f06bc5-d289-403b-9dba-9b5295af2a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:54.369705 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f06bc5-d289-403b-9dba-9b5295af2a43 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:54.370422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f06bc5-d289-403b-9dba-9b5295af2a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:54.372350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f06bc5-d289-403b-9dba-9b5295af2a43 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:54.502512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 590/1175] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:17:54 2022] POST /identity/v3/users => generated 311 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:17:56.734932 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58b285-82d5-42a2-b3cc-0979aa7f7c1e None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:56.735506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58b285-82d5-42a2-b3cc-0979aa7f7c1e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:56.735506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58b285-82d5-42a2-b3cc-0979aa7f7c1e None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:56.737254 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 586/1176] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:56.742508 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7409e-c80c-4211-aefa-9cb3b94a65bc None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:56.742879 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7409e-c80c-4211-aefa-9cb3b94a65bc None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:56.743055 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7409e-c80c-4211-aefa-9cb3b94a65bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:56.761646 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-a3d7409e-c80c-4211-aefa-9cb3b94a65bc None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:56.762816 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a3d7409e-c80c-4211-aefa-9cb3b94a65bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:56.770532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 591/1177] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:56 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:56.794409 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58b285-82d5-42a2-b3cc-0979aa7f7c1e None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:56.807414 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58b285-82d5-42a2-b3cc-0979aa7f7c1e None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:56.812279 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27411a2a-43ff-4bb6-9cab-32367db2121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:56.813029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27411a2a-43ff-4bb6-9cab-32367db2121f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:56.813307 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27411a2a-43ff-4bb6-9cab-32367db2121f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:56.813575 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27411a2a-43ff-4bb6-9cab-32367db2121f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:56.823816 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27411a2a-43ff-4bb6-9cab-32367db2121f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:17:56.830653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-27411a2a-43ff-4bb6-9cab-32367db2121f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:17:56.831794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 587/1178] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:17:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:56.837375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7409e-c80c-4211-aefa-9cb3b94a65bc None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:56.846228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7409e-c80c-4211-aefa-9cb3b94a65bc None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:56.850672 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9697cf-0bd4-4732-9119-cf12582ef40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:56.851342 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9697cf-0bd4-4732-9119-cf12582ef40e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:56.851623 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9697cf-0bd4-4732-9119-cf12582ef40e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:56.851895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9697cf-0bd4-4732-9119-cf12582ef40e admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:56.852646 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9697cf-0bd4-4732-9119-cf12582ef40e admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:56.852947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9697cf-0bd4-4732-9119-cf12582ef40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:56.854502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9697cf-0bd4-4732-9119-cf12582ef40e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:56.862964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 592/1179] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:17:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:56.868350 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27411a2a-43ff-4bb6-9cab-32367db2121f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:56.877745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27411a2a-43ff-4bb6-9cab-32367db2121f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:56.882131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7a32e-dd20-4419-8588-f2f62767f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:56.882941 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7a32e-dd20-4419-8588-f2f62767f770 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:56.883213 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7a32e-dd20-4419-8588-f2f62767f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:56.883505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7a32e-dd20-4419-8588-f2f62767f770 admin admin] PATH_INFO: `/v3/users/c0aa5337ae734e1daca9c7fdea215314` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:56.896817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7a32e-dd20-4419-8588-f2f62767f770 admin admin] RBAC: Authorizing `identity:get_user(user_id=c0aa5337ae734e1daca9c7fdea215314)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:56.899007 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7a32e-dd20-4419-8588-f2f62767f770 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:56.900606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 588/1180] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:17:56 2022] GET /identity/v3/users/c0aa5337ae734e1daca9c7fdea215314 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:56.906551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9697cf-0bd4-4732-9119-cf12582ef40e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:56.915770 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9697cf-0bd4-4732-9119-cf12582ef40e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:56.920227 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e225-3c8f-4b56-9837-6651589089a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:56.920829 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e225-3c8f-4b56-9837-6651589089a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:56.921108 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e225-3c8f-4b56-9837-6651589089a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:56.921382 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1e225-3c8f-4b56-9837-6651589089a3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:56.929177 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1e225-3c8f-4b56-9837-6651589089a3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:56.930878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1e225-3c8f-4b56-9837-6651589089a3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:56.940228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 593/1181] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:17:56 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:17:56.945402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7a32e-dd20-4419-8588-f2f62767f770 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:56.955006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7a32e-dd20-4419-8588-f2f62767f770 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:56.959402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aad78c-5c9c-458a-833a-9a0699aa1567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:56.960542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aad78c-5c9c-458a-833a-9a0699aa1567 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:56.960820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aad78c-5c9c-458a-833a-9a0699aa1567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:56.961092 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aad78c-5c9c-458a-833a-9a0699aa1567 admin admin] PATH_INFO: `/v3/projects/9793fa53a84c49f79387e2ef9c8113dc` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:56.962238 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aad78c-5c9c-458a-833a-9a0699aa1567 admin admin] RBAC: Authorizing `identity:get_project(project_id=9793fa53a84c49f79387e2ef9c8113dc)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:56.964267 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44aad78c-5c9c-458a-833a-9a0699aa1567 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:56.965958 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 589/1182] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:17:56 2022] GET /identity/v3/projects/9793fa53a84c49f79387e2ef9c8113dc => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:56.971281 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e225-3c8f-4b56-9837-6651589089a3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:56.979630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1e225-3c8f-4b56-9837-6651589089a3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:56.984219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a127080-9dc8-4031-adc0-b3fe6ee548e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:56.984819 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a127080-9dc8-4031-adc0-b3fe6ee548e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:56.985144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a127080-9dc8-4031-adc0-b3fe6ee548e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:56.985367 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a127080-9dc8-4031-adc0-b3fe6ee548e8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:56.986186 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a127080-9dc8-4031-adc0-b3fe6ee548e8 admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=9793fa53a84c49f79387e2ef9c8113dc, user.id=c0aa5337ae734e1daca9c7fdea215314) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:56.986490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a127080-9dc8-4031-adc0-b3fe6ee548e8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:56.988302 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a127080-9dc8-4031-adc0-b3fe6ee548e8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:56.993560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 594/1183] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:17:56 2022] GET /identity/v3/role_assignments?user.id=c0aa5337ae734e1daca9c7fdea215314&scope.project.id=9793fa53a84c49f79387e2ef9c8113dc&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:59.178129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b953191-2bef-473f-84b5-8c110a45deca None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:59.178727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b953191-2bef-473f-84b5-8c110a45deca None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:59.178727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b953191-2bef-473f-84b5-8c110a45deca None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:59.180452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 590/1184] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:17:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:17:59.185732 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e0fe5-c56a-41ab-9702-91c298fc3180 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:59.186694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e0fe5-c56a-41ab-9702-91c298fc3180 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:59.186936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505e0fe5-c56a-41ab-9702-91c298fc3180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:59.204256 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-505e0fe5-c56a-41ab-9702-91c298fc3180 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:17:59.205421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-505e0fe5-c56a-41ab-9702-91c298fc3180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:17:59.212910 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 595/1185] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:17:59 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:17:59.237249 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b953191-2bef-473f-84b5-8c110a45deca None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:59.249247 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b953191-2bef-473f-84b5-8c110a45deca None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:59.253508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ddad4-9f8c-47b4-a038-82bd824c70f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:59.254260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ddad4-9f8c-47b4-a038-82bd824c70f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:59.254536 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ddad4-9f8c-47b4-a038-82bd824c70f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:59.254805 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ddad4-9f8c-47b4-a038-82bd824c70f5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:59.264708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ddad4-9f8c-47b4-a038-82bd824c70f5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:17:59.271447 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-c43ddad4-9f8c-47b4-a038-82bd824c70f5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:17:59.272560 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 591/1186] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:17:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:17:59.278228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e0fe5-c56a-41ab-9702-91c298fc3180 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:59.287616 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505e0fe5-c56a-41ab-9702-91c298fc3180 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:59.292071 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ae189-0f61-49f8-869b-01e083158b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:59.292709 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae189-0f61-49f8-869b-01e083158b26 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:59.292988 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae189-0f61-49f8-869b-01e083158b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:59.293260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ae189-0f61-49f8-869b-01e083158b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:59.294009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ae189-0f61-49f8-869b-01e083158b26 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:17:59.294309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ae189-0f61-49f8-869b-01e083158b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:59.296503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ae189-0f61-49f8-869b-01e083158b26 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:59.304714 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 596/1187] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:17:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:59.310262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ddad4-9f8c-47b4-a038-82bd824c70f5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:59.320109 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ddad4-9f8c-47b4-a038-82bd824c70f5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:59.324544 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6891b-3e29-40fa-b9ce-f5ef61ddd86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:59.325358 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6891b-3e29-40fa-b9ce-f5ef61ddd86c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:59.325632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6891b-3e29-40fa-b9ce-f5ef61ddd86c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:59.325899 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6891b-3e29-40fa-b9ce-f5ef61ddd86c admin admin] PATH_INFO: `/v3/users/c0aa5337ae734e1daca9c7fdea215314` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:59.331029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6891b-3e29-40fa-b9ce-f5ef61ddd86c admin admin] RBAC: Authorizing `identity:get_user(user_id=c0aa5337ae734e1daca9c7fdea215314)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:59.333153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6891b-3e29-40fa-b9ce-f5ef61ddd86c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:59.334685 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 592/1188] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:17:59 2022] GET /identity/v3/users/c0aa5337ae734e1daca9c7fdea215314 => generated 311 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:17:59.339871 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ae189-0f61-49f8-869b-01e083158b26 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:59.349741 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ae189-0f61-49f8-869b-01e083158b26 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:59.354162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a76a0e-3fdf-4ba1-84d4-9ebbf9af2c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:59.354973 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a76a0e-3fdf-4ba1-84d4-9ebbf9af2c04 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:59.355280 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a76a0e-3fdf-4ba1-84d4-9ebbf9af2c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:59.355555 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a76a0e-3fdf-4ba1-84d4-9ebbf9af2c04 admin admin] PATH_INFO: `/v3/projects/9793fa53a84c49f79387e2ef9c8113dc` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:59.356716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a76a0e-3fdf-4ba1-84d4-9ebbf9af2c04 admin admin] RBAC: Authorizing `identity:get_project(project_id=9793fa53a84c49f79387e2ef9c8113dc)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:59.359670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a76a0e-3fdf-4ba1-84d4-9ebbf9af2c04 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:59.361373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 597/1189] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:17:59 2022] GET /identity/v3/projects/9793fa53a84c49f79387e2ef9c8113dc => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:17:59.366469 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6891b-3e29-40fa-b9ce-f5ef61ddd86c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:17:59.376226 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6891b-3e29-40fa-b9ce-f5ef61ddd86c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:17:59.380824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c01a72-ebfa-42c8-80e3-7ab0f45b4fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:17:59.381668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c01a72-ebfa-42c8-80e3-7ab0f45b4fab admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:17:59.381947 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c01a72-ebfa-42c8-80e3-7ab0f45b4fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:17:59.382221 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c01a72-ebfa-42c8-80e3-7ab0f45b4fab admin admin] PATH_INFO: `/v3/projects/9793fa53a84c49f79387e2ef9c8113dc/users/c0aa5337ae734e1daca9c7fdea215314/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:17:59.384185 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c01a72-ebfa-42c8-80e3-7ab0f45b4fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9793fa53a84c49f79387e2ef9c8113dc, user_id=c0aa5337ae734e1daca9c7fdea215314, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:17:59.386773 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c01a72-ebfa-42c8-80e3-7ab0f45b4fab admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:17:59.505232 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 593/1190] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:17:59 2022] PUT /identity/v3/projects/9793fa53a84c49f79387e2ef9c8113dc/users/c0aa5337ae734e1daca9c7fdea215314/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:18:01.688676 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484a9f-7450-46b5-94f4-c528b4cc8d58 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:01.689229 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484a9f-7450-46b5-94f4-c528b4cc8d58 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:01.689229 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9484a9f-7450-46b5-94f4-c528b4cc8d58 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:01.690983 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 598/1191] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:18:01.696304 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef8582-0ddd-48ee-b6ec-48906e5cebd3 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:01.696724 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef8582-0ddd-48ee-b6ec-48906e5cebd3 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:01.696858 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef8582-0ddd-48ee-b6ec-48906e5cebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:01.714124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-88ef8582-0ddd-48ee-b6ec-48906e5cebd3 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:18:01.715330 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-88ef8582-0ddd-48ee-b6ec-48906e5cebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:18:01.772208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 594/1192] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:18:01 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:18:01.797251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9484a9f-7450-46b5-94f4-c528b4cc8d58 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:01.809421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9484a9f-7450-46b5-94f4-c528b4cc8d58 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:01.813820 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ca018-7512-4fea-9c37-31a52962490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:01.814580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ca018-7512-4fea-9c37-31a52962490e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:01.814862 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ca018-7512-4fea-9c37-31a52962490e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:01.815136 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ca018-7512-4fea-9c37-31a52962490e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:01.825126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815ca018-7512-4fea-9c37-31a52962490e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:18:01.832507 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-815ca018-7512-4fea-9c37-31a52962490e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:18:01.833636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 599/1193] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:18:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:18:01.839083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef8582-0ddd-48ee-b6ec-48906e5cebd3 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:01.848519 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef8582-0ddd-48ee-b6ec-48906e5cebd3 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:01.852969 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b26bba-7012-4396-a233-cb3d8823de0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:01.853606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b26bba-7012-4396-a233-cb3d8823de0f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:01.853884 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b26bba-7012-4396-a233-cb3d8823de0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:01.854155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b26bba-7012-4396-a233-cb3d8823de0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:01.854914 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b26bba-7012-4396-a233-cb3d8823de0f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:18:01.855212 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b26bba-7012-4396-a233-cb3d8823de0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:01.856806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b26bba-7012-4396-a233-cb3d8823de0f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:01.864764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 595/1194] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:18:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:18:01.870209 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ca018-7512-4fea-9c37-31a52962490e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:01.880288 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ca018-7512-4fea-9c37-31a52962490e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:01.884777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f5fef-b2ba-40c5-9100-3cce717691c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:01.885594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5fef-b2ba-40c5-9100-3cce717691c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:01.885876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5fef-b2ba-40c5-9100-3cce717691c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:01.886148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5fef-b2ba-40c5-9100-3cce717691c3 admin admin] PATH_INFO: `/v3/users/c0aa5337ae734e1daca9c7fdea215314` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:01.887362 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f5fef-b2ba-40c5-9100-3cce717691c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=c0aa5337ae734e1daca9c7fdea215314)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:01.890167 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f5fef-b2ba-40c5-9100-3cce717691c3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:01.891747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 600/1195] 10.222.0.35 () {56 vars in 1198 bytes} [Sat Feb 12 04:18:01 2022] GET /identity/v3/users/c0aa5337ae734e1daca9c7fdea215314 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:18:01.896957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b26bba-7012-4396-a233-cb3d8823de0f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:01.906755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b26bba-7012-4396-a233-cb3d8823de0f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:01.911181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8ea75-2000-4d37-8855-3d936ee1a668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:01.911812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8ea75-2000-4d37-8855-3d936ee1a668 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:01.912098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8ea75-2000-4d37-8855-3d936ee1a668 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:01.912373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8ea75-2000-4d37-8855-3d936ee1a668 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:01.919887 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8ea75-2000-4d37-8855-3d936ee1a668 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:01.921617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8ea75-2000-4d37-8855-3d936ee1a668 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:01.930467 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 596/1196] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:18:01 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:18:01.935708 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f5fef-b2ba-40c5-9100-3cce717691c3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:01.945048 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f5fef-b2ba-40c5-9100-3cce717691c3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:01.949422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b15f91-b1fc-4d6b-97e2-43cbf5d1d6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:01.950211 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15f91-b1fc-4d6b-97e2-43cbf5d1d6ec admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:01.950481 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15f91-b1fc-4d6b-97e2-43cbf5d1d6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:01.950744 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15f91-b1fc-4d6b-97e2-43cbf5d1d6ec admin admin] PATH_INFO: `/v3/projects/9793fa53a84c49f79387e2ef9c8113dc` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:01.952681 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b15f91-b1fc-4d6b-97e2-43cbf5d1d6ec admin admin] RBAC: Authorizing `identity:get_project(project_id=9793fa53a84c49f79387e2ef9c8113dc)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:01.954910 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b15f91-b1fc-4d6b-97e2-43cbf5d1d6ec admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:01.956555 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 601/1197] 10.222.0.35 () {56 vars in 1207 bytes} [Sat Feb 12 04:18:01 2022] GET /identity/v3/projects/9793fa53a84c49f79387e2ef9c8113dc => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:18:01.962052 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8ea75-2000-4d37-8855-3d936ee1a668 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:18:01.971253 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8ea75-2000-4d37-8855-3d936ee1a668 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:18:01.975748 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a79e99-a6e1-4b52-8ea4-3232fe2ec207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:18:01.976355 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a79e99-a6e1-4b52-8ea4-3232fe2ec207 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:18:01.976631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a79e99-a6e1-4b52-8ea4-3232fe2ec207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:18:01.976901 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a79e99-a6e1-4b52-8ea4-3232fe2ec207 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:18:01.977723 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a79e99-a6e1-4b52-8ea4-3232fe2ec207 admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=9793fa53a84c49f79387e2ef9c8113dc, user.id=c0aa5337ae734e1daca9c7fdea215314) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:18:01.978028 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a79e99-a6e1-4b52-8ea4-3232fe2ec207 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:18:01.979844 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a79e99-a6e1-4b52-8ea4-3232fe2ec207 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:18:01.985430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 597/1198] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:18:01 2022] GET /identity/v3/role_assignments?user.id=c0aa5337ae734e1daca9c7fdea215314&scope.project.id=9793fa53a84c49f79387e2ef9c8113dc&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:18.267270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7917d-7edd-4a85-98e7-ce2df4c90c37 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:18.267856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7917d-7edd-4a85-98e7-ce2df4c90c37 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:18.267856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7917d-7edd-4a85-98e7-ce2df4c90c37 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:18.269579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 602/1199] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:19:18.274743 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879b4da-e115-411a-92fe-dc2e7d43a834 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:18.280417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879b4da-e115-411a-92fe-dc2e7d43a834 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:18.280417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879b4da-e115-411a-92fe-dc2e7d43a834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:18.293040 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-2879b4da-e115-411a-92fe-dc2e7d43a834 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:18.294222 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2879b4da-e115-411a-92fe-dc2e7d43a834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:18.302748 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 598/1200] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:19:18 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:19:18.329279 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7917d-7edd-4a85-98e7-ce2df4c90c37 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:18.341420 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7917d-7edd-4a85-98e7-ce2df4c90c37 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:18.346184 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735e521-040b-47c5-ab80-f3759bace0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:18.349689 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735e521-040b-47c5-ab80-f3759bace0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:18.349689 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735e521-040b-47c5-ab80-f3759bace0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:18.349689 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735e521-040b-47c5-ab80-f3759bace0c1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:18.357586 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735e521-040b-47c5-ab80-f3759bace0c1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:18.360499 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735e521-040b-47c5-ab80-f3759bace0c1 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:18.377350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-e735e521-040b-47c5-ab80-f3759bace0c1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:19:18.378477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 603/1201] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:18.384236 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879b4da-e115-411a-92fe-dc2e7d43a834 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:18.393151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879b4da-e115-411a-92fe-dc2e7d43a834 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:18.397756 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa96526-28ea-497a-8465-1d556ade4f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:18.398403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96526-28ea-497a-8465-1d556ade4f8e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:18.398699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96526-28ea-497a-8465-1d556ade4f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:18.398959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa96526-28ea-497a-8465-1d556ade4f8e admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:18.399725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa96526-28ea-497a-8465-1d556ade4f8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:18.400038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa96526-28ea-497a-8465-1d556ade4f8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:18.401616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa96526-28ea-497a-8465-1d556ade4f8e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:18.413220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 599/1202] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:19:18.419002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735e521-040b-47c5-ab80-f3759bace0c1 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:18.429607 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735e521-040b-47c5-ab80-f3759bace0c1 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:18.434531 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98155fc6-a3e5-4fbb-8207-29986274d11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:18.434709 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98155fc6-a3e5-4fbb-8207-29986274d11f admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:18.434934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98155fc6-a3e5-4fbb-8207-29986274d11f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:18.435205 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98155fc6-a3e5-4fbb-8207-29986274d11f admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:18.435943 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98155fc6-a3e5-4fbb-8207-29986274d11f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:18.438605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98155fc6-a3e5-4fbb-8207-29986274d11f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:18.510551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 604/1203] 10.222.0.35 () {60 vars in 1153 bytes} [Sat Feb 12 04:19:18 2022] POST /identity/v3/users => generated 251 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:19:20.757024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363c2e3-8f32-4599-92c9-82cfa1c2bcd2 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:20.757590 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363c2e3-8f32-4599-92c9-82cfa1c2bcd2 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:20.757590 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363c2e3-8f32-4599-92c9-82cfa1c2bcd2 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:20.759437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 600/1204] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:19:20.766990 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294a5e-1145-411a-b844-50c87cf31142 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:20.767490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294a5e-1145-411a-b844-50c87cf31142 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:20.767749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92294a5e-1145-411a-b844-50c87cf31142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:20.785652 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-92294a5e-1145-411a-b844-50c87cf31142 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:20.786813 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-92294a5e-1145-411a-b844-50c87cf31142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:20.794309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 605/1205] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:19:20 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:20.819417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363c2e3-8f32-4599-92c9-82cfa1c2bcd2 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:20.831597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363c2e3-8f32-4599-92c9-82cfa1c2bcd2 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:20.836940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3cc81-4c2c-4acb-9b63-9a17411aaf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:20.836940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3cc81-4c2c-4acb-9b63-9a17411aaf65 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:20.837234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3cc81-4c2c-4acb-9b63-9a17411aaf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:20.837234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3cc81-4c2c-4acb-9b63-9a17411aaf65 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:20.848555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3cc81-4c2c-4acb-9b63-9a17411aaf65 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:19:20.855445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-dde3cc81-4c2c-4acb-9b63-9a17411aaf65 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:19:20.856598 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 601/1206] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:19:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:20.863013 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92294a5e-1145-411a-b844-50c87cf31142 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:20.871966 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92294a5e-1145-411a-b844-50c87cf31142 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:20.878187 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2465a74-74f6-40d3-a3a6-f67d1810c184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:20.878839 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2465a74-74f6-40d3-a3a6-f67d1810c184 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:20.879125 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2465a74-74f6-40d3-a3a6-f67d1810c184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:20.879429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2465a74-74f6-40d3-a3a6-f67d1810c184 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:20.880194 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2465a74-74f6-40d3-a3a6-f67d1810c184 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:20.880494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2465a74-74f6-40d3-a3a6-f67d1810c184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:20.882052 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2465a74-74f6-40d3-a3a6-f67d1810c184 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:20.890297 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 606/1207] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:19:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:20.896037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3cc81-4c2c-4acb-9b63-9a17411aaf65 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:20.906087 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3cc81-4c2c-4acb-9b63-9a17411aaf65 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:20.910731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc6b36-e842-4834-be26-6b3ffa122aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:20.911527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc6b36-e842-4834-be26-6b3ffa122aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:20.911806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc6b36-e842-4834-be26-6b3ffa122aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:20.912096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc6b36-e842-4834-be26-6b3ffa122aa0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:20.922772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc6b36-e842-4834-be26-6b3ffa122aa0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:20.924742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc6b36-e842-4834-be26-6b3ffa122aa0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:20.941486 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-9ffc6b36-e842-4834-be26-6b3ffa122aa0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:19:20.942609 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 602/1208] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:20.948317 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2465a74-74f6-40d3-a3a6-f67d1810c184 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:20.958167 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2465a74-74f6-40d3-a3a6-f67d1810c184 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:20.962798 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e2e71-61c5-4042-baab-f5d5abfe070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:20.963481 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2e71-61c5-4042-baab-f5d5abfe070d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:20.963763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2e71-61c5-4042-baab-f5d5abfe070d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:20.964096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2e71-61c5-4042-baab-f5d5abfe070d admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:20.964826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e2e71-61c5-4042-baab-f5d5abfe070d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:20.965127 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e2e71-61c5-4042-baab-f5d5abfe070d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:20.966745 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e2e71-61c5-4042-baab-f5d5abfe070d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:20.979006 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 607/1209] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:19:20.985140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc6b36-e842-4834-be26-6b3ffa122aa0 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:20.994644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc6b36-e842-4834-be26-6b3ffa122aa0 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:20.999265 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2743b36-ea4d-44ed-b600-306ff6601a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:21.000025 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2743b36-ea4d-44ed-b600-306ff6601a1a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.000303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2743b36-ea4d-44ed-b600-306ff6601a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.000645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2743b36-ea4d-44ed-b600-306ff6601a1a admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.007817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2743b36-ea4d-44ed-b600-306ff6601a1a admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:21.009742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2743b36-ea4d-44ed-b600-306ff6601a1a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:21.024766 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-c2743b36-ea4d-44ed-b600-306ff6601a1a admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 12 04:19:21.025916 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 603/1210] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:21.032053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e2e71-61c5-4042-baab-f5d5abfe070d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:21.041548 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e2e71-61c5-4042-baab-f5d5abfe070d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:21.046898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649a068-57a7-4358-ac71-206825595ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:21.052366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a068-57a7-4358-ac71-206825595ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.052366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a068-57a7-4358-ac71-206825595ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.052366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0649a068-57a7-4358-ac71-206825595ae9 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.052366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649a068-57a7-4358-ac71-206825595ae9 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:21.052366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649a068-57a7-4358-ac71-206825595ae9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:21.052366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0649a068-57a7-4358-ac71-206825595ae9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:21.067998 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 608/1211] 10.222.0.35 () {56 vars in 1164 bytes} [Sat Feb 12 04:19:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:21.073620 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2743b36-ea4d-44ed-b600-306ff6601a1a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:21.083549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2743b36-ea4d-44ed-b600-306ff6601a1a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:21.088179 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46ae46-d184-4136-9706-182d16aeda4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:21.088800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46ae46-d184-4136-9706-182d16aeda4c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.089085 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46ae46-d184-4136-9706-182d16aeda4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.089362 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46ae46-d184-4136-9706-182d16aeda4c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.097908 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46ae46-d184-4136-9706-182d16aeda4c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:21.099700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d46ae46-d184-4136-9706-182d16aeda4c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:21.108950 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 604/1212] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:19:21 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:21.114318 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649a068-57a7-4358-ac71-206825595ae9 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:21.123707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0649a068-57a7-4358-ac71-206825595ae9 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:21.128311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02f134-37ca-4e41-b94f-1e200838f462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:21.130173 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02f134-37ca-4e41-b94f-1e200838f462 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.130173 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02f134-37ca-4e41-b94f-1e200838f462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.130173 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02f134-37ca-4e41-b94f-1e200838f462 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.140221 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02f134-37ca-4e41-b94f-1e200838f462 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:21.142110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02f134-37ca-4e41-b94f-1e200838f462 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:21.159772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-9e02f134-37ca-4e41-b94f-1e200838f462 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:19:21.161118 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 609/1213] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:21.166646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46ae46-d184-4136-9706-182d16aeda4c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:21.176361 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46ae46-d184-4136-9706-182d16aeda4c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:21.180946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd4bc3-e67f-43a1-b4c8-1b542ba2ff79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:21.181570 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd4bc3-e67f-43a1-b4c8-1b542ba2ff79 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.181847 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd4bc3-e67f-43a1-b4c8-1b542ba2ff79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.182119 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd4bc3-e67f-43a1-b4c8-1b542ba2ff79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.182837 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd4bc3-e67f-43a1-b4c8-1b542ba2ff79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:21.183135 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd4bc3-e67f-43a1-b4c8-1b542ba2ff79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:21.184721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd4bc3-e67f-43a1-b4c8-1b542ba2ff79 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:21.195660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 605/1214] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:21.200904 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02f134-37ca-4e41-b94f-1e200838f462 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:21.210986 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02f134-37ca-4e41-b94f-1e200838f462 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:21.215493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dde03b-cc48-40dc-8f1d-a53cfd3c392f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:21.216278 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dde03b-cc48-40dc-8f1d-a53cfd3c392f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.216557 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dde03b-cc48-40dc-8f1d-a53cfd3c392f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.216825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dde03b-cc48-40dc-8f1d-a53cfd3c392f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.224300 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dde03b-cc48-40dc-8f1d-a53cfd3c392f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:21.227918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dde03b-cc48-40dc-8f1d-a53cfd3c392f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:21.240054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-b4dde03b-cc48-40dc-8f1d-a53cfd3c392f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:19:21.241230 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 610/1215] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:19:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:21.247267 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd4bc3-e67f-43a1-b4c8-1b542ba2ff79 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:21.257282 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd4bc3-e67f-43a1-b4c8-1b542ba2ff79 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:21.261824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bae538-a3c3-441e-ad42-1bedbf4e01bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:21.262443 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bae538-a3c3-441e-ad42-1bedbf4e01bf admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.262731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bae538-a3c3-441e-ad42-1bedbf4e01bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.263002 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bae538-a3c3-441e-ad42-1bedbf4e01bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.263828 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bae538-a3c3-441e-ad42-1bedbf4e01bf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:21.264793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bae538-a3c3-441e-ad42-1bedbf4e01bf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:21.266555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bae538-a3c3-441e-ad42-1bedbf4e01bf admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:21.278374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 606/1216] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:19:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:21.284679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dde03b-cc48-40dc-8f1d-a53cfd3c392f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:21.294961 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dde03b-cc48-40dc-8f1d-a53cfd3c392f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:21.300593 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c835cd-9b6e-4531-9391-9dbd69200f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:21.301230 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c835cd-9b6e-4531-9391-9dbd69200f8b admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:21.301494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c835cd-9b6e-4531-9391-9dbd69200f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:21.301762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c835cd-9b6e-4531-9391-9dbd69200f8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:21.302592 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c835cd-9b6e-4531-9391-9dbd69200f8b admin admin] RBAC: Adding query filter params (role.id=f9ebfff2487e4c75854f6c174dcebf56, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=d48fd9b23a4946cc81a9ad7845d26623) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:21.302898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c835cd-9b6e-4531-9391-9dbd69200f8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:21.304754 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c835cd-9b6e-4531-9391-9dbd69200f8b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:21.310088 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 611/1217] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:19:21 2022] GET /identity/v3/role_assignments?user.id=d48fd9b23a4946cc81a9ad7845d26623&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=f9ebfff2487e4c75854f6c174dcebf56 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:23.483101 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba966f-e83b-4b23-913a-047b0a9de917 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:23.483675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba966f-e83b-4b23-913a-047b0a9de917 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:23.483675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba966f-e83b-4b23-913a-047b0a9de917 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:23.485415 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 607/1218] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:19:23.490687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346073c-71ea-4e8d-900e-0790cd214959 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:23.491064 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346073c-71ea-4e8d-900e-0790cd214959 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:23.491247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346073c-71ea-4e8d-900e-0790cd214959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:23.508723 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-e346073c-71ea-4e8d-900e-0790cd214959 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:23.509867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e346073c-71ea-4e8d-900e-0790cd214959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:23.518213 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 612/1219] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:19:23 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:23.541205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba966f-e83b-4b23-913a-047b0a9de917 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:23.553979 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba966f-e83b-4b23-913a-047b0a9de917 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:23.558404 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b430a-968c-4bad-91c5-73a1b15aaefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:23.559172 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b430a-968c-4bad-91c5-73a1b15aaefb admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:23.559490 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b430a-968c-4bad-91c5-73a1b15aaefb admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:23.559767 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b430a-968c-4bad-91c5-73a1b15aaefb admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:23.570170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b430a-968c-4bad-91c5-73a1b15aaefb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:19:23.577454 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-a78b430a-968c-4bad-91c5-73a1b15aaefb admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:19:23.578600 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 608/1220] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:19:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:23.584601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346073c-71ea-4e8d-900e-0790cd214959 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:23.594092 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346073c-71ea-4e8d-900e-0790cd214959 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:23.598541 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ba23e-4410-4ba5-8911-83055cc8616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:23.599175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ba23e-4410-4ba5-8911-83055cc8616b admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:23.599481 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ba23e-4410-4ba5-8911-83055cc8616b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:23.599749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ba23e-4410-4ba5-8911-83055cc8616b admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:23.600498 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ba23e-4410-4ba5-8911-83055cc8616b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:23.600795 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ba23e-4410-4ba5-8911-83055cc8616b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:23.602352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ba23e-4410-4ba5-8911-83055cc8616b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:23.610231 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 613/1221] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:19:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:19:23.615625 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b430a-968c-4bad-91c5-73a1b15aaefb admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:23.625772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b430a-968c-4bad-91c5-73a1b15aaefb admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:23.630207 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845f6fa-3447-4506-9117-7870cfdf500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:23.630944 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845f6fa-3447-4506-9117-7870cfdf500b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:23.631233 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845f6fa-3447-4506-9117-7870cfdf500b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:23.631518 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845f6fa-3447-4506-9117-7870cfdf500b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:23.641894 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845f6fa-3447-4506-9117-7870cfdf500b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:23.645136 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845f6fa-3447-4506-9117-7870cfdf500b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:23.662083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-1845f6fa-3447-4506-9117-7870cfdf500b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:19:23.663252 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 609/1222] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:23.668946 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ba23e-4410-4ba5-8911-83055cc8616b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:23.679448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ba23e-4410-4ba5-8911-83055cc8616b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:23.684506 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8107e-e3d1-4305-9ca6-578363751dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:23.685137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8107e-e3d1-4305-9ca6-578363751dbc admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:23.685566 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8107e-e3d1-4305-9ca6-578363751dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:23.685850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8107e-e3d1-4305-9ca6-578363751dbc admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:23.686669 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8107e-e3d1-4305-9ca6-578363751dbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:23.686972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8107e-e3d1-4305-9ca6-578363751dbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:23.688586 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8107e-e3d1-4305-9ca6-578363751dbc admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:23.700090 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 614/1223] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:23.706169 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845f6fa-3447-4506-9117-7870cfdf500b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:23.715791 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845f6fa-3447-4506-9117-7870cfdf500b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:23.720950 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1586c8-71e1-465c-adf7-b3bb86ad0b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:23.721709 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1586c8-71e1-465c-adf7-b3bb86ad0b5e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:23.727670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1586c8-71e1-465c-adf7-b3bb86ad0b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:23.727670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1586c8-71e1-465c-adf7-b3bb86ad0b5e admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:23.729314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1586c8-71e1-465c-adf7-b3bb86ad0b5e admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:23.731340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1586c8-71e1-465c-adf7-b3bb86ad0b5e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:23.744874 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-4b1586c8-71e1-465c-adf7-b3bb86ad0b5e admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 12 04:19:23.745977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 610/1224] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:23.751606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8107e-e3d1-4305-9ca6-578363751dbc admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:23.761289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8107e-e3d1-4305-9ca6-578363751dbc admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:23.766455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618a78-9d41-46b1-831d-c70db868742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:23.767249 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618a78-9d41-46b1-831d-c70db868742f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:23.767537 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618a78-9d41-46b1-831d-c70db868742f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:23.767817 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618a78-9d41-46b1-831d-c70db868742f admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:23.768642 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18618a78-9d41-46b1-831d-c70db868742f admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:23.768941 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18618a78-9d41-46b1-831d-c70db868742f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:23.770785 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18618a78-9d41-46b1-831d-c70db868742f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:23.787662 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 615/1225] 10.222.0.35 () {56 vars in 1164 bytes} [Sat Feb 12 04:19:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:19:23.793184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1586c8-71e1-465c-adf7-b3bb86ad0b5e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:23.803576 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1586c8-71e1-465c-adf7-b3bb86ad0b5e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:23.808081 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72cec8-8bac-4033-8e26-411e3a3056db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:23.808836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72cec8-8bac-4033-8e26-411e3a3056db admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:23.809112 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72cec8-8bac-4033-8e26-411e3a3056db admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:23.809382 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72cec8-8bac-4033-8e26-411e3a3056db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:23.819719 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72cec8-8bac-4033-8e26-411e3a3056db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:23.821508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72cec8-8bac-4033-8e26-411e3a3056db admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:23.837826 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-6e72cec8-8bac-4033-8e26-411e3a3056db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:19:23.838935 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 611/1226] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:23.845055 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618a78-9d41-46b1-831d-c70db868742f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:23.854671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618a78-9d41-46b1-831d-c70db868742f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:23.859727 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28b4a5-d861-4afc-9755-c49e0e9ff32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:23.860352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28b4a5-d861-4afc-9755-c49e0e9ff32e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:23.860628 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28b4a5-d861-4afc-9755-c49e0e9ff32e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:23.860894 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28b4a5-d861-4afc-9755-c49e0e9ff32e admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:23.861611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28b4a5-d861-4afc-9755-c49e0e9ff32e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:23.861907 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28b4a5-d861-4afc-9755-c49e0e9ff32e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:23.863501 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28b4a5-d861-4afc-9755-c49e0e9ff32e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:23.876047 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 616/1227] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:23.881437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72cec8-8bac-4033-8e26-411e3a3056db admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:23.890890 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72cec8-8bac-4033-8e26-411e3a3056db admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:23.895387 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bacb87-a0f3-4673-88b7-cecbc4391088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:23.896142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bacb87-a0f3-4673-88b7-cecbc4391088 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:23.896420 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bacb87-a0f3-4673-88b7-cecbc4391088 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:23.896692 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bacb87-a0f3-4673-88b7-cecbc4391088 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:23.903458 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bacb87-a0f3-4673-88b7-cecbc4391088 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:23.906141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bacb87-a0f3-4673-88b7-cecbc4391088 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:23.918892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-61bacb87-a0f3-4673-88b7-cecbc4391088 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:19:23.920038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 612/1228] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:19:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:23.927500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28b4a5-d861-4afc-9755-c49e0e9ff32e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:23.937182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28b4a5-d861-4afc-9755-c49e0e9ff32e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:23.941794 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ec460-2879-4bbb-acfe-41a9ec9c7bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:23.942435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ec460-2879-4bbb-acfe-41a9ec9c7bbc admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:23.942724 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ec460-2879-4bbb-acfe-41a9ec9c7bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:23.943001 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ec460-2879-4bbb-acfe-41a9ec9c7bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:23.943855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ec460-2879-4bbb-acfe-41a9ec9c7bbc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:23.945619 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ec460-2879-4bbb-acfe-41a9ec9c7bbc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:23.946021 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ec460-2879-4bbb-acfe-41a9ec9c7bbc admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:23.959087 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 617/1229] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:23.965230 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bacb87-a0f3-4673-88b7-cecbc4391088 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:23.976264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bacb87-a0f3-4673-88b7-cecbc4391088 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:23.980929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b934a7-e68b-4fb8-9180-40da5567725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:23.981786 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b934a7-e68b-4fb8-9180-40da5567725c admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:23.982063 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b934a7-e68b-4fb8-9180-40da5567725c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:23.982333 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b934a7-e68b-4fb8-9180-40da5567725c admin admin] PATH_INFO: `/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/d48fd9b23a4946cc81a9ad7845d26623/roles/f9ebfff2487e4c75854f6c174dcebf56` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:23.997042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b934a7-e68b-4fb8-9180-40da5567725c admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e546ab571490aa0b23c0b22a35c4f, user_id=d48fd9b23a4946cc81a9ad7845d26623, role_id=f9ebfff2487e4c75854f6c174dcebf56)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:23.999891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b934a7-e68b-4fb8-9180-40da5567725c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:24.104716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 613/1230] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:19:23 2022] PUT /identity/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/d48fd9b23a4946cc81a9ad7845d26623/roles/f9ebfff2487e4c75854f6c174dcebf56 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:26.277825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac821d-90ee-4536-9f92-e39f179c9065 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.278375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac821d-90ee-4536-9f92-e39f179c9065 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.278375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac821d-90ee-4536-9f92-e39f179c9065 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.280762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 618/1231] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:19:26.286190 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50d157-7bef-4175-b7c1-36d4d9cf1f5d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.291891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50d157-7bef-4175-b7c1-36d4d9cf1f5d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.291891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee50d157-7bef-4175-b7c1-36d4d9cf1f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.305031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-ee50d157-7bef-4175-b7c1-36d4d9cf1f5d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:26.306197 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ee50d157-7bef-4175-b7c1-36d4d9cf1f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:26.361243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 614/1232] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:19:26 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:26.384828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac821d-90ee-4536-9f92-e39f179c9065 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:26.397351 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac821d-90ee-4536-9f92-e39f179c9065 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:26.401671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbfaa0-affe-432a-802a-adf4423a734d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:26.402441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbfaa0-affe-432a-802a-adf4423a734d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.402720 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbfaa0-affe-432a-802a-adf4423a734d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.402993 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dbfaa0-affe-432a-802a-adf4423a734d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.413677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dbfaa0-affe-432a-802a-adf4423a734d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:19:26.421013 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-05dbfaa0-affe-432a-802a-adf4423a734d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Feb 12 04:19:26.424959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 619/1233] 10.222.0.35 () {56 vars in 1123 bytes} [Sat Feb 12 04:19:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:26.428500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50d157-7bef-4175-b7c1-36d4d9cf1f5d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:26.437372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee50d157-7bef-4175-b7c1-36d4d9cf1f5d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:26.441912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2501cd-ebba-409c-b05a-dfb7a34a4510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:26.442555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2501cd-ebba-409c-b05a-dfb7a34a4510 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.442833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2501cd-ebba-409c-b05a-dfb7a34a4510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.443105 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2501cd-ebba-409c-b05a-dfb7a34a4510 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.443896 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2501cd-ebba-409c-b05a-dfb7a34a4510 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:26.444196 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2501cd-ebba-409c-b05a-dfb7a34a4510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:26.445777 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2501cd-ebba-409c-b05a-dfb7a34a4510 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:26.454323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 615/1234] 10.222.0.35 () {56 vars in 1124 bytes} [Sat Feb 12 04:19:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:26.459816 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbfaa0-affe-432a-802a-adf4423a734d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:26.470189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dbfaa0-affe-432a-802a-adf4423a734d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:26.475551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b35691-7201-4f4c-9b4a-ea37fc5d6e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:26.475551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b35691-7201-4f4c-9b4a-ea37fc5d6e00 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.475887 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b35691-7201-4f4c-9b4a-ea37fc5d6e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.476162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b35691-7201-4f4c-9b4a-ea37fc5d6e00 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.486834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b35691-7201-4f4c-9b4a-ea37fc5d6e00 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:26.488668 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b35691-7201-4f4c-9b4a-ea37fc5d6e00 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:26.504542 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-16b35691-7201-4f4c-9b4a-ea37fc5d6e00 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:19:26.505663 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 620/1235] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:26.511241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2501cd-ebba-409c-b05a-dfb7a34a4510 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:26.521444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2501cd-ebba-409c-b05a-dfb7a34a4510 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:26.526017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd14b27-c0a4-4a52-ac00-ea77dede22ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:26.526656 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd14b27-c0a4-4a52-ac00-ea77dede22ce admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.535763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd14b27-c0a4-4a52-ac00-ea77dede22ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.535763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd14b27-c0a4-4a52-ac00-ea77dede22ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.535763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd14b27-c0a4-4a52-ac00-ea77dede22ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:26.535763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd14b27-c0a4-4a52-ac00-ea77dede22ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:26.535763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd14b27-c0a4-4a52-ac00-ea77dede22ce admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:26.541893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 616/1236] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:26.547479 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b35691-7201-4f4c-9b4a-ea37fc5d6e00 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:26.557306 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b35691-7201-4f4c-9b4a-ea37fc5d6e00 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:26.564444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197b8a0-7a34-4023-aff7-c77e2a01284f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:26.564444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b8a0-7a34-4023-aff7-c77e2a01284f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.564444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b8a0-7a34-4023-aff7-c77e2a01284f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.564444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b8a0-7a34-4023-aff7-c77e2a01284f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.571470 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197b8a0-7a34-4023-aff7-c77e2a01284f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:26.573443 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197b8a0-7a34-4023-aff7-c77e2a01284f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:26.587519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-8197b8a0-7a34-4023-aff7-c77e2a01284f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 12 04:19:26.588651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 621/1237] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:19:26.594955 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd14b27-c0a4-4a52-ac00-ea77dede22ce admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:26.604546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd14b27-c0a4-4a52-ac00-ea77dede22ce admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:26.609479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f36f0-efc8-432b-8d2d-5417b500e61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:26.610115 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f36f0-efc8-432b-8d2d-5417b500e61a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.610394 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f36f0-efc8-432b-8d2d-5417b500e61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.610665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4f36f0-efc8-432b-8d2d-5417b500e61a admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.611609 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f36f0-efc8-432b-8d2d-5417b500e61a admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:26.611975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f36f0-efc8-432b-8d2d-5417b500e61a admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:26.613787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4f36f0-efc8-432b-8d2d-5417b500e61a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:26.630546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 617/1238] 10.222.0.35 () {56 vars in 1164 bytes} [Sat Feb 12 04:19:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:26.636003 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197b8a0-7a34-4023-aff7-c77e2a01284f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:26.646318 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197b8a0-7a34-4023-aff7-c77e2a01284f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:26.650774 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ab7b7-08b6-4239-823e-3e06d40570ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:26.651423 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ab7b7-08b6-4239-823e-3e06d40570ed admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.651705 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ab7b7-08b6-4239-823e-3e06d40570ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.651982 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1ab7b7-08b6-4239-823e-3e06d40570ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.660298 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ab7b7-08b6-4239-823e-3e06d40570ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:26.662009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1ab7b7-08b6-4239-823e-3e06d40570ed admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:26.670947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 622/1239] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:19:26 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:26.676660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f36f0-efc8-432b-8d2d-5417b500e61a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:26.686091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4f36f0-efc8-432b-8d2d-5417b500e61a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:26.690682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdc7e8-7204-4056-ad62-d24520074429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:26.691568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdc7e8-7204-4056-ad62-d24520074429 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.691798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdc7e8-7204-4056-ad62-d24520074429 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.692069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcdc7e8-7204-4056-ad62-d24520074429 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.702690 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdc7e8-7204-4056-ad62-d24520074429 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:26.704569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcdc7e8-7204-4056-ad62-d24520074429 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:26.721915 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-6dcdc7e8-7204-4056-ad62-d24520074429 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:19:26.723081 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 618/1240] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:26.728664 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ab7b7-08b6-4239-823e-3e06d40570ed admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:26.737434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1ab7b7-08b6-4239-823e-3e06d40570ed admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:26.742018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4aea8c-0567-41fc-8efd-5be486e990c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:26.742645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aea8c-0567-41fc-8efd-5be486e990c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.742920 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aea8c-0567-41fc-8efd-5be486e990c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.743189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aea8c-0567-41fc-8efd-5be486e990c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.743944 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4aea8c-0567-41fc-8efd-5be486e990c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:26.744241 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4aea8c-0567-41fc-8efd-5be486e990c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:26.745784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4aea8c-0567-41fc-8efd-5be486e990c5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:26.757294 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 623/1241] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:26.762588 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdc7e8-7204-4056-ad62-d24520074429 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:26.772974 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcdc7e8-7204-4056-ad62-d24520074429 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:26.783939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f94c2-31b4-46fc-8a72-4e2dac2f8ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:26.783939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f94c2-31b4-46fc-8a72-4e2dac2f8ffe admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.783939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f94c2-31b4-46fc-8a72-4e2dac2f8ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.783939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102f94c2-31b4-46fc-8a72-4e2dac2f8ffe admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.787144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f94c2-31b4-46fc-8a72-4e2dac2f8ffe admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:26.789120 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102f94c2-31b4-46fc-8a72-4e2dac2f8ffe admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:26.802061 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-102f94c2-31b4-46fc-8a72-4e2dac2f8ffe admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:19:26.803170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 619/1242] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:19:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:19:26.808686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4aea8c-0567-41fc-8efd-5be486e990c5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:26.818293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4aea8c-0567-41fc-8efd-5be486e990c5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:26.822558 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a7fcd2-8693-4003-8997-5bef5bc3e6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:26.823244 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7fcd2-8693-4003-8997-5bef5bc3e6cb admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.823542 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7fcd2-8693-4003-8997-5bef5bc3e6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.823812 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a7fcd2-8693-4003-8997-5bef5bc3e6cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.824598 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7fcd2-8693-4003-8997-5bef5bc3e6cb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:26.824899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7fcd2-8693-4003-8997-5bef5bc3e6cb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:26.827211 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a7fcd2-8693-4003-8997-5bef5bc3e6cb admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:26.838418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 624/1243] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:19:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:26.845022 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f94c2-31b4-46fc-8a72-4e2dac2f8ffe admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:26.855254 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102f94c2-31b4-46fc-8a72-4e2dac2f8ffe admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:26.859903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea89c30-7f7d-4243-a551-54bcb0ef287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:26.860522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea89c30-7f7d-4243-a551-54bcb0ef287f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:26.860807 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea89c30-7f7d-4243-a551-54bcb0ef287f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:26.861083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea89c30-7f7d-4243-a551-54bcb0ef287f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:26.861919 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea89c30-7f7d-4243-a551-54bcb0ef287f admin admin] RBAC: Adding query filter params (role.id=f9ebfff2487e4c75854f6c174dcebf56, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=d48fd9b23a4946cc81a9ad7845d26623) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:26.862225 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea89c30-7f7d-4243-a551-54bcb0ef287f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:26.864072 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea89c30-7f7d-4243-a551-54bcb0ef287f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:26.869734 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 620/1244] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:19:26 2022] GET /identity/v3/role_assignments?user.id=d48fd9b23a4946cc81a9ad7845d26623&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=f9ebfff2487e4c75854f6c174dcebf56 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:29.143824 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d9a9a-c49a-4119-b5c7-e857fb0a4fa2 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.144579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d9a9a-c49a-4119-b5c7-e857fb0a4fa2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.144579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57d9a9a-c49a-4119-b5c7-e857fb0a4fa2 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.146107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 625/1245] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:19:29.151369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f18f44-4f6d-44fd-b964-bef0c33468a4 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.151772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f18f44-4f6d-44fd-b964-bef0c33468a4 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.151922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f18f44-4f6d-44fd-b964-bef0c33468a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.169156 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-33f18f44-4f6d-44fd-b964-bef0c33468a4 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:29.170475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-33f18f44-4f6d-44fd-b964-bef0c33468a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:29.178493 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 621/1246] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:19:29 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:29.203531 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d9a9a-c49a-4119-b5c7-e857fb0a4fa2 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:29.215806 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57d9a9a-c49a-4119-b5c7-e857fb0a4fa2 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:29.220290 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd1336-6829-49a3-8e7b-2e1bef6c8929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:29.221098 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd1336-6829-49a3-8e7b-2e1bef6c8929 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.221380 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd1336-6829-49a3-8e7b-2e1bef6c8929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.221648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd1336-6829-49a3-8e7b-2e1bef6c8929 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.231765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bd1336-6829-49a3-8e7b-2e1bef6c8929 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:19:29.238626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-72bd1336-6829-49a3-8e7b-2e1bef6c8929 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:19:29.239922 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 626/1247] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:19:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:29.245846 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f18f44-4f6d-44fd-b964-bef0c33468a4 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:29.255586 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f18f44-4f6d-44fd-b964-bef0c33468a4 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:29.260189 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515e56c-84ea-4af2-9b66-49ae1712a48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:29.262294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515e56c-84ea-4af2-9b66-49ae1712a48b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.262294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515e56c-84ea-4af2-9b66-49ae1712a48b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.262294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b515e56c-84ea-4af2-9b66-49ae1712a48b admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.262294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515e56c-84ea-4af2-9b66-49ae1712a48b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:29.262594 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515e56c-84ea-4af2-9b66-49ae1712a48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:29.264808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b515e56c-84ea-4af2-9b66-49ae1712a48b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:29.272899 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 622/1248] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:19:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:29.278551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd1336-6829-49a3-8e7b-2e1bef6c8929 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:29.288951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bd1336-6829-49a3-8e7b-2e1bef6c8929 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:29.293453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa02c52-54c6-425f-8098-5c4a230a513f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:29.294205 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa02c52-54c6-425f-8098-5c4a230a513f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.294479 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa02c52-54c6-425f-8098-5c4a230a513f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.294746 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa02c52-54c6-425f-8098-5c4a230a513f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.305798 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa02c52-54c6-425f-8098-5c4a230a513f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:29.307648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa02c52-54c6-425f-8098-5c4a230a513f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:29.325042 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-3fa02c52-54c6-425f-8098-5c4a230a513f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:19:29.326273 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 627/1249] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:29.332830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515e56c-84ea-4af2-9b66-49ae1712a48b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:29.342771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b515e56c-84ea-4af2-9b66-49ae1712a48b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:29.347494 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba22576-a6bb-4aa4-b2b5-fd0a200d33de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:29.348179 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba22576-a6bb-4aa4-b2b5-fd0a200d33de admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.348467 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba22576-a6bb-4aa4-b2b5-fd0a200d33de admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.348746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba22576-a6bb-4aa4-b2b5-fd0a200d33de admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.349481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba22576-a6bb-4aa4-b2b5-fd0a200d33de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:29.349786 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba22576-a6bb-4aa4-b2b5-fd0a200d33de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:29.351401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba22576-a6bb-4aa4-b2b5-fd0a200d33de admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:29.363395 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 623/1250] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:29.368882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa02c52-54c6-425f-8098-5c4a230a513f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:29.379455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa02c52-54c6-425f-8098-5c4a230a513f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:29.384137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cdb23-a26a-4e23-aed9-17e9324615f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:29.384904 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cdb23-a26a-4e23-aed9-17e9324615f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.385186 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cdb23-a26a-4e23-aed9-17e9324615f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.385458 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cdb23-a26a-4e23-aed9-17e9324615f3 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.393664 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cdb23-a26a-4e23-aed9-17e9324615f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:29.395747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cdb23-a26a-4e23-aed9-17e9324615f3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:29.409976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-e90cdb23-a26a-4e23-aed9-17e9324615f3 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 12 04:19:29.411141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 628/1251] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:29.416641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba22576-a6bb-4aa4-b2b5-fd0a200d33de admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:29.426667 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba22576-a6bb-4aa4-b2b5-fd0a200d33de admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:29.431283 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f6518-d9ea-4df3-bd4a-de644749f734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:29.432167 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f6518-d9ea-4df3-bd4a-de644749f734 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.432273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f6518-d9ea-4df3-bd4a-de644749f734 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.432527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f6518-d9ea-4df3-bd4a-de644749f734 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.433405 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f6518-d9ea-4df3-bd4a-de644749f734 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:29.433730 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f6518-d9ea-4df3-bd4a-de644749f734 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:29.435665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f6518-d9ea-4df3-bd4a-de644749f734 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:29.453670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 624/1252] 10.222.0.35 () {56 vars in 1164 bytes} [Sat Feb 12 04:19:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:29.459194 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cdb23-a26a-4e23-aed9-17e9324615f3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:29.468655 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cdb23-a26a-4e23-aed9-17e9324615f3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:29.473106 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c31e9b-23b6-4dfd-9524-ff2bf036ef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:29.473721 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c31e9b-23b6-4dfd-9524-ff2bf036ef04 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.474001 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c31e9b-23b6-4dfd-9524-ff2bf036ef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.474269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c31e9b-23b6-4dfd-9524-ff2bf036ef04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.481888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c31e9b-23b6-4dfd-9524-ff2bf036ef04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:29.485475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c31e9b-23b6-4dfd-9524-ff2bf036ef04 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:29.492632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 629/1253] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:19:29 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:29.498019 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f6518-d9ea-4df3-bd4a-de644749f734 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:29.508209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f6518-d9ea-4df3-bd4a-de644749f734 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:29.512646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831da5c5-ea6a-4d60-8d36-23993e63355d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:29.514187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831da5c5-ea6a-4d60-8d36-23993e63355d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.514187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831da5c5-ea6a-4d60-8d36-23993e63355d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.514187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831da5c5-ea6a-4d60-8d36-23993e63355d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.523956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831da5c5-ea6a-4d60-8d36-23993e63355d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:29.525767 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831da5c5-ea6a-4d60-8d36-23993e63355d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:29.542583 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-831da5c5-ea6a-4d60-8d36-23993e63355d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:19:29.543832 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 625/1254] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:29.550296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c31e9b-23b6-4dfd-9524-ff2bf036ef04 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:29.558972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c31e9b-23b6-4dfd-9524-ff2bf036ef04 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:29.564304 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18011a-0765-454d-a331-8b708d4df421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:29.564933 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18011a-0765-454d-a331-8b708d4df421 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.565211 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18011a-0765-454d-a331-8b708d4df421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.565482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18011a-0765-454d-a331-8b708d4df421 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.566242 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18011a-0765-454d-a331-8b708d4df421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:29.566584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18011a-0765-454d-a331-8b708d4df421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:29.568170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18011a-0765-454d-a331-8b708d4df421 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:29.579195 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 630/1255] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:29.584634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831da5c5-ea6a-4d60-8d36-23993e63355d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:29.594760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831da5c5-ea6a-4d60-8d36-23993e63355d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:29.599425 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4a989-e364-4bff-a9ac-ef5c380ca726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:29.600189 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4a989-e364-4bff-a9ac-ef5c380ca726 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.600578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4a989-e364-4bff-a9ac-ef5c380ca726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.600848 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4a989-e364-4bff-a9ac-ef5c380ca726 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.608438 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4a989-e364-4bff-a9ac-ef5c380ca726 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:29.617311 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b4a989-e364-4bff-a9ac-ef5c380ca726 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:29.630934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-22b4a989-e364-4bff-a9ac-ef5c380ca726 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:19:29.632106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 626/1256] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:19:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:29.638010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18011a-0765-454d-a331-8b708d4df421 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:29.652173 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18011a-0765-454d-a331-8b708d4df421 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:29.652405 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce843d5f-5c0b-4f8d-aecd-fec330952741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:29.652881 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843d5f-5c0b-4f8d-aecd-fec330952741 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.653164 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843d5f-5c0b-4f8d-aecd-fec330952741 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.653439 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce843d5f-5c0b-4f8d-aecd-fec330952741 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.654264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce843d5f-5c0b-4f8d-aecd-fec330952741 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:29.654594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce843d5f-5c0b-4f8d-aecd-fec330952741 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:29.656444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce843d5f-5c0b-4f8d-aecd-fec330952741 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:29.668379 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 631/1257] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:19:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:19:29.675372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4a989-e364-4bff-a9ac-ef5c380ca726 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:29.685566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4a989-e364-4bff-a9ac-ef5c380ca726 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:29.690543 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8add1c-d671-433a-a57a-aef2ba1a850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:29.691163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8add1c-d671-433a-a57a-aef2ba1a850f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:29.691472 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8add1c-d671-433a-a57a-aef2ba1a850f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:29.691748 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8add1c-d671-433a-a57a-aef2ba1a850f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:29.692579 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8add1c-d671-433a-a57a-aef2ba1a850f admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=d48fd9b23a4946cc81a9ad7845d26623) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:29.692885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8add1c-d671-433a-a57a-aef2ba1a850f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:29.694691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8add1c-d671-433a-a57a-aef2ba1a850f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:29.699959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 627/1258] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:19:29 2022] GET /identity/v3/role_assignments?user.id=d48fd9b23a4946cc81a9ad7845d26623&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:31.871520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea460ae-bdcd-4964-834b-957379454f6a None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.872071 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea460ae-bdcd-4964-834b-957379454f6a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.872071 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea460ae-bdcd-4964-834b-957379454f6a None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.874419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 632/1259] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:19:31.879857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ed407-354c-4975-997b-aca36b8fbdad None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.880277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ed407-354c-4975-997b-aca36b8fbdad None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.880405 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63ed407-354c-4975-997b-aca36b8fbdad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.897210 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-f63ed407-354c-4975-997b-aca36b8fbdad None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:31.898369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f63ed407-354c-4975-997b-aca36b8fbdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:31.905974 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 628/1260] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:19:31 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:31.929674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea460ae-bdcd-4964-834b-957379454f6a None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:31.942481 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea460ae-bdcd-4964-834b-957379454f6a None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:31.946863 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1e104-d3e0-4049-a9ac-b716d600b0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:31.947662 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1e104-d3e0-4049-a9ac-b716d600b0fd admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.947942 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1e104-d3e0-4049-a9ac-b716d600b0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.948215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1e104-d3e0-4049-a9ac-b716d600b0fd admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.958277 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1e104-d3e0-4049-a9ac-b716d600b0fd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:19:31.965046 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-1af1e104-d3e0-4049-a9ac-b716d600b0fd admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:19:31.966236 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 633/1261] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:19:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:31.972367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ed407-354c-4975-997b-aca36b8fbdad None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:31.981091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63ed407-354c-4975-997b-aca36b8fbdad None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:31.986300 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff9eba-fcb9-4309-a6bc-f94509a13a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:31.986938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff9eba-fcb9-4309-a6bc-f94509a13a6a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:31.987215 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff9eba-fcb9-4309-a6bc-f94509a13a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:31.987512 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aff9eba-fcb9-4309-a6bc-f94509a13a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:31.988301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff9eba-fcb9-4309-a6bc-f94509a13a6a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:31.988602 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff9eba-fcb9-4309-a6bc-f94509a13a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:31.990155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aff9eba-fcb9-4309-a6bc-f94509a13a6a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:31.998111 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 629/1262] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:19:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:32.004112 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1e104-d3e0-4049-a9ac-b716d600b0fd admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.014365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1e104-d3e0-4049-a9ac-b716d600b0fd admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.018985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7460cdb-4c5d-4228-bdb3-bbd5df36f6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.024679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7460cdb-4c5d-4228-bdb3-bbd5df36f6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.024679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7460cdb-4c5d-4228-bdb3-bbd5df36f6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.024679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7460cdb-4c5d-4228-bdb3-bbd5df36f6a6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.030537 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7460cdb-4c5d-4228-bdb3-bbd5df36f6a6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.032367 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7460cdb-4c5d-4228-bdb3-bbd5df36f6a6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.049095 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-c7460cdb-4c5d-4228-bdb3-bbd5df36f6a6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:19:32.050502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 634/1263] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:32.056267 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff9eba-fcb9-4309-a6bc-f94509a13a6a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.066488 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aff9eba-fcb9-4309-a6bc-f94509a13a6a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.071062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2d8d1-9e91-4b4a-8005-a5f6d2b6dd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.071732 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2d8d1-9e91-4b4a-8005-a5f6d2b6dd4a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.072038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2d8d1-9e91-4b4a-8005-a5f6d2b6dd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.072344 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b2d8d1-9e91-4b4a-8005-a5f6d2b6dd4a admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.073105 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2d8d1-9e91-4b4a-8005-a5f6d2b6dd4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:32.073410 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2d8d1-9e91-4b4a-8005-a5f6d2b6dd4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.075023 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b2d8d1-9e91-4b4a-8005-a5f6d2b6dd4a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.087482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 630/1264] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:32.093661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7460cdb-4c5d-4228-bdb3-bbd5df36f6a6 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.103315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7460cdb-4c5d-4228-bdb3-bbd5df36f6a6 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.108438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d14c2-40e1-4045-b193-01cae428df79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.109210 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d14c2-40e1-4045-b193-01cae428df79 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.109481 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d14c2-40e1-4045-b193-01cae428df79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.109749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d14c2-40e1-4045-b193-01cae428df79 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.116924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d14c2-40e1-4045-b193-01cae428df79 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.118893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d14c2-40e1-4045-b193-01cae428df79 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.132740 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-871d14c2-40e1-4045-b193-01cae428df79 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 12 04:19:32.133799 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 635/1265] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:19:32.139604 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2d8d1-9e91-4b4a-8005-a5f6d2b6dd4a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.149200 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b2d8d1-9e91-4b4a-8005-a5f6d2b6dd4a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.153762 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236c8a4-e798-4677-b77e-4d0e41b3dab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.154914 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236c8a4-e798-4677-b77e-4d0e41b3dab7 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.155201 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236c8a4-e798-4677-b77e-4d0e41b3dab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.159599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2236c8a4-e798-4677-b77e-4d0e41b3dab7 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.159599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236c8a4-e798-4677-b77e-4d0e41b3dab7 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:32.159599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236c8a4-e798-4677-b77e-4d0e41b3dab7 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.159599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2236c8a4-e798-4677-b77e-4d0e41b3dab7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.176635 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 631/1266] 10.222.0.35 () {56 vars in 1164 bytes} [Sat Feb 12 04:19:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:32.182018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d14c2-40e1-4045-b193-01cae428df79 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.191589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d14c2-40e1-4045-b193-01cae428df79 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.196052 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cbc84-5ac5-4d25-8f4c-88a9327a0d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.196808 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cbc84-5ac5-4d25-8f4c-88a9327a0d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.197086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cbc84-5ac5-4d25-8f4c-88a9327a0d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.197354 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8cbc84-5ac5-4d25-8f4c-88a9327a0d53 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.207534 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cbc84-5ac5-4d25-8f4c-88a9327a0d53 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.209312 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8cbc84-5ac5-4d25-8f4c-88a9327a0d53 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.226162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-db8cbc84-5ac5-4d25-8f4c-88a9327a0d53 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:19:32.227316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 636/1267] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:19:32.233606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236c8a4-e798-4677-b77e-4d0e41b3dab7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.243339 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2236c8a4-e798-4677-b77e-4d0e41b3dab7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.247905 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3a94b-53ad-4198-88d1-8c7035c45cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.251345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3a94b-53ad-4198-88d1-8c7035c45cff admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.251345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3a94b-53ad-4198-88d1-8c7035c45cff admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.251345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e3a94b-53ad-4198-88d1-8c7035c45cff admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.251345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3a94b-53ad-4198-88d1-8c7035c45cff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:32.251345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3a94b-53ad-4198-88d1-8c7035c45cff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.251865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e3a94b-53ad-4198-88d1-8c7035c45cff admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.262997 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 632/1268] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:32.268558 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cbc84-5ac5-4d25-8f4c-88a9327a0d53 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.278416 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8cbc84-5ac5-4d25-8f4c-88a9327a0d53 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.283830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925453e4-238f-48a7-92bd-aaeac071ba2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.284604 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925453e4-238f-48a7-92bd-aaeac071ba2e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.284887 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925453e4-238f-48a7-92bd-aaeac071ba2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.285159 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925453e4-238f-48a7-92bd-aaeac071ba2e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.292105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925453e4-238f-48a7-92bd-aaeac071ba2e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.294043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925453e4-238f-48a7-92bd-aaeac071ba2e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.307897 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-925453e4-238f-48a7-92bd-aaeac071ba2e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:19:32.309039 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 637/1269] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:19:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:32.314717 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3a94b-53ad-4198-88d1-8c7035c45cff admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.324251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e3a94b-53ad-4198-88d1-8c7035c45cff admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.328816 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f22602-b1eb-4ecd-9f6d-89816cbe4799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.329440 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f22602-b1eb-4ecd-9f6d-89816cbe4799 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.329718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f22602-b1eb-4ecd-9f6d-89816cbe4799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.329990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f22602-b1eb-4ecd-9f6d-89816cbe4799 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.330937 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f22602-b1eb-4ecd-9f6d-89816cbe4799 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:32.331265 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f22602-b1eb-4ecd-9f6d-89816cbe4799 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.333087 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f22602-b1eb-4ecd-9f6d-89816cbe4799 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.345311 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 633/1270] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:19:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:19:32.351137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925453e4-238f-48a7-92bd-aaeac071ba2e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:32.362716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925453e4-238f-48a7-92bd-aaeac071ba2e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:32.367310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260d67ea-d83f-4296-a1c8-9d61fbff0339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:32.368095 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d67ea-d83f-4296-a1c8-9d61fbff0339 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:32.370686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d67ea-d83f-4296-a1c8-9d61fbff0339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:32.370686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260d67ea-d83f-4296-a1c8-9d61fbff0339 admin admin] PATH_INFO: `/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/d48fd9b23a4946cc81a9ad7845d26623/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:32.370686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d67ea-d83f-4296-a1c8-9d61fbff0339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688e546ab571490aa0b23c0b22a35c4f, user_id=d48fd9b23a4946cc81a9ad7845d26623, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:32.373237 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260d67ea-d83f-4296-a1c8-9d61fbff0339 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:32.458717 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 638/1271] 10.222.0.35 () {58 vars in 1460 bytes} [Sat Feb 12 04:19:32 2022] PUT /identity/v3/projects/688e546ab571490aa0b23c0b22a35c4f/users/d48fd9b23a4946cc81a9ad7845d26623/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:19:34.643051 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6385e44-2baa-4c37-8aba-092421e5fdf0 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.643621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6385e44-2baa-4c37-8aba-092421e5fdf0 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.643621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6385e44-2baa-4c37-8aba-092421e5fdf0 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.645310 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 634/1272] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:19:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:19:34.650734 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432f016-5f0b-466b-a79b-009d46d9f0a2 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.652658 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432f016-5f0b-466b-a79b-009d46d9f0a2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.652658 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432f016-5f0b-466b-a79b-009d46d9f0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.669052 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-c432f016-5f0b-466b-a79b-009d46d9f0a2 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:34.671179 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c432f016-5f0b-466b-a79b-009d46d9f0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:34.727676 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 639/1273] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:19:34 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:34.751281 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6385e44-2baa-4c37-8aba-092421e5fdf0 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:34.763298 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6385e44-2baa-4c37-8aba-092421e5fdf0 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:34.768250 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140950e-eb6e-449f-a9e3-25bd2071a9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:34.769007 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140950e-eb6e-449f-a9e3-25bd2071a9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.772855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140950e-eb6e-449f-a9e3-25bd2071a9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.772855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140950e-eb6e-449f-a9e3-25bd2071a9e2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.780351 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140950e-eb6e-449f-a9e3-25bd2071a9e2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Feb 12 04:19:34.787020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-e140950e-eb6e-449f-a9e3-25bd2071a9e2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Feb 12 04:19:34.788197 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 635/1274] 10.222.0.35 () {56 vars in 1117 bytes} [Sat Feb 12 04:19:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:34.794085 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432f016-5f0b-466b-a79b-009d46d9f0a2 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:34.803144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432f016-5f0b-466b-a79b-009d46d9f0a2 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:34.808001 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5578eac-51ff-4c23-97e5-d094f16339e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:34.808649 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578eac-51ff-4c23-97e5-d094f16339e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.808928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578eac-51ff-4c23-97e5-d094f16339e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.809200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578eac-51ff-4c23-97e5-d094f16339e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.809957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5578eac-51ff-4c23-97e5-d094f16339e7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:34.810257 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5578eac-51ff-4c23-97e5-d094f16339e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:34.811917 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5578eac-51ff-4c23-97e5-d094f16339e7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:34.819947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 640/1275] 10.222.0.35 () {56 vars in 1120 bytes} [Sat Feb 12 04:19:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:34.825335 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140950e-eb6e-449f-a9e3-25bd2071a9e2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:34.836163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140950e-eb6e-449f-a9e3-25bd2071a9e2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:34.840626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa4240-d63f-4e5a-8519-bd1bda45afa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:34.841378 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa4240-d63f-4e5a-8519-bd1bda45afa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.841659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa4240-d63f-4e5a-8519-bd1bda45afa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.842785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fa4240-d63f-4e5a-8519-bd1bda45afa0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.852956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa4240-d63f-4e5a-8519-bd1bda45afa0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:34.854788 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fa4240-d63f-4e5a-8519-bd1bda45afa0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:34.871214 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-42fa4240-d63f-4e5a-8519-bd1bda45afa0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:19:34.872552 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 636/1276] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:19:34.878093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5578eac-51ff-4c23-97e5-d094f16339e7 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:34.887521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5578eac-51ff-4c23-97e5-d094f16339e7 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:34.892611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741ffa0-40da-4b7b-8fb1-20c3254b50aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:34.893288 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ffa0-40da-4b7b-8fb1-20c3254b50aa admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.893517 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ffa0-40da-4b7b-8fb1-20c3254b50aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.893785 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ffa0-40da-4b7b-8fb1-20c3254b50aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.894503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741ffa0-40da-4b7b-8fb1-20c3254b50aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:34.894801 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741ffa0-40da-4b7b-8fb1-20c3254b50aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:34.896385 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741ffa0-40da-4b7b-8fb1-20c3254b50aa admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:34.908315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 641/1277] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:34.913712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa4240-d63f-4e5a-8519-bd1bda45afa0 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:34.923318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fa4240-d63f-4e5a-8519-bd1bda45afa0 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:34.928111 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492fbed-e0a1-4920-9958-b32c65b9cdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:34.928875 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492fbed-e0a1-4920-9958-b32c65b9cdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.929155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492fbed-e0a1-4920-9958-b32c65b9cdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.929430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f492fbed-e0a1-4920-9958-b32c65b9cdc7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.936570 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492fbed-e0a1-4920-9958-b32c65b9cdc7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:34.938640 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f492fbed-e0a1-4920-9958-b32c65b9cdc7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:34.953041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-f492fbed-e0a1-4920-9958-b32c65b9cdc7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Feb 12 04:19:34.954755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 637/1278] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:34.959916 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741ffa0-40da-4b7b-8fb1-20c3254b50aa admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:34.970898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741ffa0-40da-4b7b-8fb1-20c3254b50aa admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:34.975392 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ceb6d-e702-41f0-8a67-ded1011f4106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:34.976023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ceb6d-e702-41f0-8a67-ded1011f4106 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:34.976298 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ceb6d-e702-41f0-8a67-ded1011f4106 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:34.976565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24ceb6d-e702-41f0-8a67-ded1011f4106 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:34.977440 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ceb6d-e702-41f0-8a67-ded1011f4106 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:34.977739 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ceb6d-e702-41f0-8a67-ded1011f4106 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:34.979570 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24ceb6d-e702-41f0-8a67-ded1011f4106 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:34.996366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 642/1279] 10.222.0.35 () {56 vars in 1164 bytes} [Sat Feb 12 04:19:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:35.001847 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492fbed-e0a1-4920-9958-b32c65b9cdc7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:35.011418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f492fbed-e0a1-4920-9958-b32c65b9cdc7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:35.016729 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3fbe1-5900-4a00-adbb-f8e864388254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:35.017416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3fbe1-5900-4a00-adbb-f8e864388254 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:35.017691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3fbe1-5900-4a00-adbb-f8e864388254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:35.017960 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b3fbe1-5900-4a00-adbb-f8e864388254 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:35.025710 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3fbe1-5900-4a00-adbb-f8e864388254 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:35.027494 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b3fbe1-5900-4a00-adbb-f8e864388254 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:35.036853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 638/1280] 10.222.0.35 () {58 vars in 1324 bytes} [Sat Feb 12 04:19:35 2022] GET /identity/v3/auth/tokens => generated 2973 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:19:35.042391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ceb6d-e702-41f0-8a67-ded1011f4106 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:35.052259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24ceb6d-e702-41f0-8a67-ded1011f4106 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:35.056797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430af52d-749a-48b0-96ae-a00f59429797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:35.057989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430af52d-749a-48b0-96ae-a00f59429797 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:35.057989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430af52d-749a-48b0-96ae-a00f59429797 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:35.058179 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430af52d-749a-48b0-96ae-a00f59429797 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:35.068169 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430af52d-749a-48b0-96ae-a00f59429797 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:35.070100 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430af52d-749a-48b0-96ae-a00f59429797 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:35.087609 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-430af52d-749a-48b0-96ae-a00f59429797 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Feb 12 04:19:35.088807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 643/1281] 10.222.0.35 () {56 vars in 1129 bytes} [Sat Feb 12 04:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:35.095244 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3fbe1-5900-4a00-adbb-f8e864388254 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:35.104261 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b3fbe1-5900-4a00-adbb-f8e864388254 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:35.109287 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d50d7d-207f-4693-aae1-8b27d734c1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:35.110712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d50d7d-207f-4693-aae1-8b27d734c1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:35.110712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d50d7d-207f-4693-aae1-8b27d734c1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:35.110712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d50d7d-207f-4693-aae1-8b27d734c1d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:35.111212 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d50d7d-207f-4693-aae1-8b27d734c1d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:35.111542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d50d7d-207f-4693-aae1-8b27d734c1d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:35.113118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d50d7d-207f-4693-aae1-8b27d734c1d0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:35.124937 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 639/1282] 10.222.0.35 () {56 vars in 1130 bytes} [Sat Feb 12 04:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:19:35.130495 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430af52d-749a-48b0-96ae-a00f59429797 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:35.140594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430af52d-749a-48b0-96ae-a00f59429797 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:35.145129 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bf3cb-88a6-4853-94f7-4da464b94ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:35.145836 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bf3cb-88a6-4853-94f7-4da464b94ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:35.146113 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bf3cb-88a6-4853-94f7-4da464b94ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:35.146381 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0bf3cb-88a6-4853-94f7-4da464b94ce4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:35.153062 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bf3cb-88a6-4853-94f7-4da464b94ce4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:35.155029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0bf3cb-88a6-4853-94f7-4da464b94ce4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:35.167662 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-aa0bf3cb-88a6-4853-94f7-4da464b94ce4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Feb 12 04:19:35.168783 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 644/1283] 10.222.0.35 () {56 vars in 1132 bytes} [Sat Feb 12 04:19:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:35.174955 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d50d7d-207f-4693-aae1-8b27d734c1d0 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:35.184522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d50d7d-207f-4693-aae1-8b27d734c1d0 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:35.189559 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353c4cbe-77c2-474b-8458-d74a4265539f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:35.190187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c4cbe-77c2-474b-8458-d74a4265539f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:35.190469 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c4cbe-77c2-474b-8458-d74a4265539f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:35.190745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353c4cbe-77c2-474b-8458-d74a4265539f admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:35.191558 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c4cbe-77c2-474b-8458-d74a4265539f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:35.191866 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c4cbe-77c2-474b-8458-d74a4265539f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:35.193691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353c4cbe-77c2-474b-8458-d74a4265539f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:35.206196 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 640/1284] 10.222.0.35 () {56 vars in 1169 bytes} [Sat Feb 12 04:19:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:19:35.211861 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bf3cb-88a6-4853-94f7-4da464b94ce4 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:35.222351 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0bf3cb-88a6-4853-94f7-4da464b94ce4 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:35.226877 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b211efd2-97e1-4823-97e1-dcb7ab1a1f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:35.227532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211efd2-97e1-4823-97e1-dcb7ab1a1f0b admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:35.227814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211efd2-97e1-4823-97e1-dcb7ab1a1f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:35.228089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b211efd2-97e1-4823-97e1-dcb7ab1a1f0b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:35.228930 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211efd2-97e1-4823-97e1-dcb7ab1a1f0b admin admin] RBAC: Adding query filter params (role.id=31f3de1096c0476b99b7ac4d719eaa14, scope.project.id=688e546ab571490aa0b23c0b22a35c4f, user.id=d48fd9b23a4946cc81a9ad7845d26623) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:35.229235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211efd2-97e1-4823-97e1-dcb7ab1a1f0b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:35.231057 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b211efd2-97e1-4823-97e1-dcb7ab1a1f0b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:35.237176 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 645/1285] 10.222.0.35 () {56 vars in 1395 bytes} [Sat Feb 12 04:19:35 2022] GET /identity/v3/role_assignments?user.id=d48fd9b23a4946cc81a9ad7845d26623&scope.project.id=688e546ab571490aa0b23c0b22a35c4f&role.id=31f3de1096c0476b99b7ac4d719eaa14 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:19:37.487812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244df555-c821-4238-88a4-35b56f7c8b17 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:37.488334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244df555-c821-4238-88a4-35b56f7c8b17 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:37.488334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244df555-c821-4238-88a4-35b56f7c8b17 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:37.490100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 641/1286] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:19:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:19:37.495257 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f622a-62cc-4b90-a3cc-8af3ce4c8372 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:37.495702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f622a-62cc-4b90-a3cc-8af3ce4c8372 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:37.495812 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f622a-62cc-4b90-a3cc-8af3ce4c8372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:37.513287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-452f622a-62cc-4b90-a3cc-8af3ce4c8372 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:37.514744 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-452f622a-62cc-4b90-a3cc-8af3ce4c8372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:37.522404 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 646/1287] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:19:37 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:37.546052 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244df555-c821-4238-88a4-35b56f7c8b17 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:37.558430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244df555-c821-4238-88a4-35b56f7c8b17 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:37.562944 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ef544-eeab-4d2c-a0bc-a6f304a891a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:37.563745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ef544-eeab-4d2c-a0bc-a6f304a891a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:37.564983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ef544-eeab-4d2c-a0bc-a6f304a891a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:37.564983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ef544-eeab-4d2c-a0bc-a6f304a891a1 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:37.564983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ef544-eeab-4d2c-a0bc-a6f304a891a1 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:37.566575 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ef544-eeab-4d2c-a0bc-a6f304a891a1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:37.577878 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-4c5ef544-eeab-4d2c-a0bc-a6f304a891a1 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 12 04:19:37.579004 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 642/1288] 10.222.0.35 () {56 vars in 1138 bytes} [Sat Feb 12 04:19:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Feb 12 04:19:37.585054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f622a-62cc-4b90-a3cc-8af3ce4c8372 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:37.594548 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f622a-62cc-4b90-a3cc-8af3ce4c8372 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:37.599026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f789471-e450-4e23-9315-552a83292d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:37.599703 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f789471-e450-4e23-9315-552a83292d90 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:37.599985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f789471-e450-4e23-9315-552a83292d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:37.600260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f789471-e450-4e23-9315-552a83292d90 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:37.600979 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f789471-e450-4e23-9315-552a83292d90 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:37.601282 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f789471-e450-4e23-9315-552a83292d90 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:37.602842 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f789471-e450-4e23-9315-552a83292d90 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:37.608255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 647/1289] 10.222.0.35 () {56 vars in 1137 bytes} [Sat Feb 12 04:19:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:37.613599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ef544-eeab-4d2c-a0bc-a6f304a891a1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:37.623479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ef544-eeab-4d2c-a0bc-a6f304a891a1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:37.627925 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f628659-c206-414d-9a0b-391144d546f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:37.628611 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628659-c206-414d-9a0b-391144d546f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:37.628917 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628659-c206-414d-9a0b-391144d546f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:37.629207 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f628659-c206-414d-9a0b-391144d546f3 admin admin] PATH_INFO: `/v3/services` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:37.629917 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f628659-c206-414d-9a0b-391144d546f3 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:37.630215 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f628659-c206-414d-9a0b-391144d546f3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:37.631812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f628659-c206-414d-9a0b-391144d546f3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:37.636241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 643/1290] 10.222.0.35 () {56 vars in 1137 bytes} [Sat Feb 12 04:19:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:39.860166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61927b-9981-4430-9fab-f27e7652b79e None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:39.860693 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61927b-9981-4430-9fab-f27e7652b79e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:39.860693 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61927b-9981-4430-9fab-f27e7652b79e None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:39.862484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 648/1291] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:19:39.867600 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed015281-9473-411e-8c1e-e77b008288c9 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:39.868034 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed015281-9473-411e-8c1e-e77b008288c9 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:39.868202 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed015281-9473-411e-8c1e-e77b008288c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:39.886320 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-ed015281-9473-411e-8c1e-e77b008288c9 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:39.887519 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ed015281-9473-411e-8c1e-e77b008288c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:39.895302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 644/1292] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:19:39 2022] POST /identity/v3/auth/tokens => generated 2973 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:39.918573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61927b-9981-4430-9fab-f27e7652b79e None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:39.931644 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61927b-9981-4430-9fab-f27e7652b79e None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:39.936052 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e347b77-134e-4282-a373-57353ce36d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:39.936687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e347b77-134e-4282-a373-57353ce36d0e admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:39.936971 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e347b77-134e-4282-a373-57353ce36d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:39.937241 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e347b77-134e-4282-a373-57353ce36d0e admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:39.937977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e347b77-134e-4282-a373-57353ce36d0e admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:39.939576 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e347b77-134e-4282-a373-57353ce36d0e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:40.064249 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 649/1293] 10.222.0.35 () {60 vars in 1162 bytes} [Sat Feb 12 04:19:39 2022] POST /identity/v3/services => generated 246 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:19:42.271761 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a6c4f-9809-45a2-9ffb-e260159c50f0 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:42.272314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a6c4f-9809-45a2-9ffb-e260159c50f0 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:42.272314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a6c4f-9809-45a2-9ffb-e260159c50f0 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:42.274215 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 645/1294] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:19:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:19:42.280708 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487442d9-887b-4e30-a656-7c426412a4af None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:42.281097 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487442d9-887b-4e30-a656-7c426412a4af None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:42.281269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487442d9-887b-4e30-a656-7c426412a4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:42.300463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-487442d9-887b-4e30-a656-7c426412a4af None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:42.301721 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-487442d9-887b-4e30-a656-7c426412a4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:42.320559 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 650/1295] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:19:42 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:42.344977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a6c4f-9809-45a2-9ffb-e260159c50f0 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:42.357557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a6c4f-9809-45a2-9ffb-e260159c50f0 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:42.361997 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e855cf-f440-41a6-a0fb-cd9d282751d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:42.362793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e855cf-f440-41a6-a0fb-cd9d282751d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:42.363070 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e855cf-f440-41a6-a0fb-cd9d282751d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:42.363372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e855cf-f440-41a6-a0fb-cd9d282751d2 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:42.364040 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e855cf-f440-41a6-a0fb-cd9d282751d2 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:42.368248 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e855cf-f440-41a6-a0fb-cd9d282751d2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:42.377797 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-08e855cf-f440-41a6-a0fb-cd9d282751d2 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 12 04:19:42.379275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 646/1296] 10.222.0.35 () {56 vars in 1138 bytes} [Sat Feb 12 04:19:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:42.385790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487442d9-887b-4e30-a656-7c426412a4af None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:42.395803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487442d9-887b-4e30-a656-7c426412a4af None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:42.400313 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b5fac-9cfd-4ca2-aa29-3583648ed12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:42.400975 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b5fac-9cfd-4ca2-aa29-3583648ed12a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:42.401300 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b5fac-9cfd-4ca2-aa29-3583648ed12a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:42.401601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b5fac-9cfd-4ca2-aa29-3583648ed12a admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:42.402330 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b5fac-9cfd-4ca2-aa29-3583648ed12a admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:42.402631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b5fac-9cfd-4ca2-aa29-3583648ed12a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:42.404865 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531b5fac-9cfd-4ca2-aa29-3583648ed12a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:42.415431 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 651/1297] 10.222.0.35 () {56 vars in 1137 bytes} [Sat Feb 12 04:19:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:42.417257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e855cf-f440-41a6-a0fb-cd9d282751d2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:42.427701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e855cf-f440-41a6-a0fb-cd9d282751d2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:42.432360 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9031039-2c4f-4a0a-82f1-7f14d0fc18b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:42.433022 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9031039-2c4f-4a0a-82f1-7f14d0fc18b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:42.433303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9031039-2c4f-4a0a-82f1-7f14d0fc18b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:42.433576 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9031039-2c4f-4a0a-82f1-7f14d0fc18b6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:42.434391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9031039-2c4f-4a0a-82f1-7f14d0fc18b6 admin admin] RBAC: Adding query filter params (interface=public, service_id=55dcd2e0f7544cf1b9506e8a98fa9d71, region_id=RegionOne) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:42.434701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9031039-2c4f-4a0a-82f1-7f14d0fc18b6 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:42.436631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9031039-2c4f-4a0a-82f1-7f14d0fc18b6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:42.442472 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 647/1298] 10.222.0.35 () {56 vars in 1272 bytes} [Sat Feb 12 04:19:42 2022] GET /identity/v3/endpoints?service_id=55dcd2e0f7544cf1b9506e8a98fa9d71&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:42.448615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b5fac-9cfd-4ca2-aa29-3583648ed12a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:42.458890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b5fac-9cfd-4ca2-aa29-3583648ed12a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:42.470220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84bf85-c1fd-4294-b970-409b31c7596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:42.470897 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84bf85-c1fd-4294-b970-409b31c7596a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:42.471174 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84bf85-c1fd-4294-b970-409b31c7596a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:42.471488 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84bf85-c1fd-4294-b970-409b31c7596a admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:42.476718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84bf85-c1fd-4294-b970-409b31c7596a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:42.476718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84bf85-c1fd-4294-b970-409b31c7596a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:42.481416 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 652/1299] 10.222.0.35 () {56 vars in 1108 bytes} [Sat Feb 12 04:19:42 2022] GET /identity/v3/services => generated 2191 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:19:44.756078 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93675f2c-6384-401b-876f-d85d5d0e92e1 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:44.756656 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93675f2c-6384-401b-876f-d85d5d0e92e1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:44.756656 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93675f2c-6384-401b-876f-d85d5d0e92e1 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:44.758396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 648/1300] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:19:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:19:44.763562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c8004-e76b-40e4-a32a-680d9f1719bc None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:44.764309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c8004-e76b-40e4-a32a-680d9f1719bc None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:44.764309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c8004-e76b-40e4-a32a-680d9f1719bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:44.782150 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-849c8004-e76b-40e4-a32a-680d9f1719bc None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:19:44.783373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-849c8004-e76b-40e4-a32a-680d9f1719bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:19:44.791301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 653/1301] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:19:44 2022] POST /identity/v3/auth/tokens => generated 3076 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:19:44.815863 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93675f2c-6384-401b-876f-d85d5d0e92e1 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:44.828123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93675f2c-6384-401b-876f-d85d5d0e92e1 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:44.832690 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da499ea-cfc2-4261-a01f-32870f72f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:44.833464 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da499ea-cfc2-4261-a01f-32870f72f423 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:44.833741 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da499ea-cfc2-4261-a01f-32870f72f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:44.834024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da499ea-cfc2-4261-a01f-32870f72f423 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:44.834686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da499ea-cfc2-4261-a01f-32870f72f423 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:44.836295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da499ea-cfc2-4261-a01f-32870f72f423 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:44.847612 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-6da499ea-cfc2-4261-a01f-32870f72f423 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Feb 12 04:19:44.848727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 649/1302] 10.222.0.35 () {56 vars in 1138 bytes} [Sat Feb 12 04:19:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Feb 12 04:19:44.854701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c8004-e76b-40e4-a32a-680d9f1719bc None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:44.864132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c8004-e76b-40e4-a32a-680d9f1719bc None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:44.868554 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636225bd-a304-4281-a2c1-5606f7d34b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:44.869185 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636225bd-a304-4281-a2c1-5606f7d34b07 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:44.869463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636225bd-a304-4281-a2c1-5606f7d34b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:44.869733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636225bd-a304-4281-a2c1-5606f7d34b07 admin admin] PATH_INFO: `/v3/services` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:44.871632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636225bd-a304-4281-a2c1-5606f7d34b07 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:19:44.871632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636225bd-a304-4281-a2c1-5606f7d34b07 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:44.872319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636225bd-a304-4281-a2c1-5606f7d34b07 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:44.877327 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 654/1303] 10.222.0.35 () {56 vars in 1137 bytes} [Sat Feb 12 04:19:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:19:44.882724 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da499ea-cfc2-4261-a01f-32870f72f423 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:19:44.892739 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da499ea-cfc2-4261-a01f-32870f72f423 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:19:44.897335 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f5f6d6-087b-4de5-af78-ea0dd9c12241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:19:44.897953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5f6d6-087b-4de5-af78-ea0dd9c12241 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:19:44.898234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5f6d6-087b-4de5-af78-ea0dd9c12241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:19:44.898503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f5f6d6-087b-4de5-af78-ea0dd9c12241 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:19:44.899252 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5f6d6-087b-4de5-af78-ea0dd9c12241 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:19:44.900819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f5f6d6-087b-4de5-af78-ea0dd9c12241 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:19:44.978636 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 650/1304] 10.222.0.35 () {60 vars in 1165 bytes} [Sat Feb 12 04:19:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:25:42.814139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d1095-09a1-410c-a374-f1f133e8e278 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:42.815190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d1095-09a1-410c-a374-f1f133e8e278 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:42.815734 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986d1095-09a1-410c-a374-f1f133e8e278 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:42.823068 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c15f0-f92a-4aec-a5b3-6a2160fb371e None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:42.828931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c15f0-f92a-4aec-a5b3-6a2160fb371e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:42.828931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c15f0-f92a-4aec-a5b3-6a2160fb371e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:42.829116 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 655/1305] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:25:42 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:25:42.952752 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-a13c15f0-f92a-4aec-a5b3-6a2160fb371e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:42.954380 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a13c15f0-f92a-4aec-a5b3-6a2160fb371e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:43.132004 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 651/1306] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:43.155773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d1095-09a1-410c-a374-f1f133e8e278 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:43.157492 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-986d1095-09a1-410c-a374-f1f133e8e278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:43.300546 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986d1095-09a1-410c-a374-f1f133e8e278 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:43.411409 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd6b9c-cfda-45b5-b2ab-7e87d590a43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:43.412331 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd6b9c-cfda-45b5-b2ab-7e87d590a43f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:43.412718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd6b9c-cfda-45b5-b2ab-7e87d590a43f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:43.413096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd6b9c-cfda-45b5-b2ab-7e87d590a43f admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:43.413946 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd6b9c-cfda-45b5-b2ab-7e87d590a43f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:43.416165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd6b9c-cfda-45b5-b2ab-7e87d590a43f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:43.437088 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 656/1307] 10.222.0.35 () {56 vars in 1108 bytes} [Sat Feb 12 04:25:43 2022] GET /identity/v3/projects => generated 2553 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:25:45.748444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb3def-4fb7-4dc4-a568-a9476e33748c None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:45.748967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb3def-4fb7-4dc4-a568-a9476e33748c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:45.749057 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb3def-4fb7-4dc4-a568-a9476e33748c None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:45.750796 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 652/1308] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:25:45.756076 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fd6de-2314-4c69-82d9-608590eae690 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:45.756464 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fd6de-2314-4c69-82d9-608590eae690 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:45.756773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fd6de-2314-4c69-82d9-608590eae690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:45.836545 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-592fd6de-2314-4c69-82d9-608590eae690 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:45.837678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-592fd6de-2314-4c69-82d9-608590eae690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:45.934956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 657/1309] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:25:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:25:45.988784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646b7de-f2f0-4f06-92b1-5916fd523980 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:45.989200 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646b7de-f2f0-4f06-92b1-5916fd523980 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:45.989547 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646b7de-f2f0-4f06-92b1-5916fd523980 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:45.991424 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 653/1310] 10.222.0.35 () {54 vars in 964 bytes} [Sat Feb 12 04:25:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:25:46.000644 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5b37b-94c8-4e95-aaec-62bce20020c2 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:46.001023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5b37b-94c8-4e95-aaec-62bce20020c2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:46.001435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5b37b-94c8-4e95-aaec-62bce20020c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:46.088323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-aea5b37b-94c8-4e95-aaec-62bce20020c2 None None] MFA Rules not processed for user `d9c5541a29cf42f6ab394133baa05fae`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:46.089733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-aea5b37b-94c8-4e95-aaec-62bce20020c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:46.171174 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 658/1311] 10.222.0.35 () {58 vars in 1061 bytes} [Sat Feb 12 04:25:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:46.180353 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646b7de-f2f0-4f06-92b1-5916fd523980 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:46.181950 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5646b7de-f2f0-4f06-92b1-5916fd523980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:46.284709 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646b7de-f2f0-4f06-92b1-5916fd523980 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:46.358701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7412e-9a9b-49a7-a4a8-639af000fb09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:46.359403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7412e-9a9b-49a7-a4a8-639af000fb09 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:46.359760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7412e-9a9b-49a7-a4a8-639af000fb09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:46.360108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7412e-9a9b-49a7-a4a8-639af000fb09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:46.361830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1ec7412e-9a9b-49a7-a4a8-639af000fb09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:46.471482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7412e-9a9b-49a7-a4a8-639af000fb09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:46.473572 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7412e-9a9b-49a7-a4a8-639af000fb09 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:46.492204 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 654/1312] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:25:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:25:49.009332 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a2067-adab-45f8-aab1-47b5ffe8b558 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:49.009870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a2067-adab-45f8-aab1-47b5ffe8b558 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:49.009870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a2067-adab-45f8-aab1-47b5ffe8b558 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:49.011653 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 659/1313] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:25:49.017055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e02c09-6a22-43b2-8982-4aa94ae640f7 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:49.017471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e02c09-6a22-43b2-8982-4aa94ae640f7 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:49.017596 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e02c09-6a22-43b2-8982-4aa94ae640f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:49.082074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-29e02c09-6a22-43b2-8982-4aa94ae640f7 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:49.083291 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-29e02c09-6a22-43b2-8982-4aa94ae640f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:49.183203 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 655/1314] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:49.221517 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a2067-adab-45f8-aab1-47b5ffe8b558 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:49.223079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7d9a2067-adab-45f8-aab1-47b5ffe8b558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:49.329419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a2067-adab-45f8-aab1-47b5ffe8b558 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:49.399074 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c3766-5f4f-4f31-912d-7bc4253b9da5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:49.399722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c3766-5f4f-4f31-912d-7bc4253b9da5 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:49.399997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c3766-5f4f-4f31-912d-7bc4253b9da5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:49.400263 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c3766-5f4f-4f31-912d-7bc4253b9da5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:49.401875 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-696c3766-5f4f-4f31-912d-7bc4253b9da5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:49.505429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c3766-5f4f-4f31-912d-7bc4253b9da5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:49.506844 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c3766-5f4f-4f31-912d-7bc4253b9da5 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:49.524009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 660/1315] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:25:52.233964 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f533bf9-f402-4c70-94a9-bbaf150e41e4 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:52.234506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f533bf9-f402-4c70-94a9-bbaf150e41e4 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:52.234506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f533bf9-f402-4c70-94a9-bbaf150e41e4 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:52.236334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 656/1316] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:25:52.241644 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96493584-c268-4034-9a4d-edd382225063 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:52.242039 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96493584-c268-4034-9a4d-edd382225063 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:52.242196 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96493584-c268-4034-9a4d-edd382225063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:52.305500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-96493584-c268-4034-9a4d-edd382225063 None None] MFA Rules not processed for user `07fc48f86c42414a9ed416bfe9660e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:52.306707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-96493584-c268-4034-9a4d-edd382225063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:52.404928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 661/1317] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:25:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:52.464103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b027e-1c3f-4516-bb91-b9c9d18f9196 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:52.464385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b027e-1c3f-4516-bb91-b9c9d18f9196 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:52.464661 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b027e-1c3f-4516-bb91-b9c9d18f9196 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:52.467285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 657/1318] 10.222.0.35 () {54 vars in 964 bytes} [Sat Feb 12 04:25:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:25:52.473517 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3f67c-b36d-4c97-a81c-f89051c16b16 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:52.473803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3f67c-b36d-4c97-a81c-f89051c16b16 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:52.474076 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e3f67c-b36d-4c97-a81c-f89051c16b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:52.547454 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-a3e3f67c-b36d-4c97-a81c-f89051c16b16 None None] MFA Rules not processed for user `d9c5541a29cf42f6ab394133baa05fae`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:52.548640 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a3e3f67c-b36d-4c97-a81c-f89051c16b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:52.619929 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 662/1319] 10.222.0.35 () {58 vars in 1061 bytes} [Sat Feb 12 04:25:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:25:52.631269 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b027e-1c3f-4516-bb91-b9c9d18f9196 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:52.633668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-be6b027e-1c3f-4516-bb91-b9c9d18f9196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:52.742371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b027e-1c3f-4516-bb91-b9c9d18f9196 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:52.819768 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036efa2-7207-4fce-9d7b-a4741fa52ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:52.819768 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036efa2-7207-4fce-9d7b-a4741fa52ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:52.819768 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036efa2-7207-4fce-9d7b-a4741fa52ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:52.819768 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036efa2-7207-4fce-9d7b-a4741fa52ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:52.820208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e036efa2-7207-4fce-9d7b-a4741fa52ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:52.917579 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036efa2-7207-4fce-9d7b-a4741fa52ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:52.919255 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036efa2-7207-4fce-9d7b-a4741fa52ab3 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:52.937371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 658/1320] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:25:52 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:25:56.336432 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93e880-fbe3-46dc-a7f5-74b33bc6b1d6 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:56.336950 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93e880-fbe3-46dc-a7f5-74b33bc6b1d6 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:56.337051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93e880-fbe3-46dc-a7f5-74b33bc6b1d6 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:56.338730 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 663/1321] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:25:56.344700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad039-e272-4619-9029-ae1681536a1e None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:56.345111 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad039-e272-4619-9029-ae1681536a1e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:56.345256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ad039-e272-4619-9029-ae1681536a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:56.407806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-b43ad039-e272-4619-9029-ae1681536a1e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:25:56.408990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b43ad039-e272-4619-9029-ae1681536a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:56.501732 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 659/1322] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:25:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:25:56.540952 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93e880-fbe3-46dc-a7f5-74b33bc6b1d6 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:25:56.542452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0a93e880-fbe3-46dc-a7f5-74b33bc6b1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:56.641190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93e880-fbe3-46dc-a7f5-74b33bc6b1d6 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:25:56.710117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4828132-526e-4fd4-89b1-aac3878cdce8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:25:56.710763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4828132-526e-4fd4-89b1-aac3878cdce8 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:25:56.711041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4828132-526e-4fd4-89b1-aac3878cdce8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:25:56.711347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4828132-526e-4fd4-89b1-aac3878cdce8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:25:56.712972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f4828132-526e-4fd4-89b1-aac3878cdce8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:25:56.831199 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4828132-526e-4fd4-89b1-aac3878cdce8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:25:56.831199 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4828132-526e-4fd4-89b1-aac3878cdce8 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:25:56.835693 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 664/1323] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:25:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:00.174830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfda8e5-6ab2-4772-bf39-764dd5b0f610 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:00.175457 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfda8e5-6ab2-4772-bf39-764dd5b0f610 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:00.175578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfda8e5-6ab2-4772-bf39-764dd5b0f610 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:00.177263 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 660/1324] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:00.182597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb20a18-0c7e-45f0-b549-b91afc3b8434 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:00.182980 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb20a18-0c7e-45f0-b549-b91afc3b8434 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:00.183153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb20a18-0c7e-45f0-b549-b91afc3b8434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:00.245420 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-ecb20a18-0c7e-45f0-b549-b91afc3b8434 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:00.246604 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ecb20a18-0c7e-45f0-b549-b91afc3b8434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:00.339030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 665/1325] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:00.375184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfda8e5-6ab2-4772-bf39-764dd5b0f610 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:00.376761 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9dfda8e5-6ab2-4772-bf39-764dd5b0f610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:00.478660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfda8e5-6ab2-4772-bf39-764dd5b0f610 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:00.551580 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b21d74-d46a-450e-a17b-ce25eb77a62d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:00.552214 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21d74-d46a-450e-a17b-ce25eb77a62d service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:00.552501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21d74-d46a-450e-a17b-ce25eb77a62d service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:00.552754 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b21d74-d46a-450e-a17b-ce25eb77a62d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:00.554371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a9b21d74-d46a-450e-a17b-ce25eb77a62d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:00.659911 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b21d74-d46a-450e-a17b-ce25eb77a62d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:00.661386 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b21d74-d46a-450e-a17b-ce25eb77a62d service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:00.679432 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 661/1326] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:02.956427 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d77422-85df-419e-8ae6-7753c17d2b4f None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:02.956952 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d77422-85df-419e-8ae6-7753c17d2b4f None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:02.957041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d77422-85df-419e-8ae6-7753c17d2b4f None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:02.958870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 666/1327] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:02.964273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c0cf1-141e-48d8-bf92-8c5fb1643e7c None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:02.964683 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c0cf1-141e-48d8-bf92-8c5fb1643e7c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:02.964824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c0cf1-141e-48d8-bf92-8c5fb1643e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:03.029782 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-a62c0cf1-141e-48d8-bf92-8c5fb1643e7c None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:03.030968 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a62c0cf1-141e-48d8-bf92-8c5fb1643e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:03.125324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 662/1328] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:03.161144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d77422-85df-419e-8ae6-7753c17d2b4f None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:03.162655 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a2d77422-85df-419e-8ae6-7753c17d2b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:03.263493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d77422-85df-419e-8ae6-7753c17d2b4f None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:03.333846 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70481edb-faae-4aa5-a991-d6c9d8143d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:03.334485 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70481edb-faae-4aa5-a991-d6c9d8143d58 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:03.334767 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70481edb-faae-4aa5-a991-d6c9d8143d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:03.335040 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70481edb-faae-4aa5-a991-d6c9d8143d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:03.336701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-70481edb-faae-4aa5-a991-d6c9d8143d58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:03.441809 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70481edb-faae-4aa5-a991-d6c9d8143d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:03.443256 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70481edb-faae-4aa5-a991-d6c9d8143d58 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:03.460974 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 667/1329] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:05.751701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93772ebd-92c6-4e76-8480-09fb537ed88a None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:05.752252 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93772ebd-92c6-4e76-8480-09fb537ed88a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:05.752252 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93772ebd-92c6-4e76-8480-09fb537ed88a None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:05.754130 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 663/1330] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:05.759579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8ecd7-f3fb-430b-a3cf-ca4b7018431d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:05.759999 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8ecd7-f3fb-430b-a3cf-ca4b7018431d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:05.760260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a8ecd7-f3fb-430b-a3cf-ca4b7018431d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:05.824568 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-f6a8ecd7-f3fb-430b-a3cf-ca4b7018431d None None] MFA Rules not processed for user `07fc48f86c42414a9ed416bfe9660e3f`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:05.826694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f6a8ecd7-f3fb-430b-a3cf-ca4b7018431d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:05.919580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 668/1331] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:05 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:05.956491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93772ebd-92c6-4e76-8480-09fb537ed88a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:05.958161 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-93772ebd-92c6-4e76-8480-09fb537ed88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:06.058294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93772ebd-92c6-4e76-8480-09fb537ed88a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:06.135090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b400400-f958-4215-a31b-714440163bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:06.135777 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b400400-f958-4215-a31b-714440163bad service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:06.136055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b400400-f958-4215-a31b-714440163bad service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:06.136328 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b400400-f958-4215-a31b-714440163bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:06.138153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2b400400-f958-4215-a31b-714440163bad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:06.253880 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b400400-f958-4215-a31b-714440163bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:06.255340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b400400-f958-4215-a31b-714440163bad service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:06.272751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 664/1332] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:05 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:08.952238 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fea77-4c29-4426-a781-4c63fe5aa2e1 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:08.953044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fea77-4c29-4426-a781-4c63fe5aa2e1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:08.953044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fea77-4c29-4426-a781-4c63fe5aa2e1 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:08.957308 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 669/1333] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:09.020830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829357b0-5bb1-4e80-8dc6-1dbf7183c65a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:09.020830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829357b0-5bb1-4e80-8dc6-1dbf7183c65a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:09.020830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829357b0-5bb1-4e80-8dc6-1dbf7183c65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:09.038026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-829357b0-5bb1-4e80-8dc6-1dbf7183c65a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:09.039529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-829357b0-5bb1-4e80-8dc6-1dbf7183c65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:09.139920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 665/1334] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:09.177255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fea77-4c29-4426-a781-4c63fe5aa2e1 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:09.178765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-245fea77-4c29-4426-a781-4c63fe5aa2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:09.281292 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fea77-4c29-4426-a781-4c63fe5aa2e1 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:09.353389 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906efb38-29cc-4140-b20c-9525c799af59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:09.354030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906efb38-29cc-4140-b20c-9525c799af59 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:09.354311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906efb38-29cc-4140-b20c-9525c799af59 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:09.354598 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906efb38-29cc-4140-b20c-9525c799af59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:09.356293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-906efb38-29cc-4140-b20c-9525c799af59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:09.462597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906efb38-29cc-4140-b20c-9525c799af59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:09.463951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906efb38-29cc-4140-b20c-9525c799af59 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:09.481528 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 670/1335] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:11.746072 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cccfc6-3998-4acd-830d-7b7c14c32400 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:11.747133 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cccfc6-3998-4acd-830d-7b7c14c32400 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:11.747133 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cccfc6-3998-4acd-830d-7b7c14c32400 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:11.748956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 666/1336] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:11.754241 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273935b-7c5d-4312-be86-2867ef74b5e6 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:11.754651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273935b-7c5d-4312-be86-2867ef74b5e6 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:11.754784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273935b-7c5d-4312-be86-2867ef74b5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:11.817566 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-f273935b-7c5d-4312-be86-2867ef74b5e6 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:11.818737 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f273935b-7c5d-4312-be86-2867ef74b5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:11.910427 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 671/1337] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:11.950977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cccfc6-3998-4acd-830d-7b7c14c32400 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:11.952569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-59cccfc6-3998-4acd-830d-7b7c14c32400 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:12.051591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cccfc6-3998-4acd-830d-7b7c14c32400 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:12.120357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de72647-b5ed-4edc-9011-79ea4983bca9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:12.120987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de72647-b5ed-4edc-9011-79ea4983bca9 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:12.121918 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de72647-b5ed-4edc-9011-79ea4983bca9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:12.122208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de72647-b5ed-4edc-9011-79ea4983bca9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:12.123886 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-8de72647-b5ed-4edc-9011-79ea4983bca9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:12.229045 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de72647-b5ed-4edc-9011-79ea4983bca9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:12.230477 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de72647-b5ed-4edc-9011-79ea4983bca9 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:12.249384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 667/1338] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:15.242477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9b7f9-56a4-442a-8228-1117d9f16d25 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:15.243013 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9b7f9-56a4-442a-8228-1117d9f16d25 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:15.243013 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de9b7f9-56a4-442a-8228-1117d9f16d25 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:15.244819 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 672/1339] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:15.251146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334d77f-8de7-43e8-a685-7dbbbb9ac29d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:15.251620 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334d77f-8de7-43e8-a685-7dbbbb9ac29d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:15.251745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334d77f-8de7-43e8-a685-7dbbbb9ac29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:15.326181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-9334d77f-8de7-43e8-a685-7dbbbb9ac29d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:15.327430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9334d77f-8de7-43e8-a685-7dbbbb9ac29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:15.438705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 668/1340] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:15.476421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9b7f9-56a4-442a-8228-1117d9f16d25 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:15.479096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4de9b7f9-56a4-442a-8228-1117d9f16d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:15.581868 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de9b7f9-56a4-442a-8228-1117d9f16d25 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:15.585509 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821c8086-5ad2-42f4-84c0-b9088cdb7ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:15.586148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c8086-5ad2-42f4-84c0-b9088cdb7ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:15.586431 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c8086-5ad2-42f4-84c0-b9088cdb7ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:15.586703 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821c8086-5ad2-42f4-84c0-b9088cdb7ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:15.596129 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c8086-5ad2-42f4-84c0-b9088cdb7ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:15.597548 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821c8086-5ad2-42f4-84c0-b9088cdb7ad4 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:15.607061 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 673/1341] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:20.022436 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594402-81bc-4e8a-80cd-ea6635f91490 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:20.022960 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594402-81bc-4e8a-80cd-ea6635f91490 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:20.022960 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60594402-81bc-4e8a-80cd-ea6635f91490 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:20.024791 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 669/1342] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:20.030267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7a150-acd0-40ef-ae62-7c5719d44071 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:20.030671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7a150-acd0-40ef-ae62-7c5719d44071 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:20.030947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df7a150-acd0-40ef-ae62-7c5719d44071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:20.059648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-0df7a150-acd0-40ef-ae62-7c5719d44071 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:20.060748 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0df7a150-acd0-40ef-ae62-7c5719d44071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:20.133862 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 674/1343] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:20.174714 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60594402-81bc-4e8a-80cd-ea6635f91490 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:20.186340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60594402-81bc-4e8a-80cd-ea6635f91490 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:20.189853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010df3bd-a57e-48d9-bd7c-df36eb0f54c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:20.190482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010df3bd-a57e-48d9-bd7c-df36eb0f54c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:20.190763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010df3bd-a57e-48d9-bd7c-df36eb0f54c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:20.191037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010df3bd-a57e-48d9-bd7c-df36eb0f54c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:20.200062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010df3bd-a57e-48d9-bd7c-df36eb0f54c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:20.201482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010df3bd-a57e-48d9-bd7c-df36eb0f54c0 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:20.210689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 670/1344] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:23.345161 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab293-9cf8-4feb-8a38-516f09649e25 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:23.345664 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab293-9cf8-4feb-8a38-516f09649e25 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:23.345752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ab293-9cf8-4feb-8a38-516f09649e25 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:23.347515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 675/1345] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:23.352704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67cc6e-aab0-4efb-b43a-58c218fed2f9 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:23.353126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67cc6e-aab0-4efb-b43a-58c218fed2f9 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:23.353407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67cc6e-aab0-4efb-b43a-58c218fed2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:23.370827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-df67cc6e-aab0-4efb-b43a-58c218fed2f9 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:23.372417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-df67cc6e-aab0-4efb-b43a-58c218fed2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:23.380145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 671/1346] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:23.420618 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ab293-9cf8-4feb-8a38-516f09649e25 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:23.422344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-397ab293-9cf8-4feb-8a38-516f09649e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:23.435389 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ab293-9cf8-4feb-8a38-516f09649e25 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:23.438897 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbae8b-11b2-4b11-aa90-682c0678b5b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:23.439576 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbae8b-11b2-4b11-aa90-682c0678b5b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:23.441694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbae8b-11b2-4b11-aa90-682c0678b5b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:23.441980 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbae8b-11b2-4b11-aa90-682c0678b5b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:23.457119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbae8b-11b2-4b11-aa90-682c0678b5b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:23.458535 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbae8b-11b2-4b11-aa90-682c0678b5b0 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:23.469448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 676/1347] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:26:28.290368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285ed5a-7697-4020-a7d7-0fac6bd54086 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:28.290827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285ed5a-7697-4020-a7d7-0fac6bd54086 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:28.290919 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285ed5a-7697-4020-a7d7-0fac6bd54086 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:28.293418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 672/1348] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:28.298982 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e856d5-2548-4518-a2e5-4fc2272879ab None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:28.299475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e856d5-2548-4518-a2e5-4fc2272879ab None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:28.299601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e856d5-2548-4518-a2e5-4fc2272879ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:28.318019 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-e5e856d5-2548-4518-a2e5-4fc2272879ab None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:28.319219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e5e856d5-2548-4518-a2e5-4fc2272879ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:28.327062 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 677/1349] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:28.365683 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285ed5a-7697-4020-a7d7-0fac6bd54086 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:28.376271 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285ed5a-7697-4020-a7d7-0fac6bd54086 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:28.379718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8e48b0-5ee0-4649-92bd-514105cf8767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:28.380344 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e48b0-5ee0-4649-92bd-514105cf8767 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:28.380617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e48b0-5ee0-4649-92bd-514105cf8767 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:28.380885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e48b0-5ee0-4649-92bd-514105cf8767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:28.389756 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e48b0-5ee0-4649-92bd-514105cf8767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:28.391173 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8e48b0-5ee0-4649-92bd-514105cf8767 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:28.400383 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 673/1350] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:33.666643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2a11-bb15-4671-abb3-35013e77d2af None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:33.666643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2a11-bb15-4671-abb3-35013e77d2af None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:33.666643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2a11-bb15-4671-abb3-35013e77d2af None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:33.666643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 678/1351] 10.222.0.35 () {54 vars in 921 bytes} [Sat Feb 12 04:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:33.668587 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d5f7a-4542-43a8-a2fc-b32606a26f50 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:33.668961 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d5f7a-4542-43a8-a2fc-b32606a26f50 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:33.669142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d5f7a-4542-43a8-a2fc-b32606a26f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:33.757215 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-104d5f7a-4542-43a8-a2fc-b32606a26f50 None None] MFA Rules not processed for user `d48fd9b23a4946cc81a9ad7845d26623`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:33.758464 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-104d5f7a-4542-43a8-a2fc-b32606a26f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:33.892034 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 674/1352] 10.222.0.35 () {58 vars in 1018 bytes} [Sat Feb 12 04:26:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:38.182615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81982048-5302-4c11-8bf0-ffe853074982 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:38.183803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81982048-5302-4c11-8bf0-ffe853074982 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:38.183803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81982048-5302-4c11-8bf0-ffe853074982 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:38.185661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 679/1353] 10.222.0.35 () {54 vars in 921 bytes} [Sat Feb 12 04:26:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:38.190698 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc380b-eb78-404c-926f-b37b4439cb90 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:38.191614 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc380b-eb78-404c-926f-b37b4439cb90 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:38.192128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc380b-eb78-404c-926f-b37b4439cb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:38.212884 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-7ccc380b-eb78-404c-926f-b37b4439cb90 None None] MFA Rules not processed for user `d48fd9b23a4946cc81a9ad7845d26623`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:38.214390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-7ccc380b-eb78-404c-926f-b37b4439cb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:38.225417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 675/1354] 10.222.0.35 () {58 vars in 1018 bytes} [Sat Feb 12 04:26:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:39.671080 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc1934-2cf0-4cb9-ad3e-2e2be8478595 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:39.671811 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc1934-2cf0-4cb9-ad3e-2e2be8478595 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:39.671811 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc1934-2cf0-4cb9-ad3e-2e2be8478595 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:39.673645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 680/1355] 10.222.0.35 () {54 vars in 921 bytes} [Sat Feb 12 04:26:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:39.679967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c52319-800d-4c98-bb9c-58cca3c4efd7 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:39.681144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c52319-800d-4c98-bb9c-58cca3c4efd7 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:39.681501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c52319-800d-4c98-bb9c-58cca3c4efd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:39.703360 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-78c52319-800d-4c98-bb9c-58cca3c4efd7 None None] MFA Rules not processed for user `d48fd9b23a4946cc81a9ad7845d26623`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:39.704917 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-78c52319-800d-4c98-bb9c-58cca3c4efd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:39.714703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 676/1356] 10.222.0.35 () {58 vars in 1018 bytes} [Sat Feb 12 04:26:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:43.580383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c9506-c334-45c6-acd3-ca9d60e76378 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:43.580889 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c9506-c334-45c6-acd3-ca9d60e76378 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:43.580889 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4c9506-c334-45c6-acd3-ca9d60e76378 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:43.583621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 681/1357] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:43.587821 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1426e-e1e4-42c1-aa72-d9ec562b5123 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:43.588260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1426e-e1e4-42c1-aa72-d9ec562b5123 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:43.588558 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1426e-e1e4-42c1-aa72-d9ec562b5123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:43.607441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-d7e1426e-e1e4-42c1-aa72-d9ec562b5123 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:43.608824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d7e1426e-e1e4-42c1-aa72-d9ec562b5123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:43.617369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 677/1358] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:43.666075 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e81db-51fc-455f-b5d3-1ed92610e2ab None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:43.666358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e81db-51fc-455f-b5d3-1ed92610e2ab None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:43.666631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e81db-51fc-455f-b5d3-1ed92610e2ab None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:43.668905 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 682/1359] 10.222.0.35 () {54 vars in 961 bytes} [Sat Feb 12 04:26:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:43.674639 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7180f7-d523-4497-9808-d8559a5944df None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:43.675022 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7180f7-d523-4497-9808-d8559a5944df None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:43.675483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7180f7-d523-4497-9808-d8559a5944df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:43.723574 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-0e7180f7-d523-4497-9808-d8559a5944df None None] MFA Rules not processed for user `362ab4aeb88746d8b8a14a238c877a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:43.724818 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-0e7180f7-d523-4497-9808-d8559a5944df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:43.805795 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 678/1360] 10.222.0.35 () {58 vars in 1058 bytes} [Sat Feb 12 04:26:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:43.814241 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e81db-51fc-455f-b5d3-1ed92610e2ab None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:43.830512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e81db-51fc-455f-b5d3-1ed92610e2ab None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:43.836109 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3ecb19-9f0d-4ec6-9673-451ccd7c5f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:43.836875 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ecb19-9f0d-4ec6-9673-451ccd7c5f31 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:43.837394 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ecb19-9f0d-4ec6-9673-451ccd7c5f31 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:43.837744 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3ecb19-9f0d-4ec6-9673-451ccd7c5f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:43.846601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ecb19-9f0d-4ec6-9673-451ccd7c5f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:43.848277 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3ecb19-9f0d-4ec6-9673-451ccd7c5f31 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:43.859942 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 683/1361] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:26:46.323145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbd8c7-d6b1-400a-849e-9d932f00b6d4 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:46.323728 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbd8c7-d6b1-400a-849e-9d932f00b6d4 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:46.323817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbd8c7-d6b1-400a-849e-9d932f00b6d4 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:46.325824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 679/1362] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:46.330893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf6a06-2c30-4eac-9155-48fdff534250 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:46.331417 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf6a06-2c30-4eac-9155-48fdff534250 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:46.331506 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf6a06-2c30-4eac-9155-48fdff534250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:46.349511 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-05bf6a06-2c30-4eac-9155-48fdff534250 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:46.350716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-05bf6a06-2c30-4eac-9155-48fdff534250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:46.360026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 684/1363] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:46.404461 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbd8c7-d6b1-400a-849e-9d932f00b6d4 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:46.422234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbd8c7-d6b1-400a-849e-9d932f00b6d4 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:46.428155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff69ada9-b180-4b9c-b9ad-eb6494c779ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:46.428982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69ada9-b180-4b9c-b9ad-eb6494c779ff service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:46.429421 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69ada9-b180-4b9c-b9ad-eb6494c779ff service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:46.429837 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff69ada9-b180-4b9c-b9ad-eb6494c779ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:46.439336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69ada9-b180-4b9c-b9ad-eb6494c779ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:46.440938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff69ada9-b180-4b9c-b9ad-eb6494c779ff service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:46.454630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 680/1364] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:49.103667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b3530-24e6-49c0-a1c1-32eb89c0ff1f None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:49.104224 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b3530-24e6-49c0-a1c1-32eb89c0ff1f None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:49.104224 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b3530-24e6-49c0-a1c1-32eb89c0ff1f None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:49.106358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 685/1365] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:49.111820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdac853-e1fd-4c1e-a585-3a4fa8220bb9 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:49.112244 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdac853-e1fd-4c1e-a585-3a4fa8220bb9 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:49.112352 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdac853-e1fd-4c1e-a585-3a4fa8220bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:49.130394 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-4bdac853-e1fd-4c1e-a585-3a4fa8220bb9 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:49.131598 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-4bdac853-e1fd-4c1e-a585-3a4fa8220bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:49.140541 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 681/1366] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:49.185797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607a005-e15f-44e0-8123-424bf099c273 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:49.186080 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607a005-e15f-44e0-8123-424bf099c273 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:49.186353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607a005-e15f-44e0-8123-424bf099c273 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:49.188110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 686/1367] 10.222.0.35 () {54 vars in 961 bytes} [Sat Feb 12 04:26:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:49.193203 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecebda-d361-4eb4-a4e7-d42c80828734 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:49.193481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecebda-d361-4eb4-a4e7-d42c80828734 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:49.193750 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ecebda-d361-4eb4-a4e7-d42c80828734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:49.212718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-12ecebda-d361-4eb4-a4e7-d42c80828734 None None] MFA Rules not processed for user `362ab4aeb88746d8b8a14a238c877a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:49.213931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-12ecebda-d361-4eb4-a4e7-d42c80828734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:49.222852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 682/1368] 10.222.0.35 () {58 vars in 1058 bytes} [Sat Feb 12 04:26:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:49.232797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607a005-e15f-44e0-8123-424bf099c273 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:49.247255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607a005-e15f-44e0-8123-424bf099c273 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:49.258047 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc23efe-c7d8-4da8-bf11-75c7601b2aa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:49.258672 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc23efe-c7d8-4da8-bf11-75c7601b2aa6 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:49.258947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc23efe-c7d8-4da8-bf11-75c7601b2aa6 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:49.259215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc23efe-c7d8-4da8-bf11-75c7601b2aa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:49.268088 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc23efe-c7d8-4da8-bf11-75c7601b2aa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:49.269666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc23efe-c7d8-4da8-bf11-75c7601b2aa6 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:49.279277 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 687/1369] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:51.727785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295fe7c-626f-4749-914a-35f47a9130dc None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:51.728337 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295fe7c-626f-4749-914a-35f47a9130dc None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:51.728337 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295fe7c-626f-4749-914a-35f47a9130dc None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:51.731018 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 683/1370] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:51.736977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a88f1-cae1-4e54-9983-bd144a2f2981 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:51.737510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a88f1-cae1-4e54-9983-bd144a2f2981 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:51.737510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a88f1-cae1-4e54-9983-bd144a2f2981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:51.756952 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-d36a88f1-cae1-4e54-9983-bd144a2f2981 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:51.758182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d36a88f1-cae1-4e54-9983-bd144a2f2981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:51.762785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ece771-fb2e-4ca4-8632-bf9ae565c196 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:51.763069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ece771-fb2e-4ca4-8632-bf9ae565c196 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:51.763549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ece771-fb2e-4ca4-8632-bf9ae565c196 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:51.765346 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 684/1371] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:51.769640 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 688/1372] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:51.772915 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef23cb-c247-42de-9464-40eed32681c4 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:51.773202 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef23cb-c247-42de-9464-40eed32681c4 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:51.773475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef23cb-c247-42de-9464-40eed32681c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:51.792402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-41ef23cb-c247-42de-9464-40eed32681c4 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:51.793592 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-41ef23cb-c247-42de-9464-40eed32681c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:51.801746 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 689/1373] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:51.845546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ece771-fb2e-4ca4-8632-bf9ae565c196 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:51.860768 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ece771-fb2e-4ca4-8632-bf9ae565c196 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:51.866305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e0c0e-64d8-4b39-a1b4-6ae228a60499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:51.867041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e0c0e-64d8-4b39-a1b4-6ae228a60499 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:51.867445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e0c0e-64d8-4b39-a1b4-6ae228a60499 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:51.867836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e0c0e-64d8-4b39-a1b4-6ae228a60499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:51.877255 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e0c0e-64d8-4b39-a1b4-6ae228a60499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:51.878941 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e0c0e-64d8-4b39-a1b4-6ae228a60499 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:51.888670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 685/1374] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:52.038594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36247ad9-ede6-4817-8d7d-3f3edd518ac0 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:52.038931 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36247ad9-ede6-4817-8d7d-3f3edd518ac0 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:52.039254 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36247ad9-ede6-4817-8d7d-3f3edd518ac0 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:52.041531 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 690/1375] 10.222.0.35 () {54 vars in 963 bytes} [Sat Feb 12 04:26:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:52.047713 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f9d4f-f936-4734-a918-5f128740a3f2 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:52.048002 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f9d4f-f936-4734-a918-5f128740a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:52.048276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f9d4f-f936-4734-a918-5f128740a3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:52.103043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-5f1f9d4f-f936-4734-a918-5f128740a3f2 None None] MFA Rules not processed for user `df25b09762ab4130a1c656cd499d5fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:52.104927 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5f1f9d4f-f936-4734-a918-5f128740a3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:52.171888 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 686/1376] 10.222.0.35 () {58 vars in 1060 bytes} [Sat Feb 12 04:26:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:52.179731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36247ad9-ede6-4817-8d7d-3f3edd518ac0 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:52.191678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36247ad9-ede6-4817-8d7d-3f3edd518ac0 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:52.196806 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d580458-f2c5-4d76-92bc-3ef85fef67fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:52.198057 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580458-f2c5-4d76-92bc-3ef85fef67fc service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:52.198765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580458-f2c5-4d76-92bc-3ef85fef67fc service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:52.199304 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d580458-f2c5-4d76-92bc-3ef85fef67fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:52.211523 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d580458-f2c5-4d76-92bc-3ef85fef67fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:52.213997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d580458-f2c5-4d76-92bc-3ef85fef67fc service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:52.227153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 691/1377] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:54.379258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a6603-10e4-4b25-a26f-07ded9df9790 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:54.379679 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a6603-10e4-4b25-a26f-07ded9df9790 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:54.379822 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a6603-10e4-4b25-a26f-07ded9df9790 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:54.381620 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 687/1378] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:54.387297 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c973d-8249-43aa-9a86-4d28c0719f9f None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:54.387732 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c973d-8249-43aa-9a86-4d28c0719f9f None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:54.387880 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c973d-8249-43aa-9a86-4d28c0719f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:54.406919 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-424c973d-8249-43aa-9a86-4d28c0719f9f None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:54.408165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-424c973d-8249-43aa-9a86-4d28c0719f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:54.416600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 692/1379] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:26:54.460891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a6603-10e4-4b25-a26f-07ded9df9790 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:54.476245 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a6603-10e4-4b25-a26f-07ded9df9790 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:54.482310 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd69be-7a54-497a-999d-74e4ccafcbaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:54.482933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd69be-7a54-497a-999d-74e4ccafcbaf service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:54.483211 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd69be-7a54-497a-999d-74e4ccafcbaf service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:54.483515 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd69be-7a54-497a-999d-74e4ccafcbaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:54.491501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd69be-7a54-497a-999d-74e4ccafcbaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:54.493085 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd69be-7a54-497a-999d-74e4ccafcbaf service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:54.502370 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 688/1380] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:56.888275 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec359714-ad06-4f61-af1b-18883ad8c60c None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:56.888797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec359714-ad06-4f61-af1b-18883ad8c60c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:56.888999 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec359714-ad06-4f61-af1b-18883ad8c60c None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:56.891004 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 693/1381] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:56.896154 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2f11d-302e-4ae4-8e6e-bf81d7486792 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:56.896552 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2f11d-302e-4ae4-8e6e-bf81d7486792 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:56.896705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d2f11d-302e-4ae4-8e6e-bf81d7486792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:56.914999 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-89d2f11d-302e-4ae4-8e6e-bf81d7486792 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:56.916393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-89d2f11d-302e-4ae4-8e6e-bf81d7486792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:56.925504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 689/1382] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:56.971173 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec359714-ad06-4f61-af1b-18883ad8c60c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:56.985783 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec359714-ad06-4f61-af1b-18883ad8c60c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:56.991319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ae0ef-f659-4af3-baaf-99d255f81ef7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:56.992126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ae0ef-f659-4af3-baaf-99d255f81ef7 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:56.992551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ae0ef-f659-4af3-baaf-99d255f81ef7 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:56.992965 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ae0ef-f659-4af3-baaf-99d255f81ef7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:57.001475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ae0ef-f659-4af3-baaf-99d255f81ef7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:57.003210 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ae0ef-f659-4af3-baaf-99d255f81ef7 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:57.019363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 694/1383] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:26:59.425604 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6b726-001b-45c5-a72a-2150d5004d04 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:59.426138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6b726-001b-45c5-a72a-2150d5004d04 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:59.426138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c6b726-001b-45c5-a72a-2150d5004d04 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:59.428021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 690/1384] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:26:59.433367 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f6f3-565a-49a9-94c2-78c041e617c2 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:59.433780 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f6f3-565a-49a9-94c2-78c041e617c2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:59.433891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393f6f3-565a-49a9-94c2-78c041e617c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:59.456228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-4393f6f3-565a-49a9-94c2-78c041e617c2 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:26:59.457661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4393f6f3-565a-49a9-94c2-78c041e617c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:26:59.466788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 695/1385] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:26:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:26:59.508811 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6b726-001b-45c5-a72a-2150d5004d04 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:26:59.525268 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c6b726-001b-45c5-a72a-2150d5004d04 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:26:59.531149 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f18079-3472-4713-b01f-1bc1e286fcfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:26:59.531855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f18079-3472-4713-b01f-1bc1e286fcfb service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:26:59.532217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f18079-3472-4713-b01f-1bc1e286fcfb service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:26:59.532547 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f18079-3472-4713-b01f-1bc1e286fcfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:26:59.541226 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f18079-3472-4713-b01f-1bc1e286fcfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:26:59.544032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f18079-3472-4713-b01f-1bc1e286fcfb service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:26:59.553913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 691/1386] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:26:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:01.769523 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844727e-be1f-4214-bd7a-6e2435c70102 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:01.770059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844727e-be1f-4214-bd7a-6e2435c70102 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:01.770059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a844727e-be1f-4214-bd7a-6e2435c70102 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:01.771842 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 696/1387] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:01.777840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54032c-c507-492a-a802-5eb03dd56735 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:01.778284 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54032c-c507-492a-a802-5eb03dd56735 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:01.778388 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54032c-c507-492a-a802-5eb03dd56735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:01.796036 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-ad54032c-c507-492a-a802-5eb03dd56735 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:01.797216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ad54032c-c507-492a-a802-5eb03dd56735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:01.805117 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 692/1388] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:01.851266 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844727e-be1f-4214-bd7a-6e2435c70102 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:01.865519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a844727e-be1f-4214-bd7a-6e2435c70102 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:01.871553 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9bd70-8e7c-48b6-bb58-ec3faab4831d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:01.872184 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9bd70-8e7c-48b6-bb58-ec3faab4831d service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:01.872469 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9bd70-8e7c-48b6-bb58-ec3faab4831d service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:01.872744 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9bd70-8e7c-48b6-bb58-ec3faab4831d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:01.880947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9bd70-8e7c-48b6-bb58-ec3faab4831d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:01.882505 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9bd70-8e7c-48b6-bb58-ec3faab4831d service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:01.892392 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 697/1389] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:04.372255 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e8259-7401-4cb0-a2f8-3fa7aa0a0c70 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:04.372787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e8259-7401-4cb0-a2f8-3fa7aa0a0c70 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:04.372787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e8259-7401-4cb0-a2f8-3fa7aa0a0c70 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:04.374590 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 693/1390] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:27:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:04.380025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938ae44-b511-4cda-9a24-3960dd58a15d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:04.380451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938ae44-b511-4cda-9a24-3960dd58a15d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:04.380572 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938ae44-b511-4cda-9a24-3960dd58a15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:04.398701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-1938ae44-b511-4cda-9a24-3960dd58a15d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:04.399924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-1938ae44-b511-4cda-9a24-3960dd58a15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:04.408948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 698/1391] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:04.456277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e8259-7401-4cb0-a2f8-3fa7aa0a0c70 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:04.470990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e8259-7401-4cb0-a2f8-3fa7aa0a0c70 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:04.476389 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d438073-b37d-4097-96d0-88717d033db9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:04.477015 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d438073-b37d-4097-96d0-88717d033db9 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:04.477295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d438073-b37d-4097-96d0-88717d033db9 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:04.477562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d438073-b37d-4097-96d0-88717d033db9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:04.486162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d438073-b37d-4097-96d0-88717d033db9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:04.487797 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d438073-b37d-4097-96d0-88717d033db9 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:04.497028 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 694/1392] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:06.917347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0800d-462c-47ae-9774-850e6fe4180b None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:06.917898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0800d-462c-47ae-9774-850e6fe4180b None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:06.917898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0800d-462c-47ae-9774-850e6fe4180b None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:06.919737 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 699/1393] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:27:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:06.925167 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6419b1-604a-43e1-9ea3-b5d65ad90628 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:06.925587 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6419b1-604a-43e1-9ea3-b5d65ad90628 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:06.925836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6419b1-604a-43e1-9ea3-b5d65ad90628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:06.943838 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-af6419b1-604a-43e1-9ea3-b5d65ad90628 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:06.945004 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-af6419b1-604a-43e1-9ea3-b5d65ad90628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:06.952817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 695/1394] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:06.997295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0800d-462c-47ae-9774-850e6fe4180b None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:07.012347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0800d-462c-47ae-9774-850e6fe4180b None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:07.017946 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e87020-3cb1-43eb-9e54-e97f436a0a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:07.018579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e87020-3cb1-43eb-9e54-e97f436a0a40 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:07.018864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e87020-3cb1-43eb-9e54-e97f436a0a40 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:07.019141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e87020-3cb1-43eb-9e54-e97f436a0a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:07.027718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e87020-3cb1-43eb-9e54-e97f436a0a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:07.029319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e87020-3cb1-43eb-9e54-e97f436a0a40 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:07.038890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 700/1395] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:07.558129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67250b0d-9b4a-4002-858c-bf103005c1e6 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:07.558327 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67250b0d-9b4a-4002-858c-bf103005c1e6 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:07.558589 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67250b0d-9b4a-4002-858c-bf103005c1e6 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:07.560433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 696/1396] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:07.565775 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e1c29-f25a-4113-b040-8d1480b391e2 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:07.566062 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e1c29-f25a-4113-b040-8d1480b391e2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:07.566343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e1c29-f25a-4113-b040-8d1480b391e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:07.584300 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-569e1c29-f25a-4113-b040-8d1480b391e2 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:07.585475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-569e1c29-f25a-4113-b040-8d1480b391e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:07.594228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 701/1397] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:27:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:07.649168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7775-ef85-48f1-a129-dff28cc93b8c None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:07.649457 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7775-ef85-48f1-a129-dff28cc93b8c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:07.649731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d7775-ef85-48f1-a129-dff28cc93b8c None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:07.652136 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 697/1398] 10.222.0.35 () {54 vars in 962 bytes} [Sat Feb 12 04:27:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:07.657126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57eb55-21ea-4a61-aa9d-2f81f8223f23 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:07.657416 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57eb55-21ea-4a61-aa9d-2f81f8223f23 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:07.657700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c57eb55-21ea-4a61-aa9d-2f81f8223f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:07.706828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-7c57eb55-21ea-4a61-aa9d-2f81f8223f23 None None] MFA Rules not processed for user `e3df18302cd84e6eae6a1a60b0a8b2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:07.708042 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7c57eb55-21ea-4a61-aa9d-2f81f8223f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:07.765688 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 702/1399] 10.222.0.35 () {58 vars in 1059 bytes} [Sat Feb 12 04:27:07 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:07.772944 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d7775-ef85-48f1-a129-dff28cc93b8c None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:07.786126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d7775-ef85-48f1-a129-dff28cc93b8c None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:07.790161 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146a18e5-0180-4635-9a4e-8fc3cb0935b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3df18302cd84e6eae6a1a60b0a8b2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:07.790797 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a18e5-0180-4635-9a4e-8fc3cb0935b9 service glance] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:07.791108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a18e5-0180-4635-9a4e-8fc3cb0935b9 service glance] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:07.791524 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146a18e5-0180-4635-9a4e-8fc3cb0935b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:07.800218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a18e5-0180-4635-9a4e-8fc3cb0935b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:07.801652 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146a18e5-0180-4635-9a4e-8fc3cb0935b9 service glance] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:07.811610 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 698/1400] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:08.422681 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998d3df-890e-4f5b-9f55-7229d405dc66 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:08.422681 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998d3df-890e-4f5b-9f55-7229d405dc66 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:08.422681 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998d3df-890e-4f5b-9f55-7229d405dc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:08.468329 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-7998d3df-890e-4f5b-9f55-7229d405dc66 None None] MFA Rules not processed for user `560fd9efb8a04f449acaf2f3987ce81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:08.469648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7998d3df-890e-4f5b-9f55-7229d405dc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:08.530365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 703/1401] 10.222.0.35 () {58 vars in 1009 bytes} [Sat Feb 12 04:27:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:08.572368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d889782-5040-4f74-aee4-d3dcc25f3489 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:08.573364 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d889782-5040-4f74-aee4-d3dcc25f3489 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:08.573469 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d889782-5040-4f74-aee4-d3dcc25f3489 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:08.575322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 699/1402] 10.222.0.35 () {54 vars in 942 bytes} [Sat Feb 12 04:27:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:08.581679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca907a-74b2-40cb-a984-8fdcf7e1b822 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:08.581974 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca907a-74b2-40cb-a984-8fdcf7e1b822 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:08.582252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca907a-74b2-40cb-a984-8fdcf7e1b822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:08.629613 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-b1ca907a-74b2-40cb-a984-8fdcf7e1b822 None None] MFA Rules not processed for user `3b37a10e3b5e404db7aad72e1772a2de`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:08.630809 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b1ca907a-74b2-40cb-a984-8fdcf7e1b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:08.700228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 704/1403] 10.222.0.35 () {58 vars in 1039 bytes} [Sat Feb 12 04:27:08 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:08.709723 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d889782-5040-4f74-aee4-d3dcc25f3489 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:08.723022 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d889782-5040-4f74-aee4-d3dcc25f3489 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:08.727954 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9561478-b3ac-4957-83ca-7b1aedb8a7e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b37a10e3b5e404db7aad72e1772a2de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:08.728705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9561478-b3ac-4957-83ca-7b1aedb8a7e0 service swift] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:08.728907 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9561478-b3ac-4957-83ca-7b1aedb8a7e0 service swift] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:08.729187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9561478-b3ac-4957-83ca-7b1aedb8a7e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:08.737389 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9561478-b3ac-4957-83ca-7b1aedb8a7e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:08.739277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9561478-b3ac-4957-83ca-7b1aedb8a7e0 service swift] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:08.750438 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 700/1404] 10.222.0.35 () {60 vars in 1384 bytes} [Sat Feb 12 04:27:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:27:09.418470 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544492c-ee3c-41c3-be5a-df5c18ff59b6 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:09.418755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544492c-ee3c-41c3-be5a-df5c18ff59b6 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:09.419034 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544492c-ee3c-41c3-be5a-df5c18ff59b6 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:09.421021 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 705/1405] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:27:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:09.426485 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866396-be03-4e18-b43b-5f01bbc1a680 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:09.426785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866396-be03-4e18-b43b-5f01bbc1a680 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:09.427063 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a866396-be03-4e18-b43b-5f01bbc1a680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:09.445300 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-7a866396-be03-4e18-b43b-5f01bbc1a680 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:09.451379 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-7a866396-be03-4e18-b43b-5f01bbc1a680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:09.456500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 701/1406] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:27:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:09.505973 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544492c-ee3c-41c3-be5a-df5c18ff59b6 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:09.523137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544492c-ee3c-41c3-be5a-df5c18ff59b6 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:09.528997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f737a-fb57-47a2-b862-5b0f58b9f319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:09.529633 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f737a-fb57-47a2-b862-5b0f58b9f319 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:09.530345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f737a-fb57-47a2-b862-5b0f58b9f319 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:09.530345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f737a-fb57-47a2-b862-5b0f58b9f319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:09.543647 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f737a-fb57-47a2-b862-5b0f58b9f319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:09.545371 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f737a-fb57-47a2-b862-5b0f58b9f319 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:09.555181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 706/1407] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:12.530468 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373c20e-c5c0-40a5-865e-6f8d900dbafc None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:12.531016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373c20e-c5c0-40a5-865e-6f8d900dbafc None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:12.531016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373c20e-c5c0-40a5-865e-6f8d900dbafc None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:12.534294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 702/1408] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:27:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:12.540531 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905cbc-6bde-402c-8781-821dff4bb233 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:12.541704 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905cbc-6bde-402c-8781-821dff4bb233 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:12.541704 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b905cbc-6bde-402c-8781-821dff4bb233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:12.561237 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-2b905cbc-6bde-402c-8781-821dff4bb233 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:12.562505 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2b905cbc-6bde-402c-8781-821dff4bb233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:12.575151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 707/1409] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:12.620834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373c20e-c5c0-40a5-865e-6f8d900dbafc None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:12.636483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373c20e-c5c0-40a5-865e-6f8d900dbafc None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:12.642235 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3527fd1-a974-462b-863e-10892685f210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:12.642891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3527fd1-a974-462b-863e-10892685f210 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:12.643168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3527fd1-a974-462b-863e-10892685f210 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:12.643482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3527fd1-a974-462b-863e-10892685f210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:12.653190 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3527fd1-a974-462b-863e-10892685f210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:12.654771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3527fd1-a974-462b-863e-10892685f210 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:12.664723 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 703/1410] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:32.310083 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9f98a-7256-4f01-b7d9-bd0d892276ce None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:32.310634 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9f98a-7256-4f01-b7d9-bd0d892276ce None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:32.310634 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9f98a-7256-4f01-b7d9-bd0d892276ce None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:32.312401 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 708/1411] 10.222.0.35 () {54 vars in 918 bytes} [Sat Feb 12 04:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:32.317425 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9b9b3-2446-4e9a-b27c-7cd4ecb2f0e3 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:32.317829 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9b9b3-2446-4e9a-b27c-7cd4ecb2f0e3 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:32.318011 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9b9b3-2446-4e9a-b27c-7cd4ecb2f0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:32.338226 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-9ea9b9b3-2446-4e9a-b27c-7cd4ecb2f0e3 None None] MFA Rules not processed for user `d48fd9b23a4946cc81a9ad7845d26623`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:32.339454 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9ea9b9b3-2446-4e9a-b27c-7cd4ecb2f0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:32.347806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 704/1412] 10.222.0.35 () {58 vars in 1015 bytes} [Sat Feb 12 04:27:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:32.361803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469aac-1410-44c3-8bda-cd1f53c76e38 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:32.362089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469aac-1410-44c3-8bda-cd1f53c76e38 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:32.362366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9469aac-1410-44c3-8bda-cd1f53c76e38 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:32.364145 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 709/1413] 10.222.0.35 () {54 vars in 918 bytes} [Sat Feb 12 04:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:32.368801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c399-8d82-4c04-9fdb-d90c63734289 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:32.369079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c399-8d82-4c04-9fdb-d90c63734289 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:32.369354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64c399-8d82-4c04-9fdb-d90c63734289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:32.387325 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-0f64c399-8d82-4c04-9fdb-d90c63734289 None None] MFA Rules not processed for user `362ab4aeb88746d8b8a14a238c877a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:32.388503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-0f64c399-8d82-4c04-9fdb-d90c63734289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:32.397372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 705/1414] 10.222.0.35 () {58 vars in 1015 bytes} [Sat Feb 12 04:27:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:35.066119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e607b-c479-4893-9281-fd32c5689582 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:35.066679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e607b-c479-4893-9281-fd32c5689582 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:35.066679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e607b-c479-4893-9281-fd32c5689582 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:35.068493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 710/1415] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:35.074794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82317fc9-41fb-4868-a103-361b219c0a19 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:35.075215 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82317fc9-41fb-4868-a103-361b219c0a19 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:35.075381 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82317fc9-41fb-4868-a103-361b219c0a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:35.092892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-82317fc9-41fb-4868-a103-361b219c0a19 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:35.094077 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-82317fc9-41fb-4868-a103-361b219c0a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:35.101996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 706/1416] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:27:35.144346 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e607b-c479-4893-9281-fd32c5689582 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:35.158452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e607b-c479-4893-9281-fd32c5689582 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:35.164151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca1e091-5568-4507-9882-11c169313008 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:35.164779 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1e091-5568-4507-9882-11c169313008 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:35.165735 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1e091-5568-4507-9882-11c169313008 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:35.166015 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca1e091-5568-4507-9882-11c169313008 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:35.173872 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1e091-5568-4507-9882-11c169313008 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:35.175466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca1e091-5568-4507-9882-11c169313008 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:35.185081 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 711/1417] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:36.533170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e27eca-caf8-475f-aa71-fe8ee789da12 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:36.533703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e27eca-caf8-475f-aa71-fe8ee789da12 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:36.533703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e27eca-caf8-475f-aa71-fe8ee789da12 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:36.535418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 707/1418] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:36.540760 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a503c-ee7a-45ca-8add-7370dc88e0d5 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:36.541687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a503c-ee7a-45ca-8add-7370dc88e0d5 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:36.541899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7a503c-ee7a-45ca-8add-7370dc88e0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:36.559658 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-bb7a503c-ee7a-45ca-8add-7370dc88e0d5 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:36.560836 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-bb7a503c-ee7a-45ca-8add-7370dc88e0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:36.568512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 712/1419] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:36.720407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e27eca-caf8-475f-aa71-fe8ee789da12 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:36.734729 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e27eca-caf8-475f-aa71-fe8ee789da12 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:36.740036 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62566856-7a17-4440-8c89-17c0c00e977b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:36.740658 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62566856-7a17-4440-8c89-17c0c00e977b service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:36.740943 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62566856-7a17-4440-8c89-17c0c00e977b service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:36.741217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62566856-7a17-4440-8c89-17c0c00e977b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:36.749709 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62566856-7a17-4440-8c89-17c0c00e977b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:36.751287 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62566856-7a17-4440-8c89-17c0c00e977b service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:36.760407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 708/1420] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:38.080070 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a071a-879c-43d6-a3ca-f953bda22119 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:38.080645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a071a-879c-43d6-a3ca-f953bda22119 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:38.080645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a071a-879c-43d6-a3ca-f953bda22119 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:38.082358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 713/1421] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:38.087733 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c1b43-d45d-4b48-8ef0-8eaca83fc873 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:38.088164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c1b43-d45d-4b48-8ef0-8eaca83fc873 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:38.088287 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c1b43-d45d-4b48-8ef0-8eaca83fc873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:38.106071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-e55c1b43-d45d-4b48-8ef0-8eaca83fc873 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:38.107282 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e55c1b43-d45d-4b48-8ef0-8eaca83fc873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:38.115057 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 709/1422] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:38.266629 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a071a-879c-43d6-a3ca-f953bda22119 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:38.280579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a071a-879c-43d6-a3ca-f953bda22119 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:38.286127 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1dac5-ac71-4f6d-b2db-d5455a4922fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:38.286755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1dac5-ac71-4f6d-b2db-d5455a4922fd service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:38.287030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1dac5-ac71-4f6d-b2db-d5455a4922fd service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:38.287328 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1dac5-ac71-4f6d-b2db-d5455a4922fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:38.295797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1dac5-ac71-4f6d-b2db-d5455a4922fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:38.297348 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1dac5-ac71-4f6d-b2db-d5455a4922fd service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:38.306997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 714/1423] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:39.629297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2ba25-c2dd-4ea8-8cf7-653241649c13 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:39.629823 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2ba25-c2dd-4ea8-8cf7-653241649c13 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:39.629823 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2ba25-c2dd-4ea8-8cf7-653241649c13 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:39.631674 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 710/1424] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:39.637077 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4df8c7-8021-409c-aae3-b409d3988935 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:39.637483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4df8c7-8021-409c-aae3-b409d3988935 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:39.637621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4df8c7-8021-409c-aae3-b409d3988935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:39.655857 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-8f4df8c7-8021-409c-aae3-b409d3988935 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:39.657022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8f4df8c7-8021-409c-aae3-b409d3988935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:39.665453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 715/1425] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:27:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:27:39.815610 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2ba25-c2dd-4ea8-8cf7-653241649c13 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:39.830833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2ba25-c2dd-4ea8-8cf7-653241649c13 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:39.837526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e8e160-bd63-4c7d-b879-ccf5fc94af71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:39.838201 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8e160-bd63-4c7d-b879-ccf5fc94af71 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:39.838485 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8e160-bd63-4c7d-b879-ccf5fc94af71 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:39.838755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8e160-bd63-4c7d-b879-ccf5fc94af71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:39.847478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8e160-bd63-4c7d-b879-ccf5fc94af71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:39.849062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e8e160-bd63-4c7d-b879-ccf5fc94af71 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:39.858756 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 711/1426] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:41.164509 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb7bec-a065-495b-97a1-5050413e0ed6 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:41.165612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb7bec-a065-495b-97a1-5050413e0ed6 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:41.165612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cb7bec-a065-495b-97a1-5050413e0ed6 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:41.167419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 716/1427] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:41.172401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1edf03-8c2b-4855-b90b-fd4c948d9833 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:41.172786 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1edf03-8c2b-4855-b90b-fd4c948d9833 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:41.172958 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1edf03-8c2b-4855-b90b-fd4c948d9833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:41.190578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-5e1edf03-8c2b-4855-b90b-fd4c948d9833 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:41.191794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5e1edf03-8c2b-4855-b90b-fd4c948d9833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:41.200363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 712/1428] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:41.350009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb7bec-a065-495b-97a1-5050413e0ed6 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:41.364046 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cb7bec-a065-495b-97a1-5050413e0ed6 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:41.369455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0563868-2652-4144-8b8b-2e7aace61961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:41.370071 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0563868-2652-4144-8b8b-2e7aace61961 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:41.370350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0563868-2652-4144-8b8b-2e7aace61961 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:41.370621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0563868-2652-4144-8b8b-2e7aace61961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:41.378851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0563868-2652-4144-8b8b-2e7aace61961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:41.380449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0563868-2652-4144-8b8b-2e7aace61961 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:41.389955 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 717/1429] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:42.705384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26a3b4-f06e-41a1-8892-456f1a08a88d None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:42.705965 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26a3b4-f06e-41a1-8892-456f1a08a88d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:42.705965 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26a3b4-f06e-41a1-8892-456f1a08a88d None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:42.707731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 713/1430] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:42.713547 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd60a-6f96-4da5-8091-061f48819f68 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:42.714003 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd60a-6f96-4da5-8091-061f48819f68 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:42.714421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffdd60a-6f96-4da5-8091-061f48819f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:42.734377 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-8ffdd60a-6f96-4da5-8091-061f48819f68 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:42.735614 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8ffdd60a-6f96-4da5-8091-061f48819f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:42.743966 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 718/1431] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:42.895808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26a3b4-f06e-41a1-8892-456f1a08a88d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:42.910409 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26a3b4-f06e-41a1-8892-456f1a08a88d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:42.915953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b9d2c9-5b64-4717-8cc3-414be99c44a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:42.916576 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9d2c9-5b64-4717-8cc3-414be99c44a8 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:42.916858 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9d2c9-5b64-4717-8cc3-414be99c44a8 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:42.917134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b9d2c9-5b64-4717-8cc3-414be99c44a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:42.925072 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9d2c9-5b64-4717-8cc3-414be99c44a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:42.926652 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b9d2c9-5b64-4717-8cc3-414be99c44a8 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:42.935996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 714/1432] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:44.291785 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a8c7-2dd7-4f0c-b9e9-c49041240281 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:44.292281 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a8c7-2dd7-4f0c-b9e9-c49041240281 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:44.292386 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d1a8c7-2dd7-4f0c-b9e9-c49041240281 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:44.294141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 719/1433] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:27:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:44.299093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025e40c-7164-4d6f-84a9-ed93d75e29b6 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:44.299555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025e40c-7164-4d6f-84a9-ed93d75e29b6 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:44.299682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5025e40c-7164-4d6f-84a9-ed93d75e29b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:44.317670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-5025e40c-7164-4d6f-84a9-ed93d75e29b6 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:44.318831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5025e40c-7164-4d6f-84a9-ed93d75e29b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:44.326712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 715/1434] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:44.478777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1a8c7-2dd7-4f0c-b9e9-c49041240281 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:44.492521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d1a8c7-2dd7-4f0c-b9e9-c49041240281 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:44.498625 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d0e72b-c7fa-4616-98e7-f31dbaf0d665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:44.499276 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0e72b-c7fa-4616-98e7-f31dbaf0d665 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:44.499562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0e72b-c7fa-4616-98e7-f31dbaf0d665 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:44.499835 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d0e72b-c7fa-4616-98e7-f31dbaf0d665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:44.507715 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0e72b-c7fa-4616-98e7-f31dbaf0d665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:44.509459 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d0e72b-c7fa-4616-98e7-f31dbaf0d665 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:44.518493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 720/1435] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:45.834697 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871242b-5347-4b8c-8bc4-9a79a1041f1a None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:45.835291 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871242b-5347-4b8c-8bc4-9a79a1041f1a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:45.835291 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871242b-5347-4b8c-8bc4-9a79a1041f1a None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:45.837214 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 716/1436] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:45.842287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370cc90-1c8d-4b6b-9e66-4a8be754389e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:45.842738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370cc90-1c8d-4b6b-9e66-4a8be754389e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:45.842844 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370cc90-1c8d-4b6b-9e66-4a8be754389e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:45.861378 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-d370cc90-1c8d-4b6b-9e66-4a8be754389e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:45.862563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d370cc90-1c8d-4b6b-9e66-4a8be754389e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:45.871354 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 721/1437] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:46.024703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871242b-5347-4b8c-8bc4-9a79a1041f1a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:46.039020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871242b-5347-4b8c-8bc4-9a79a1041f1a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:46.045230 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e48c3-ee63-4ac2-9147-8130cb31240c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:46.045856 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e48c3-ee63-4ac2-9147-8130cb31240c service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:46.046141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e48c3-ee63-4ac2-9147-8130cb31240c service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:46.046422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e48c3-ee63-4ac2-9147-8130cb31240c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:46.054560 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e48c3-ee63-4ac2-9147-8130cb31240c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:46.057072 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e48c3-ee63-4ac2-9147-8130cb31240c service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:46.066514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 717/1438] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:47.350620 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e779b-0ec2-4127-8514-c618f7ec2ca4 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:47.351166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e779b-0ec2-4127-8514-c618f7ec2ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:47.351166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e779b-0ec2-4127-8514-c618f7ec2ca4 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:47.353882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 722/1439] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:47.358910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1363663-8ae9-40bb-a369-8c64d2feeb7f None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:47.359488 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1363663-8ae9-40bb-a369-8c64d2feeb7f None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:47.359488 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1363663-8ae9-40bb-a369-8c64d2feeb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:47.377220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-a1363663-8ae9-40bb-a369-8c64d2feeb7f None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:47.378392 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a1363663-8ae9-40bb-a369-8c64d2feeb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:47.386636 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 718/1440] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:47.537826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e779b-0ec2-4127-8514-c618f7ec2ca4 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:47.552218 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e779b-0ec2-4127-8514-c618f7ec2ca4 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:47.558173 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f7576c-08aa-4915-99d2-b02d46e72d7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:47.558788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7576c-08aa-4915-99d2-b02d46e72d7e service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:47.559063 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7576c-08aa-4915-99d2-b02d46e72d7e service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:47.559361 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7576c-08aa-4915-99d2-b02d46e72d7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:47.567132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7576c-08aa-4915-99d2-b02d46e72d7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:47.568710 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f7576c-08aa-4915-99d2-b02d46e72d7e service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:47.577812 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 723/1441] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:49.679133 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0143b-3319-46fc-b0a9-ab99de3b9fd1 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:49.679708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0143b-3319-46fc-b0a9-ab99de3b9fd1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:49.679708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0143b-3319-46fc-b0a9-ab99de3b9fd1 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:49.681480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 719/1442] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:49.686964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d5787-afac-430d-88cc-c057c2836daf None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:49.687431 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d5787-afac-430d-88cc-c057c2836daf None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:49.687537 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1d5787-afac-430d-88cc-c057c2836daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:49.705445 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-6b1d5787-afac-430d-88cc-c057c2836daf None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:49.706623 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-6b1d5787-afac-430d-88cc-c057c2836daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:49.714894 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 724/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:49.752390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0143b-3319-46fc-b0a9-ab99de3b9fd1 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:49.763553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0143b-3319-46fc-b0a9-ab99de3b9fd1 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:49.767109 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1828f9-bce4-4d00-878f-6adc63afb728 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:49.767758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1828f9-bce4-4d00-878f-6adc63afb728 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:49.768042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1828f9-bce4-4d00-878f-6adc63afb728 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:49.768317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1828f9-bce4-4d00-878f-6adc63afb728 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:49.777740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1828f9-bce4-4d00-878f-6adc63afb728 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:49.779159 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1828f9-bce4-4d00-878f-6adc63afb728 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:49.788539 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 720/1444] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:52.145454 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a94bd-d385-4496-862e-f5faa553443c None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:52.146110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a94bd-d385-4496-862e-f5faa553443c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:52.146110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a94bd-d385-4496-862e-f5faa553443c None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:52.147863 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 725/1445] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:27:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:52.154510 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a35ff-403f-4e6e-a7fb-7fdd50150668 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:52.155032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a35ff-403f-4e6e-a7fb-7fdd50150668 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:52.155137 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a35ff-403f-4e6e-a7fb-7fdd50150668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:52.173997 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-b40a35ff-403f-4e6e-a7fb-7fdd50150668 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:52.175206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b40a35ff-403f-4e6e-a7fb-7fdd50150668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:52.182982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 721/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:52.221069 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a94bd-d385-4496-862e-f5faa553443c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:52.232279 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a94bd-d385-4496-862e-f5faa553443c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:52.235884 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7cad2-8bd6-4d00-9fd2-8ed640203999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:52.236521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7cad2-8bd6-4d00-9fd2-8ed640203999 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:52.236797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7cad2-8bd6-4d00-9fd2-8ed640203999 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:52.237094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7cad2-8bd6-4d00-9fd2-8ed640203999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:52.246101 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7cad2-8bd6-4d00-9fd2-8ed640203999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:52.247638 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7cad2-8bd6-4d00-9fd2-8ed640203999 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:52.256605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 726/1447] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:54.861572 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4e7ee-d577-44ca-bc89-96f751e0d8b3 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:54.862110 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4e7ee-d577-44ca-bc89-96f751e0d8b3 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:54.862110 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc4e7ee-d577-44ca-bc89-96f751e0d8b3 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:54.863881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 722/1448] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:27:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:54.869396 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42c1d5-fcdb-4fbd-859b-357a12260ba1 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:54.869798 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42c1d5-fcdb-4fbd-859b-357a12260ba1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:54.869949 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f42c1d5-fcdb-4fbd-859b-357a12260ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:54.887818 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-9f42c1d5-fcdb-4fbd-859b-357a12260ba1 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:54.889007 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9f42c1d5-fcdb-4fbd-859b-357a12260ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:54.896631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 727/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:27:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:54.935445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4e7ee-d577-44ca-bc89-96f751e0d8b3 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:54.946639 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc4e7ee-d577-44ca-bc89-96f751e0d8b3 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:54.950109 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343db23-ae58-4be9-9943-7542fcb18ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:54.950727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343db23-ae58-4be9-9943-7542fcb18ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:54.951008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343db23-ae58-4be9-9943-7542fcb18ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:54.951302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343db23-ae58-4be9-9943-7542fcb18ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:54.960060 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343db23-ae58-4be9-9943-7542fcb18ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:54.962137 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343db23-ae58-4be9-9943-7542fcb18ff4 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:54.971287 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 723/1450] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:57.320259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f9a75-a870-48e6-b81a-f393d2300377 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:57.320835 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f9a75-a870-48e6-b81a-f393d2300377 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:57.320835 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f9a75-a870-48e6-b81a-f393d2300377 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:57.322562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 728/1451] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:27:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:57.327951 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe6bb7-742b-4be2-9c6b-c2b5dd0927f8 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:57.328359 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe6bb7-742b-4be2-9c6b-c2b5dd0927f8 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:57.328502 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe6bb7-742b-4be2-9c6b-c2b5dd0927f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:57.346674 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-84fe6bb7-742b-4be2-9c6b-c2b5dd0927f8 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:57.352460 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-84fe6bb7-742b-4be2-9c6b-c2b5dd0927f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:57.356232 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 724/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:27:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:57.395010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f9a75-a870-48e6-b81a-f393d2300377 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:57.405995 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f9a75-a870-48e6-b81a-f393d2300377 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:57.409681 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72cf4e7-c48a-43e2-b731-4e7a40934d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:57.410290 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cf4e7-c48a-43e2-b731-4e7a40934d2f service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:57.410818 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cf4e7-c48a-43e2-b731-4e7a40934d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:57.411086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72cf4e7-c48a-43e2-b731-4e7a40934d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:57.420356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cf4e7-c48a-43e2-b731-4e7a40934d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:57.421745 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72cf4e7-c48a-43e2-b731-4e7a40934d2f service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:57.430892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 729/1453] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:27:59.741745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20555aa1-c34c-4dcc-bc13-35184c77daed None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:59.742897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20555aa1-c34c-4dcc-bc13-35184c77daed None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:59.742897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20555aa1-c34c-4dcc-bc13-35184c77daed None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:59.744631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 725/1454] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:27:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:27:59.749925 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21f5d0-d9b4-4b21-9e16-94cbf3eefd64 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:59.750329 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21f5d0-d9b4-4b21-9e16-94cbf3eefd64 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:59.750468 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f21f5d0-d9b4-4b21-9e16-94cbf3eefd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:59.769775 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-2f21f5d0-d9b4-4b21-9e16-94cbf3eefd64 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:27:59.770961 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2f21f5d0-d9b4-4b21-9e16-94cbf3eefd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:27:59.779142 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 730/1455] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:27:59.817773 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20555aa1-c34c-4dcc-bc13-35184c77daed None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:27:59.828979 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20555aa1-c34c-4dcc-bc13-35184c77daed None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:27:59.832424 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d44e7-ff6b-4794-81ba-3118c515628a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:27:59.833047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d44e7-ff6b-4794-81ba-3118c515628a service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:27:59.833326 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d44e7-ff6b-4794-81ba-3118c515628a service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:27:59.833597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d44e7-ff6b-4794-81ba-3118c515628a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:27:59.842329 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d44e7-ff6b-4794-81ba-3118c515628a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:27:59.843794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6d44e7-ff6b-4794-81ba-3118c515628a service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:27:59.852868 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 726/1456] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:28:02.116432 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f57c-daa7-4099-b6df-3fa1ba61e4c8 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:02.117016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f57c-daa7-4099-b6df-3fa1ba61e4c8 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:02.117016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3f57c-daa7-4099-b6df-3fa1ba61e4c8 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:02.118924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 731/1457] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:28:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:28:02.124111 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903e571-401d-4f8b-b4b3-ded4e3e35f15 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:02.124522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903e571-401d-4f8b-b4b3-ded4e3e35f15 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:02.124665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903e571-401d-4f8b-b4b3-ded4e3e35f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:02.142504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-f903e571-401d-4f8b-b4b3-ded4e3e35f15 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:28:02.143712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f903e571-401d-4f8b-b4b3-ded4e3e35f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:02.152072 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 727/1458] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:28:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:28:02.190469 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3f57c-daa7-4099-b6df-3fa1ba61e4c8 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:02.201398 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3f57c-daa7-4099-b6df-3fa1ba61e4c8 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:02.204901 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3e9093-561b-4642-a58d-eab3a68c63ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:02.205531 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9093-561b-4642-a58d-eab3a68c63ea service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:02.205807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9093-561b-4642-a58d-eab3a68c63ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:02.206077 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e9093-561b-4642-a58d-eab3a68c63ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:02.215313 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e9093-561b-4642-a58d-eab3a68c63ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:02.216727 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3e9093-561b-4642-a58d-eab3a68c63ea service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:02.225722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 732/1459] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:28:04.550928 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb3064-ab66-4b37-9549-32968ff1b57e None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:04.551500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb3064-ab66-4b37-9549-32968ff1b57e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:04.551500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb3064-ab66-4b37-9549-32968ff1b57e None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:04.553244 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 728/1460] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:28:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:28:04.559107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec65f36-3fd7-45c9-8cc3-af79758905ea None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:04.559531 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec65f36-3fd7-45c9-8cc3-af79758905ea None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:04.559687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec65f36-3fd7-45c9-8cc3-af79758905ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:04.577118 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-dec65f36-3fd7-45c9-8cc3-af79758905ea None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:28:04.578284 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-dec65f36-3fd7-45c9-8cc3-af79758905ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:04.586088 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 733/1461] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:28:04.623750 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb3064-ab66-4b37-9549-32968ff1b57e None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:04.634327 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb3064-ab66-4b37-9549-32968ff1b57e None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:04.637847 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472aa5d-076b-4340-a314-72f0342f473f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:04.638470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472aa5d-076b-4340-a314-72f0342f473f service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:04.638751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472aa5d-076b-4340-a314-72f0342f473f service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:04.639026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472aa5d-076b-4340-a314-72f0342f473f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:04.647820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472aa5d-076b-4340-a314-72f0342f473f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:04.649390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472aa5d-076b-4340-a314-72f0342f473f service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:04.658552 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 729/1462] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:28:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:28:06.906884 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edd074-1a59-4e1f-8080-d21b53eacef5 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:06.907456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edd074-1a59-4e1f-8080-d21b53eacef5 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:06.907456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edd074-1a59-4e1f-8080-d21b53eacef5 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:06.909299 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 734/1463] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:28:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:28:06.914896 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d64cde-2d27-4cc1-babd-90ad133b7653 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:06.915352 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d64cde-2d27-4cc1-babd-90ad133b7653 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:06.915499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d64cde-2d27-4cc1-babd-90ad133b7653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:06.933273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-b3d64cde-2d27-4cc1-babd-90ad133b7653 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:28:06.934462 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b3d64cde-2d27-4cc1-babd-90ad133b7653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:06.942637 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 730/1464] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:28:06.982739 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edd074-1a59-4e1f-8080-d21b53eacef5 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:06.993494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edd074-1a59-4e1f-8080-d21b53eacef5 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:06.997019 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79982726-5f2e-4443-a14e-70824dcb12ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:06.997655 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79982726-5f2e-4443-a14e-70824dcb12ad service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:06.997921 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79982726-5f2e-4443-a14e-70824dcb12ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:06.998191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79982726-5f2e-4443-a14e-70824dcb12ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:07.007168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79982726-5f2e-4443-a14e-70824dcb12ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:07.009255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79982726-5f2e-4443-a14e-70824dcb12ad service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:07.018451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 735/1465] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:28:09.282499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c109885-4549-482d-bdc6-6647f8617b1f None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:09.282939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c109885-4549-482d-bdc6-6647f8617b1f None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:09.283059 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c109885-4549-482d-bdc6-6647f8617b1f None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:09.284835 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 731/1466] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:28:09.290483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdc1a0-b34a-4237-9c62-a2fcfb19cd3f None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:09.290916 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdc1a0-b34a-4237-9c62-a2fcfb19cd3f None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:09.291040 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdc1a0-b34a-4237-9c62-a2fcfb19cd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:09.309011 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-45fdc1a0-b34a-4237-9c62-a2fcfb19cd3f None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:28:09.310189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-45fdc1a0-b34a-4237-9c62-a2fcfb19cd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:09.317877 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 736/1467] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:28:09.354367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c109885-4549-482d-bdc6-6647f8617b1f None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:09.364772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c109885-4549-482d-bdc6-6647f8617b1f None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:09.368773 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47662ea-d1e2-433f-b18e-e2ecf1c3777a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:09.369393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47662ea-d1e2-433f-b18e-e2ecf1c3777a service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:09.369672 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47662ea-d1e2-433f-b18e-e2ecf1c3777a service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:09.369941 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47662ea-d1e2-433f-b18e-e2ecf1c3777a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:09.378500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47662ea-d1e2-433f-b18e-e2ecf1c3777a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:09.379947 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47662ea-d1e2-433f-b18e-e2ecf1c3777a service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:09.389857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 732/1468] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:28:11.611791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec42dd6-bcff-43ce-a186-f7a628044fd2 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:11.612319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec42dd6-bcff-43ce-a186-f7a628044fd2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:11.612319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec42dd6-bcff-43ce-a186-f7a628044fd2 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:11.614038 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 737/1469] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:28:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:28:11.620112 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16783d9d-e141-46cb-ba15-b88c9b1bb286 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:11.620546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16783d9d-e141-46cb-ba15-b88c9b1bb286 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:11.620677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16783d9d-e141-46cb-ba15-b88c9b1bb286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:11.639665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-16783d9d-e141-46cb-ba15-b88c9b1bb286 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:28:11.640849 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-16783d9d-e141-46cb-ba15-b88c9b1bb286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:11.648667 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 733/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:28:11.685055 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec42dd6-bcff-43ce-a186-f7a628044fd2 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:11.696097 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec42dd6-bcff-43ce-a186-f7a628044fd2 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:11.699569 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b656b11a-a2bb-49b6-b73b-cfb0664f56ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:11.700188 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656b11a-a2bb-49b6-b73b-cfb0664f56ac service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:11.700463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656b11a-a2bb-49b6-b73b-cfb0664f56ac service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:11.700729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656b11a-a2bb-49b6-b73b-cfb0664f56ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:11.709258 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656b11a-a2bb-49b6-b73b-cfb0664f56ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:11.710885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b656b11a-a2bb-49b6-b73b-cfb0664f56ac service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:11.719860 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 738/1471] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:28:28.080251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e22c87-30e1-435f-9fb0-cb5588b19884 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:28.080880 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e22c87-30e1-435f-9fb0-cb5588b19884 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:28.080880 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e22c87-30e1-435f-9fb0-cb5588b19884 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:28.082634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 734/1472] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:28:28.088228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a91ae-a0f0-420d-9d82-f8104353c806 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:28.088640 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a91ae-a0f0-420d-9d82-f8104353c806 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:28.088776 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a91ae-a0f0-420d-9d82-f8104353c806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:28.106664 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-2c9a91ae-a0f0-420d-9d82-f8104353c806 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:28:28.107865 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2c9a91ae-a0f0-420d-9d82-f8104353c806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:28.115428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 739/1473] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:28:28.161954 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63852dbd-f61e-4d63-be07-8f2871a6c36a None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:28.162241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63852dbd-f61e-4d63-be07-8f2871a6c36a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:28.162545 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63852dbd-f61e-4d63-be07-8f2871a6c36a None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:28.165037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 735/1474] 10.222.0.35 () {54 vars in 962 bytes} [Sat Feb 12 04:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:28:28.169766 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a6619-8468-42c5-8544-3d7950492afe None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:28.170047 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a6619-8468-42c5-8544-3d7950492afe None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:28.170320 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45a6619-8468-42c5-8544-3d7950492afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:28.188119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-f45a6619-8468-42c5-8544-3d7950492afe None None] MFA Rules not processed for user `e3df18302cd84e6eae6a1a60b0a8b2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:28:28.189315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f45a6619-8468-42c5-8544-3d7950492afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:28.195600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 740/1475] 10.222.0.35 () {58 vars in 1059 bytes} [Sat Feb 12 04:28:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:28:28.202548 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63852dbd-f61e-4d63-be07-8f2871a6c36a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:28.214031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63852dbd-f61e-4d63-be07-8f2871a6c36a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:28.217493 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16df48b-9379-4e58-9d6d-6b0085c0546c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3df18302cd84e6eae6a1a60b0a8b2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:28.218106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16df48b-9379-4e58-9d6d-6b0085c0546c service glance] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:28.218387 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16df48b-9379-4e58-9d6d-6b0085c0546c service glance] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:28.218686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16df48b-9379-4e58-9d6d-6b0085c0546c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:28.227888 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16df48b-9379-4e58-9d6d-6b0085c0546c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:28.229325 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16df48b-9379-4e58-9d6d-6b0085c0546c service glance] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:28.238961 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 736/1476] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:28:30.542226 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52f5fa-f29e-4b86-87c4-f28f8a414783 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:30.542794 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52f5fa-f29e-4b86-87c4-f28f8a414783 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:30.542938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e52f5fa-f29e-4b86-87c4-f28f8a414783 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:30.544782 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 741/1477] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:28:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:28:30.550183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69117f12-ba18-43f7-adec-5569cd2678e1 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:30.550617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69117f12-ba18-43f7-adec-5569cd2678e1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:30.550740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69117f12-ba18-43f7-adec-5569cd2678e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:30.569583 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-69117f12-ba18-43f7-adec-5569cd2678e1 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:28:30.570775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-69117f12-ba18-43f7-adec-5569cd2678e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:30.579138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 737/1478] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:28:30.603876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52f5fa-f29e-4b86-87c4-f28f8a414783 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:30.616632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e52f5fa-f29e-4b86-87c4-f28f8a414783 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:30.621096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70e80f-8b9f-4426-9db4-649ca34cc645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:30.621739 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70e80f-8b9f-4426-9db4-649ca34cc645 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:30.622016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70e80f-8b9f-4426-9db4-649ca34cc645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:30.622292 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70e80f-8b9f-4426-9db4-649ca34cc645 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:30.623036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70e80f-8b9f-4426-9db4-649ca34cc645 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:30.624890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70e80f-8b9f-4426-9db4-649ca34cc645 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:30.639306 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 742/1479] 10.222.0.35 () {56 vars in 1108 bytes} [Sat Feb 12 04:28:30 2022] GET /identity/v3/projects => generated 2553 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:28:32.956001 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6602e9a-fc50-4f37-8574-e08a9a968256 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:32.956615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6602e9a-fc50-4f37-8574-e08a9a968256 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:32.956615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6602e9a-fc50-4f37-8574-e08a9a968256 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:32.959555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 738/1480] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:28:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:28:32.967473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7996fe-9615-4a9a-8323-61fa8ab3b772 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:32.967938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7996fe-9615-4a9a-8323-61fa8ab3b772 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:32.968043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7996fe-9615-4a9a-8323-61fa8ab3b772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:32.987212 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-ac7996fe-9615-4a9a-8323-61fa8ab3b772 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:28:32.988444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ac7996fe-9615-4a9a-8323-61fa8ab3b772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:32.998887 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 743/1481] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:28:33.044441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6602e9a-fc50-4f37-8574-e08a9a968256 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:33.059444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6602e9a-fc50-4f37-8574-e08a9a968256 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:33.064868 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48861def-60f0-4023-bbcd-3c498e6dcc4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:33.065495 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48861def-60f0-4023-bbcd-3c498e6dcc4a service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:33.065778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48861def-60f0-4023-bbcd-3c498e6dcc4a service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:33.066056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48861def-60f0-4023-bbcd-3c498e6dcc4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:33.074630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48861def-60f0-4023-bbcd-3c498e6dcc4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:33.076294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48861def-60f0-4023-bbcd-3c498e6dcc4a service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:33.086026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 739/1482] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:28:35.519524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78193c-c7f8-45fb-aec2-4f236efee0d1 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:35.520089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78193c-c7f8-45fb-aec2-4f236efee0d1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:35.520089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78193c-c7f8-45fb-aec2-4f236efee0d1 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:35.521833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 744/1483] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:28:35.527678 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ac157-5ea4-45a5-af7c-850e4ba0b648 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:35.528087 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ac157-5ea4-45a5-af7c-850e4ba0b648 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:35.528209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446ac157-5ea4-45a5-af7c-850e4ba0b648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:35.546324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-446ac157-5ea4-45a5-af7c-850e4ba0b648 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:28:35.547454 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-446ac157-5ea4-45a5-af7c-850e4ba0b648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:35.555902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 740/1484] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:28:35.591701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78193c-c7f8-45fb-aec2-4f236efee0d1 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:35.603215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78193c-c7f8-45fb-aec2-4f236efee0d1 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:35.606768 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b37df5-bb7e-4adc-b25e-650e04007d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:35.607473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37df5-bb7e-4adc-b25e-650e04007d89 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:35.607755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37df5-bb7e-4adc-b25e-650e04007d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:35.608030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b37df5-bb7e-4adc-b25e-650e04007d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:35.617051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b37df5-bb7e-4adc-b25e-650e04007d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:35.618466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b37df5-bb7e-4adc-b25e-650e04007d89 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:35.627599 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 745/1485] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:28:37.913940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac05dd-700e-44ee-9f27-cfe56016a949 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:37.914530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac05dd-700e-44ee-9f27-cfe56016a949 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:37.914637 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac05dd-700e-44ee-9f27-cfe56016a949 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:37.916403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 741/1486] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:28:37.921733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c217c07-c4b1-429f-814f-cb1e0bb4b421 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:37.922158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c217c07-c4b1-429f-814f-cb1e0bb4b421 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:37.922272 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c217c07-c4b1-429f-814f-cb1e0bb4b421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:37.939945 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-4c217c07-c4b1-429f-814f-cb1e0bb4b421 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:28:37.941133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4c217c07-c4b1-429f-814f-cb1e0bb4b421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:37.948802 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 746/1487] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:28:37.987470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac05dd-700e-44ee-9f27-cfe56016a949 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:37.997868 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac05dd-700e-44ee-9f27-cfe56016a949 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:38.001561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c8730-d21d-4ce2-928f-b5456ff422f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:38.010168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8730-d21d-4ce2-928f-b5456ff422f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:38.010168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8730-d21d-4ce2-928f-b5456ff422f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:38.010168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8730-d21d-4ce2-928f-b5456ff422f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:38.011649 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c8730-d21d-4ce2-928f-b5456ff422f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:38.013078 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c8730-d21d-4ce2-928f-b5456ff422f6 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:38.022726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 742/1488] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:28:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:28:40.403639 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea085dc-4900-4d4b-8775-76903cfaf726 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:40.404197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea085dc-4900-4d4b-8775-76903cfaf726 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:40.404197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea085dc-4900-4d4b-8775-76903cfaf726 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:40.405918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 747/1489] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:28:40.411349 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81785094-aa19-4465-a298-2a8f13a628b1 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:40.411777 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81785094-aa19-4465-a298-2a8f13a628b1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:40.411904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81785094-aa19-4465-a298-2a8f13a628b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:40.430078 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-81785094-aa19-4465-a298-2a8f13a628b1 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:28:40.431297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-81785094-aa19-4465-a298-2a8f13a628b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:40.438871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 743/1490] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:28:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:28:40.483358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea085dc-4900-4d4b-8775-76903cfaf726 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:40.493975 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea085dc-4900-4d4b-8775-76903cfaf726 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:40.497489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2a9b2-8ce4-4da2-9aca-77522fd10746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:40.498110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2a9b2-8ce4-4da2-9aca-77522fd10746 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:40.498393 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2a9b2-8ce4-4da2-9aca-77522fd10746 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:40.498666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2a9b2-8ce4-4da2-9aca-77522fd10746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:40.507910 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2a9b2-8ce4-4da2-9aca-77522fd10746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:40.509320 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2a9b2-8ce4-4da2-9aca-77522fd10746 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:40.518361 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 748/1491] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:28:43.107612 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc896a-285f-4060-b959-88ea6ad39d2d None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:43.108144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc896a-285f-4060-b959-88ea6ad39d2d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:43.108144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc896a-285f-4060-b959-88ea6ad39d2d None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:43.109832 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 744/1492] 10.222.0.35 () {54 vars in 926 bytes} [Sat Feb 12 04:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:28:43.115333 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3de3a-423f-4a30-8b6e-5b74bf5d76cc None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:43.116353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3de3a-423f-4a30-8b6e-5b74bf5d76cc None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:43.116519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3de3a-423f-4a30-8b6e-5b74bf5d76cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:43.134509 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-78f3de3a-423f-4a30-8b6e-5b74bf5d76cc None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:28:43.135711 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-78f3de3a-423f-4a30-8b6e-5b74bf5d76cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:28:43.143347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 749/1493] 10.222.0.35 () {58 vars in 1023 bytes} [Sat Feb 12 04:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:28:43.182348 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc896a-285f-4060-b959-88ea6ad39d2d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:28:43.192900 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc896a-285f-4060-b959-88ea6ad39d2d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:28:43.197083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558d4e81-01eb-4549-b7e3-5984083c657f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:28:43.197705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d4e81-01eb-4549-b7e3-5984083c657f service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:28:43.198022 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d4e81-01eb-4549-b7e3-5984083c657f service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:28:43.198279 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558d4e81-01eb-4549-b7e3-5984083c657f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:28:43.207004 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d4e81-01eb-4549-b7e3-5984083c657f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:28:43.208459 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558d4e81-01eb-4549-b7e3-5984083c657f service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:28:43.217784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 745/1494] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:30:05.658485 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e464df-9ca4-4b86-bf61-9c27406886b4 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:05.659051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e464df-9ca4-4b86-bf61-9c27406886b4 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:05.659051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e464df-9ca4-4b86-bf61-9c27406886b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:05.677430 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-51e464df-9ca4-4b86-bf61-9c27406886b4 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:30:05.678597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-51e464df-9ca4-4b86-bf61-9c27406886b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:30:05.686249 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 750/1495] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:30:05.694916 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585f498-c00e-4c02-9d13-5c72176d5d36 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:05.695428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585f498-c00e-4c02-9d13-5c72176d5d36 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:05.695544 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8585f498-c00e-4c02-9d13-5c72176d5d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:05.713041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-8585f498-c00e-4c02-9d13-5c72176d5d36 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:30:05.714221 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-8585f498-c00e-4c02-9d13-5c72176d5d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:30:05.721818 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 746/1496] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:30:05.726374 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e464df-9ca4-4b86-bf61-9c27406886b4 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:30:05.735645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e464df-9ca4-4b86-bf61-9c27406886b4 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:30:05.741235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcd335-50c4-4c06-851b-536f5f699598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:30:05.741884 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd335-50c4-4c06-851b-536f5f699598 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:05.742162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd335-50c4-4c06-851b-536f5f699598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:05.742438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabcd335-50c4-4c06-851b-536f5f699598 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:05.743169 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcd335-50c4-4c06-851b-536f5f699598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:30:05.743503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcd335-50c4-4c06-851b-536f5f699598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:30:05.745068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabcd335-50c4-4c06-851b-536f5f699598 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:30:05.757220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 751/1497] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:30:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:30:05.765229 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585f498-c00e-4c02-9d13-5c72176d5d36 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:30:05.774376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8585f498-c00e-4c02-9d13-5c72176d5d36 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:30:05.778993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c02088-ed99-47b3-a603-07830d5bef22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:30:05.779669 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c02088-ed99-47b3-a603-07830d5bef22 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:05.779952 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c02088-ed99-47b3-a603-07830d5bef22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:05.780228 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c02088-ed99-47b3-a603-07830d5bef22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:05.780936 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c02088-ed99-47b3-a603-07830d5bef22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:30:05.783074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c02088-ed99-47b3-a603-07830d5bef22 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:30:05.917922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 747/1498] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:30:05 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:30:05.921986 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcd335-50c4-4c06-851b-536f5f699598 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:30:05.932565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabcd335-50c4-4c06-851b-536f5f699598 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:30:05.984799 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90531835-4565-48b7-8653-6dfa7b49a425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:30:05.985448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90531835-4565-48b7-8653-6dfa7b49a425 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:05.985729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90531835-4565-48b7-8653-6dfa7b49a425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:05.985996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90531835-4565-48b7-8653-6dfa7b49a425 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:05.986684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90531835-4565-48b7-8653-6dfa7b49a425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:30:05.989376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90531835-4565-48b7-8653-6dfa7b49a425 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:30:06.093667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 752/1499] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:30:05 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:30:06.098460 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c02088-ed99-47b3-a603-07830d5bef22 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:30:06.108445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c02088-ed99-47b3-a603-07830d5bef22 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:30:06.112936 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b046b-1b71-4d87-b411-4c911f9fefad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:30:06.114307 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b046b-1b71-4d87-b411-4c911f9fefad admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:06.114645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b046b-1b71-4d87-b411-4c911f9fefad admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:06.114929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b046b-1b71-4d87-b411-4c911f9fefad admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:06.115704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b046b-1b71-4d87-b411-4c911f9fefad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:30:06.117285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b046b-1b71-4d87-b411-4c911f9fefad admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:30:06.129791 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 748/1500] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:30:06.133602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90531835-4565-48b7-8653-6dfa7b49a425 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:30:06.143387 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90531835-4565-48b7-8653-6dfa7b49a425 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:30:06.148133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb25e3-0af1-49cd-8724-6adcde85b225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:30:06.148779 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb25e3-0af1-49cd-8724-6adcde85b225 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:06.149060 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb25e3-0af1-49cd-8724-6adcde85b225 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:06.149334 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb25e3-0af1-49cd-8724-6adcde85b225 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:06.150101 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb25e3-0af1-49cd-8724-6adcde85b225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:30:06.151718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb25e3-0af1-49cd-8724-6adcde85b225 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:30:06.165618 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 753/1501] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:30:06.169676 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b046b-1b71-4d87-b411-4c911f9fefad admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:30:06.179902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b046b-1b71-4d87-b411-4c911f9fefad admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:30:06.184345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fd918-0735-48aa-ad44-85e128d36091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:30:06.185196 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fd918-0735-48aa-ad44-85e128d36091 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:06.188977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fd918-0735-48aa-ad44-85e128d36091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:06.188977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fd918-0735-48aa-ad44-85e128d36091 admin admin] PATH_INFO: `/v3/projects/dd98483f93ec4c388d4249da3372197a/users/d2291525c8e84eba95413a695f6f36b2/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:06.200248 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fd918-0735-48aa-ad44-85e128d36091 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd98483f93ec4c388d4249da3372197a, user_id=d2291525c8e84eba95413a695f6f36b2, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:30:06.202972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fd918-0735-48aa-ad44-85e128d36091 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:30:06.277458 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 749/1502] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:30:06 2022] PUT /identity/v3/projects/dd98483f93ec4c388d4249da3372197a/users/d2291525c8e84eba95413a695f6f36b2/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:30:06.290784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5af6a-b040-4776-8e3f-bdf423ffb5f8 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:06.291073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5af6a-b040-4776-8e3f-bdf423ffb5f8 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:06.291392 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a5af6a-b040-4776-8e3f-bdf423ffb5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:06.316852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-54a5af6a-b040-4776-8e3f-bdf423ffb5f8 None None] MFA Rules not processed for user `d2291525c8e84eba95413a695f6f36b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:30:06.318043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-54a5af6a-b040-4776-8e3f-bdf423ffb5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:30:06.379388 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 754/1503] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:30:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:30:06.390372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fd918-0735-48aa-ad44-85e128d36091 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:30:06.456987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fd918-0735-48aa-ad44-85e128d36091 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:30:06.462800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e66ca-fd41-42ce-ba43-2cb762f6ef8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:30:06.463461 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e66ca-fd41-42ce-ba43-2cb762f6ef8c service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:06.463738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e66ca-fd41-42ce-ba43-2cb762f6ef8c service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:06.464027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089e66ca-fd41-42ce-ba43-2cb762f6ef8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:06.471448 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e66ca-fd41-42ce-ba43-2cb762f6ef8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:30:06.473606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089e66ca-fd41-42ce-ba43-2cb762f6ef8c service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:30:06.482022 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 750/1504] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:30:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:30:06.549623 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e92d9-3b07-4be7-ad56-d13dcaef333d None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:06.549911 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e92d9-3b07-4be7-ad56-d13dcaef333d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:06.550185 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e92d9-3b07-4be7-ad56-d13dcaef333d None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:06.552227 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 755/1505] 10.222.0.35 () {52 vars in 829 bytes} [Sat Feb 12 04:30:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:30:06.555881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e66ca-fd41-42ce-ba43-2cb762f6ef8c service nova] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:30:06.614982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089e66ca-fd41-42ce-ba43-2cb762f6ef8c service nova] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:30:06.619525 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:30:06.620366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:06.620645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:06.620915 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] PATH_INFO: `/v3/users/d2291525c8e84eba95413a695f6f36b2` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:06.622091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2291525c8e84eba95413a695f6f36b2)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:30:06.623095 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:30:06.623095 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:30:06.623095 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:30:06.624322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:30:06.825771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2291525c8e84eba95413a695f6f36b2'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:30:06.826424 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2291525c8e84eba95413a695f6f36b2'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:30:06.827138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2291525c8e84eba95413a695f6f36b2'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:30:06.846646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2291525c8e84eba95413a695f6f36b2'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:30:06.858432 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2291525c8e84eba95413a695f6f36b2'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:30:06.930289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 751/1506] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:30:06 2022] DELETE /identity/v3/users/d2291525c8e84eba95413a695f6f36b2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:30:06.934798 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153e6ad-ccd4-4669-8996-63474ffa0379 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:06.935277 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153e6ad-ccd4-4669-8996-63474ffa0379 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:06.935393 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153e6ad-ccd4-4669-8996-63474ffa0379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:06.952805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-f153e6ad-ccd4-4669-8996-63474ffa0379 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:30:06.953997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f153e6ad-ccd4-4669-8996-63474ffa0379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:30:07.009846 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 756/1507] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:30:07.019658 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:30:07.021776 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:30:07.076125 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb23ad-67a7-47ba-8492-c568571820f9 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:30:07.079681 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da344ce-29de-4bdf-8ea0-ca7c2f3ee112 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:30:07.080326 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da344ce-29de-4bdf-8ea0-ca7c2f3ee112 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:07.080587 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da344ce-29de-4bdf-8ea0-ca7c2f3ee112 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:07.080855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da344ce-29de-4bdf-8ea0-ca7c2f3ee112 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:07.090033 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da344ce-29de-4bdf-8ea0-ca7c2f3ee112 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:30:07.091480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da344ce-29de-4bdf-8ea0-ca7c2f3ee112 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:30:07.101251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 752/1508] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:30:07.536097 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153e6ad-ccd4-4669-8996-63474ffa0379 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:30:07.537545 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f153e6ad-ccd4-4669-8996-63474ffa0379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:30:07.549435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153e6ad-ccd4-4669-8996-63474ffa0379 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:30:07.555140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd2bab-11c2-4cca-9610-18b5e647c910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:30:07.556349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2bab-11c2-4cca-9610-18b5e647c910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:30:07.556628 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2bab-11c2-4cca-9610-18b5e647c910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:30:07.556898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd2bab-11c2-4cca-9610-18b5e647c910 admin admin] PATH_INFO: `/v3/projects/dd98483f93ec4c388d4249da3372197a` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:30:07.558105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd2bab-11c2-4cca-9610-18b5e647c910 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd98483f93ec4c388d4249da3372197a)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:30:07.563002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-d6bd2bab-11c2-4cca-9610-18b5e647c910 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:30:07.563002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:30:07.563002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:30:07.564295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd2bab-11c2-4cca-9610-18b5e647c910 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:30:07.680270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d6bd2bab-11c2-4cca-9610-18b5e647c910 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd98483f93ec4c388d4249da3372197a', 'request_id': 'req-d6bd2bab-11c2-4cca-9610-18b5e647c910'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:30:07.693664 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d6bd2bab-11c2-4cca-9610-18b5e647c910 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd98483f93ec4c388d4249da3372197a', 'request_id': 'req-d6bd2bab-11c2-4cca-9610-18b5e647c910'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:30:07.699574 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d6bd2bab-11c2-4cca-9610-18b5e647c910 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd98483f93ec4c388d4249da3372197a', 'request_id': 'req-d6bd2bab-11c2-4cca-9610-18b5e647c910'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:30:07.784356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d6bd2bab-11c2-4cca-9610-18b5e647c910 admin admin] The token cache is being invalidate because project dd98483f93ec4c388d4249da3372197a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:30:07.784578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d6bd2bab-11c2-4cca-9610-18b5e647c910 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:30:07.785197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d6bd2bab-11c2-4cca-9610-18b5e647c910 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:30:07.786878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 757/1509] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:30:07 2022] DELETE /identity/v3/projects/dd98483f93ec4c388d4249da3372197a => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:31:35.844176 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cad3a3-083e-4df0-a6f2-4a3efecb0d7c None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:35.844806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cad3a3-083e-4df0-a6f2-4a3efecb0d7c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:35.844806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cad3a3-083e-4df0-a6f2-4a3efecb0d7c None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:35.846502 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 753/1510] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:31:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:31:35.851382 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a5d4d-a92e-4123-adb1-bdca2471eab3 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:35.851831 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a5d4d-a92e-4123-adb1-bdca2471eab3 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:35.851928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a5d4d-a92e-4123-adb1-bdca2471eab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:35.870339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-0b4a5d4d-a92e-4123-adb1-bdca2471eab3 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:31:35.871594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0b4a5d4d-a92e-4123-adb1-bdca2471eab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:31:35.926565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 758/1511] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:31:36.080955 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cad3a3-083e-4df0-a6f2-4a3efecb0d7c None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:31:36.082604 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-34cad3a3-083e-4df0-a6f2-4a3efecb0d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:31:36.160958 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cad3a3-083e-4df0-a6f2-4a3efecb0d7c None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:31:36.167302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbc6e1-b785-4f48-901e-dc9e561a2869 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:31:36.167948 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbc6e1-b785-4f48-901e-dc9e561a2869 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:36.168232 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbc6e1-b785-4f48-901e-dc9e561a2869 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:36.168507 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbc6e1-b785-4f48-901e-dc9e561a2869 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:36.176865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbc6e1-b785-4f48-901e-dc9e561a2869 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:31:36.179051 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbc6e1-b785-4f48-901e-dc9e561a2869 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:31:36.188261 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 754/1512] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:31:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:31:36.319362 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44c136-5b9d-4c7f-adc4-29f154ebaad9 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:36.319788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44c136-5b9d-4c7f-adc4-29f154ebaad9 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:36.320127 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b44c136-5b9d-4c7f-adc4-29f154ebaad9 None None] PATH_INFO: `/v3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:36.321475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 759/1513] 10.222.0.26 () {54 vars in 925 bytes} [Sat Feb 12 04:31:36 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:31:36.328125 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb92a8e-d135-451c-a957-ee2657b584ca None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:36.328479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb92a8e-d135-451c-a957-ee2657b584ca None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:36.328834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb92a8e-d135-451c-a957-ee2657b584ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:36.347615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-cbb92a8e-d135-451c-a957-ee2657b584ca None None] MFA Rules not processed for user `d48fd9b23a4946cc81a9ad7845d26623`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:31:36.348788 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-cbb92a8e-d135-451c-a957-ee2657b584ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:31:36.410219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 755/1514] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Feb 12 04:31:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:31:37.495914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d7f89-0a9a-4032-9573-879b2e242132 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:37.496475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d7f89-0a9a-4032-9573-879b2e242132 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:37.496475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d7f89-0a9a-4032-9573-879b2e242132 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:37.498252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 760/1515] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:31:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:31:37.503164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac7f0e-b03f-4ac0-965f-3eb054ee4c0a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:37.503577 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac7f0e-b03f-4ac0-965f-3eb054ee4c0a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:37.503760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac7f0e-b03f-4ac0-965f-3eb054ee4c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:37.521985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-f3ac7f0e-b03f-4ac0-965f-3eb054ee4c0a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:31:37.523167 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f3ac7f0e-b03f-4ac0-965f-3eb054ee4c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:31:37.531162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 756/1516] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:31:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:31:37.686077 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d7f89-0a9a-4032-9573-879b2e242132 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:31:37.700331 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d7f89-0a9a-4032-9573-879b2e242132 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:31:37.705797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c13e53-e07c-4553-8e78-5b6e38d8f2cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:31:37.706429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c13e53-e07c-4553-8e78-5b6e38d8f2cd service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:37.706712 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c13e53-e07c-4553-8e78-5b6e38d8f2cd service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:37.706993 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c13e53-e07c-4553-8e78-5b6e38d8f2cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:37.716071 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c13e53-e07c-4553-8e78-5b6e38d8f2cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:31:37.718110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c13e53-e07c-4553-8e78-5b6e38d8f2cd service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:31:37.728878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 761/1517] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:31:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:31:40.461593 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f116af-fdef-4b67-a391-d622bdfba825 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:40.462121 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f116af-fdef-4b67-a391-d622bdfba825 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:40.462121 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f116af-fdef-4b67-a391-d622bdfba825 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:40.463938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 757/1518] 10.222.0.35 () {54 vars in 960 bytes} [Sat Feb 12 04:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:31:40.469092 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1b508-b42b-4530-b3ec-77984ead6aac None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:40.469514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1b508-b42b-4530-b3ec-77984ead6aac None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:40.469629 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1b508-b42b-4530-b3ec-77984ead6aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:40.493344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-9ba1b508-b42b-4530-b3ec-77984ead6aac None None] MFA Rules not processed for user `d48fd9b23a4946cc81a9ad7845d26623`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:31:40.494575 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9ba1b508-b42b-4530-b3ec-77984ead6aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:31:40.503447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 762/1519] 10.222.0.35 () {58 vars in 1057 bytes} [Sat Feb 12 04:31:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:31:40.511342 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f116af-fdef-4b67-a391-d622bdfba825 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:31:40.525925 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f116af-fdef-4b67-a391-d622bdfba825 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:31:40.531196 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ca60b-3bf1-43c2-a23a-c2bee37073df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:31:40.531902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ca60b-3bf1-43c2-a23a-c2bee37073df service placement] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:40.532224 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ca60b-3bf1-43c2-a23a-c2bee37073df service placement] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:40.532501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ca60b-3bf1-43c2-a23a-c2bee37073df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:40.541518 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ca60b-3bf1-43c2-a23a-c2bee37073df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:31:40.543094 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ca60b-3bf1-43c2-a23a-c2bee37073df service placement] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:31:40.553147 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 758/1520] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:31:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:31:49.439758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44631fc6-43ca-4aef-b6ea-5d02fae2ade9 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:49.440375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44631fc6-43ca-4aef-b6ea-5d02fae2ade9 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:49.440375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44631fc6-43ca-4aef-b6ea-5d02fae2ade9 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:49.442095 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 763/1521] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:31:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:31:49.447895 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe8b3-dbdb-49fc-8193-771b781370a7 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:49.448354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe8b3-dbdb-49fc-8193-771b781370a7 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:49.448477 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe8b3-dbdb-49fc-8193-771b781370a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:49.466631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-46afe8b3-dbdb-49fc-8193-771b781370a7 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:31:49.467895 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-46afe8b3-dbdb-49fc-8193-771b781370a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:31:49.476237 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 759/1522] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:31:49.629839 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44631fc6-43ca-4aef-b6ea-5d02fae2ade9 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:31:49.644811 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44631fc6-43ca-4aef-b6ea-5d02fae2ade9 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:31:49.650157 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16d998-0cd6-46dc-8c7a-4931845f9ce6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:31:49.652900 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d998-0cd6-46dc-8c7a-4931845f9ce6 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:49.652900 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d998-0cd6-46dc-8c7a-4931845f9ce6 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:49.652900 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16d998-0cd6-46dc-8c7a-4931845f9ce6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:49.659499 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16d998-0cd6-46dc-8c7a-4931845f9ce6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:31:49.661083 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc16d998-0cd6-46dc-8c7a-4931845f9ce6 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:31:49.670687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 764/1523] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:31:50.964399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acb139-8336-4fbd-bde7-4eb7de071874 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:50.964957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acb139-8336-4fbd-bde7-4eb7de071874 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:50.964957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acb139-8336-4fbd-bde7-4eb7de071874 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:50.966787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 760/1524] 127.0.0.1 () {54 vars in 901 bytes} [Sat Feb 12 04:31:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:31:50.971756 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c06a3-02f7-4603-bd38-2bcc4357d107 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:50.972176 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c06a3-02f7-4603-bd38-2bcc4357d107 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:50.972348 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c06a3-02f7-4603-bd38-2bcc4357d107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:50.990968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-565c06a3-02f7-4603-bd38-2bcc4357d107 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:31:50.992282 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-565c06a3-02f7-4603-bd38-2bcc4357d107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:31:50.999945 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 765/1525] 127.0.0.1 () {58 vars in 998 bytes} [Sat Feb 12 04:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:31:51.160359 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acb139-8336-4fbd-bde7-4eb7de071874 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:31:51.174370 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acb139-8336-4fbd-bde7-4eb7de071874 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:31:51.179713 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff790ae-102b-42f5-a6c2-2d3fbc2896ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:31:51.180333 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff790ae-102b-42f5-a6c2-2d3fbc2896ee service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:51.180608 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff790ae-102b-42f5-a6c2-2d3fbc2896ee service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:51.180878 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff790ae-102b-42f5-a6c2-2d3fbc2896ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:51.188739 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff790ae-102b-42f5-a6c2-2d3fbc2896ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:31:51.190291 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff790ae-102b-42f5-a6c2-2d3fbc2896ee service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:31:51.199861 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 761/1526] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:31:55.344586 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461b324-02a4-44f9-9290-c27ff7e7bd0b None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:55.345183 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461b324-02a4-44f9-9290-c27ff7e7bd0b None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:55.345183 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461b324-02a4-44f9-9290-c27ff7e7bd0b None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:55.346954 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 766/1527] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:31:55.352016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235dce8-8008-4886-93ff-f51767b17673 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:55.352440 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235dce8-8008-4886-93ff-f51767b17673 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:55.352598 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235dce8-8008-4886-93ff-f51767b17673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:55.370794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-f235dce8-8008-4886-93ff-f51767b17673 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:31:55.372007 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f235dce8-8008-4886-93ff-f51767b17673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:31:55.379727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 762/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:31:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:31:55.415898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461b324-02a4-44f9-9290-c27ff7e7bd0b None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:31:55.417610 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0461b324-02a4-44f9-9290-c27ff7e7bd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:31:55.471929 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461b324-02a4-44f9-9290-c27ff7e7bd0b None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:31:55.475486 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ffd14-2094-4118-a2c0-f35af9067064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:31:55.476121 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ffd14-2094-4118-a2c0-f35af9067064 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:55.476397 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ffd14-2094-4118-a2c0-f35af9067064 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:55.476669 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ffd14-2094-4118-a2c0-f35af9067064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:55.485311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ffd14-2094-4118-a2c0-f35af9067064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:31:55.486754 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ffd14-2094-4118-a2c0-f35af9067064 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:31:55.496399 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 767/1529] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:31:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:31:57.679539 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b523ff-bb43-43f8-9e3b-a1da2f9fff88 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:57.680266 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b523ff-bb43-43f8-9e3b-a1da2f9fff88 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:57.680266 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b523ff-bb43-43f8-9e3b-a1da2f9fff88 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:57.682172 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 763/1530] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:31:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:31:57.688090 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc67970-165f-4d6c-a1a3-cd8be9d39243 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:57.688546 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc67970-165f-4d6c-a1a3-cd8be9d39243 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:57.688836 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc67970-165f-4d6c-a1a3-cd8be9d39243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:57.710157 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-ffc67970-165f-4d6c-a1a3-cd8be9d39243 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:31:57.711397 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ffc67970-165f-4d6c-a1a3-cd8be9d39243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:31:57.719156 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 768/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:31:57.754433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b523ff-bb43-43f8-9e3b-a1da2f9fff88 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:31:57.756698 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-08b523ff-bb43-43f8-9e3b-a1da2f9fff88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:31:57.769247 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b523ff-bb43-43f8-9e3b-a1da2f9fff88 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:31:57.772839 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7778b833-0923-4991-b961-8cc5869fab85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:31:57.773461 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778b833-0923-4991-b961-8cc5869fab85 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:31:57.773738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778b833-0923-4991-b961-8cc5869fab85 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:31:57.774007 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7778b833-0923-4991-b961-8cc5869fab85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:31:57.782922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778b833-0923-4991-b961-8cc5869fab85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:31:57.784369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7778b833-0923-4991-b961-8cc5869fab85 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:31:57.793822 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 764/1532] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:32:01.473063 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab8c0-a022-4cb2-b69c-34ef47c4d9f6 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:32:01.473707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab8c0-a022-4cb2-b69c-34ef47c4d9f6 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:32:01.473707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ab8c0-a022-4cb2-b69c-34ef47c4d9f6 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:32:01.475768 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 769/1533] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:32:01.481129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec708779-3460-4253-bd48-3a06c58d7037 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:32:01.481575 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec708779-3460-4253-bd48-3a06c58d7037 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:32:01.481683 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec708779-3460-4253-bd48-3a06c58d7037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:32:01.500016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-ec708779-3460-4253-bd48-3a06c58d7037 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:32:01.501180 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ec708779-3460-4253-bd48-3a06c58d7037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:32:01.509510 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 765/1534] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:32:01.762109 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ab8c0-a022-4cb2-b69c-34ef47c4d9f6 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:32:01.763818 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9d0ab8c0-a022-4cb2-b69c-34ef47c4d9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:32:01.821467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ab8c0-a022-4cb2-b69c-34ef47c4d9f6 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:32:01.825011 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72892ea-2059-4780-ae8b-999a769da2da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:32:01.825638 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72892ea-2059-4780-ae8b-999a769da2da service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:32:01.825921 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72892ea-2059-4780-ae8b-999a769da2da service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:32:01.826197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72892ea-2059-4780-ae8b-999a769da2da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:32:01.835000 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72892ea-2059-4780-ae8b-999a769da2da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:32:01.836444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72892ea-2059-4780-ae8b-999a769da2da service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:32:01.845527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 770/1535] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:32:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:32:04.101735 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73d9ac-8afc-4b6d-9902-27c9156c0707 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:32:04.102299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73d9ac-8afc-4b6d-9902-27c9156c0707 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:32:04.102299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73d9ac-8afc-4b6d-9902-27c9156c0707 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:32:04.104093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 766/1536] 127.0.0.1 () {54 vars in 916 bytes} [Sat Feb 12 04:32:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:32:04.109315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bc397-4cfd-4bf9-a384-820e0eebf506 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:32:04.109746 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bc397-4cfd-4bf9-a384-820e0eebf506 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:32:04.109860 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701bc397-4cfd-4bf9-a384-820e0eebf506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:32:04.128042 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-701bc397-4cfd-4bf9-a384-820e0eebf506 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:32:04.129235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-701bc397-4cfd-4bf9-a384-820e0eebf506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:32:04.136962 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 771/1537] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Feb 12 04:32:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:32:04.386679 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105ee8f-7c74-49b7-bad5-ee4e6a90e456 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:32:04.386967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105ee8f-7c74-49b7-bad5-ee4e6a90e456 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:32:04.387146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105ee8f-7c74-49b7-bad5-ee4e6a90e456 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:32:04.388926 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 767/1538] 10.222.0.35 () {54 vars in 963 bytes} [Sat Feb 12 04:32:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:32:04.393662 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddf7f4-dc6a-461e-bf4c-7f4a5749f116 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:32:04.393950 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddf7f4-dc6a-461e-bf4c-7f4a5749f116 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:32:04.394253 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ddf7f4-dc6a-461e-bf4c-7f4a5749f116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:32:04.412280 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-d2ddf7f4-dc6a-461e-bf4c-7f4a5749f116 None None] MFA Rules not processed for user `df25b09762ab4130a1c656cd499d5fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:32:04.413474 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d2ddf7f4-dc6a-461e-bf4c-7f4a5749f116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:32:04.419828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 772/1539] 10.222.0.35 () {58 vars in 1060 bytes} [Sat Feb 12 04:32:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:32:04.427210 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105ee8f-7c74-49b7-bad5-ee4e6a90e456 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:32:04.438208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105ee8f-7c74-49b7-bad5-ee4e6a90e456 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:32:04.441737 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5335c-e704-41fc-973d-d46acb94a7f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:32:04.442357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5335c-e704-41fc-973d-d46acb94a7f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:32:04.442642 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5335c-e704-41fc-973d-d46acb94a7f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:32:04.442921 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5335c-e704-41fc-973d-d46acb94a7f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:32:04.452326 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5335c-e704-41fc-973d-d46acb94a7f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:32:04.453741 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5335c-e704-41fc-973d-d46acb94a7f2 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:32:04.463265 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 768/1540] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:32:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:25.509784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499630cf-42ef-472f-ad1a-69d13617113e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:25.510930 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499630cf-42ef-472f-ad1a-69d13617113e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:25.511486 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499630cf-42ef-472f-ad1a-69d13617113e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:25.534279 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-499630cf-42ef-472f-ad1a-69d13617113e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:25.535400 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-499630cf-42ef-472f-ad1a-69d13617113e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:25.552976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 773/1541] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:25.562147 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c020348-209f-4c91-89d1-3c28dc0027de None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:25.563127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c020348-209f-4c91-89d1-3c28dc0027de None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:25.563661 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c020348-209f-4c91-89d1-3c28dc0027de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:25.594489 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1c020348-209f-4c91-89d1-3c28dc0027de None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:25.596117 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1c020348-209f-4c91-89d1-3c28dc0027de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:25.602964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072486-0cfb-45fa-8a5c-aa7ad648bef6 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:25.603270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072486-0cfb-45fa-8a5c-aa7ad648bef6 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:25.603552 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05072486-0cfb-45fa-8a5c-aa7ad648bef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:25.619093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 769/1542] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:25.624175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c020348-209f-4c91-89d1-3c28dc0027de None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:25.646720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c020348-209f-4c91-89d1-3c28dc0027de None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:25.656028 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-05072486-0cfb-45fa-8a5c-aa7ad648bef6 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:25.657228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-05072486-0cfb-45fa-8a5c-aa7ad648bef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:25.663673 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266dd3f-1d38-40fe-82ed-3b75b75031ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:25.664356 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266dd3f-1d38-40fe-82ed-3b75b75031ee admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:25.664632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266dd3f-1d38-40fe-82ed-3b75b75031ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:25.665686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0266dd3f-1d38-40fe-82ed-3b75b75031ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:25.666458 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266dd3f-1d38-40fe-82ed-3b75b75031ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:33:25.666763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266dd3f-1d38-40fe-82ed-3b75b75031ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:25.670470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0266dd3f-1d38-40fe-82ed-3b75b75031ee admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:25.683866 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 774/1543] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:25.697390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 770/1544] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:33:25.702347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa277-4eb2-4efc-a364-925859285431 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:25.702636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa277-4eb2-4efc-a364-925859285431 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:25.702909 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaa277-4eb2-4efc-a364-925859285431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:25.710995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266dd3f-1d38-40fe-82ed-3b75b75031ee admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:25.741793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0266dd3f-1d38-40fe-82ed-3b75b75031ee admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:25.743617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-9fcaa277-4eb2-4efc-a364-925859285431 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:25.744823 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9fcaa277-4eb2-4efc-a364-925859285431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:25.752890 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb77a71-1bec-45e8-9df8-bdd5d6535323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:25.753556 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb77a71-1bec-45e8-9df8-bdd5d6535323 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:25.753835 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb77a71-1bec-45e8-9df8-bdd5d6535323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:25.754112 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb77a71-1bec-45e8-9df8-bdd5d6535323 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:25.754873 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb77a71-1bec-45e8-9df8-bdd5d6535323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:25.764446 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 775/1545] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:25.765013 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb77a71-1bec-45e8-9df8-bdd5d6535323 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:25.765758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ffdf4-52d9-49a2-acea-1ae1f5ec9ca6 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:25.766043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ffdf4-52d9-49a2-acea-1ae1f5ec9ca6 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:25.766336 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ffdf4-52d9-49a2-acea-1ae1f5ec9ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:25.812606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-167ffdf4-52d9-49a2-acea-1ae1f5ec9ca6 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:25.812606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-167ffdf4-52d9-49a2-acea-1ae1f5ec9ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:25.820267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 776/1546] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:25.821257 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ffdf4-52d9-49a2-acea-1ae1f5ec9ca6 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:25.836946 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ffdf4-52d9-49a2-acea-1ae1f5ec9ca6 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:25.846051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f8f55-3f52-4e81-9edb-cfde7219bbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:25.846725 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f8f55-3f52-4e81-9edb-cfde7219bbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:25.847006 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f8f55-3f52-4e81-9edb-cfde7219bbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:25.847323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f8f55-3f52-4e81-9edb-cfde7219bbc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:25.848059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f8f55-3f52-4e81-9edb-cfde7219bbc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:33:25.848892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f8f55-3f52-4e81-9edb-cfde7219bbc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:25.850708 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f8f55-3f52-4e81-9edb-cfde7219bbc6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:25.868126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 777/1547] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:33:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:33:25.869241 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48d98-b526-4420-b7ea-91689bce11b1 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:25.869531 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48d98-b526-4420-b7ea-91689bce11b1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:25.869808 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b48d98-b526-4420-b7ea-91689bce11b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:25.895177 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-b7b48d98-b526-4420-b7ea-91689bce11b1 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:25.902859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b7b48d98-b526-4420-b7ea-91689bce11b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:25.909721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 771/1548] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:25 2022] POST /identity/v3/projects => generated 389 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:25.912194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ecf8-f886-45b7-a833-2da63c25516e None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:25.912396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ecf8-f886-45b7-a833-2da63c25516e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:25.912643 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b416ecf8-f886-45b7-a833-2da63c25516e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:25.919262 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 778/1549] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:25.921462 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ac662-4ec8-4f90-968c-59f846a63282 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:25.921753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ac662-4ec8-4f90-968c-59f846a63282 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:25.922030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9ac662-4ec8-4f90-968c-59f846a63282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:25.937806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-b416ecf8-f886-45b7-a833-2da63c25516e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:25.952112 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b416ecf8-f886-45b7-a833-2da63c25516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:25.952270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-df9ac662-4ec8-4f90-968c-59f846a63282 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:25.952270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-df9ac662-4ec8-4f90-968c-59f846a63282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:26.007175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 772/1550] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:26.008146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416ecf8-f886-45b7-a833-2da63c25516e None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.018001 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 779/1551] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:26.019076 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b416ecf8-f886-45b7-a833-2da63c25516e None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.019452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406da4-3ebc-445f-807e-f693f8f23ded None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.019742 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406da4-3ebc-445f-807e-f693f8f23ded None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.020017 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc406da4-3ebc-445f-807e-f693f8f23ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.024423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ebad8-4dd9-44d0-8afc-e7b9a64883e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.025270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ebad8-4dd9-44d0-8afc-e7b9a64883e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.025974 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ebad8-4dd9-44d0-8afc-e7b9a64883e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.026475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ebad8-4dd9-44d0-8afc-e7b9a64883e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.027375 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ebad8-4dd9-44d0-8afc-e7b9a64883e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.029280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ebad8-4dd9-44d0-8afc-e7b9a64883e6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.038922 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-bc406da4-3ebc-445f-807e-f693f8f23ded None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:26.040141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-bc406da4-3ebc-445f-807e-f693f8f23ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:26.047846 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 780/1552] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:26.054447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc406da4-3ebc-445f-807e-f693f8f23ded None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.057480 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc406da4-3ebc-445f-807e-f693f8f23ded None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.062263 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f81352-996b-4bac-a15a-320d8e598527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.062944 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f81352-996b-4bac-a15a-320d8e598527 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.063172 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f81352-996b-4bac-a15a-320d8e598527 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.063481 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f81352-996b-4bac-a15a-320d8e598527 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.064168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f81352-996b-4bac-a15a-320d8e598527 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.066057 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f81352-996b-4bac-a15a-320d8e598527 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.125998 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 773/1553] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:26.126817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ebad8-4dd9-44d0-8afc-e7b9a64883e6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.155590 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 781/1554] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:26.156892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0062c9-3e8a-4631-8d61-c3855d840118 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.157176 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0062c9-3e8a-4631-8d61-c3855d840118 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.157459 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0062c9-3e8a-4631-8d61-c3855d840118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.175487 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-dd0062c9-3e8a-4631-8d61-c3855d840118 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:26.176827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-dd0062c9-3e8a-4631-8d61-c3855d840118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:26.189219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ebad8-4dd9-44d0-8afc-e7b9a64883e6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.193825 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299dfd6e-37ab-48f0-babe-ac84e6285495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.194485 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfd6e-37ab-48f0-babe-ac84e6285495 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.194765 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfd6e-37ab-48f0-babe-ac84e6285495 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.195037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299dfd6e-37ab-48f0-babe-ac84e6285495 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.195805 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dfd6e-37ab-48f0-babe-ac84e6285495 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:33:26.196108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dfd6e-37ab-48f0-babe-ac84e6285495 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.197732 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299dfd6e-37ab-48f0-babe-ac84e6285495 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.209428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 774/1555] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:33:26.210720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937937-1c33-49be-9868-77afbf997291 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.211011 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937937-1c33-49be-9868-77afbf997291 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.211309 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1937937-1c33-49be-9868-77afbf997291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.229975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-e1937937-1c33-49be-9868-77afbf997291 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:26.231173 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e1937937-1c33-49be-9868-77afbf997291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:26.233934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 782/1556] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:26.236585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb5d34-a8ed-4e19-907e-3b2d11878cba None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.236882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb5d34-a8ed-4e19-907e-3b2d11878cba None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.237414 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb5d34-a8ed-4e19-907e-3b2d11878cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.239864 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 775/1557] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:26.241536 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d044-b003-4613-a9ab-346681127619 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.241827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d044-b003-4613-a9ab-346681127619 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.242103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6000d044-b003-4613-a9ab-346681127619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.259889 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-32bb5d34-a8ed-4e19-907e-3b2d11878cba None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:26.261090 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-32bb5d34-a8ed-4e19-907e-3b2d11878cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:26.261959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-6000d044-b003-4613-a9ab-346681127619 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:26.263094 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-6000d044-b003-4613-a9ab-346681127619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:26.269695 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 783/1558] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:26.275155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 776/1559] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:26.275373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18d73d-e673-4066-884f-52cbe52e2d8d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.275373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18d73d-e673-4066-884f-52cbe52e2d8d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.275804 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000d044-b003-4613-a9ab-346681127619 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.275912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18d73d-e673-4066-884f-52cbe52e2d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.282705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6000d044-b003-4613-a9ab-346681127619 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.288671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237d9ead-c2dc-43b8-b570-6b8387d66fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.289356 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d9ead-c2dc-43b8-b570-6b8387d66fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.289640 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d9ead-c2dc-43b8-b570-6b8387d66fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.289912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237d9ead-c2dc-43b8-b570-6b8387d66fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.290651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d9ead-c2dc-43b8-b570-6b8387d66fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.292582 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237d9ead-c2dc-43b8-b570-6b8387d66fb0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.293441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-6c18d73d-e673-4066-884f-52cbe52e2d8d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:26.294615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-6c18d73d-e673-4066-884f-52cbe52e2d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:26.306300 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 784/1560] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:26.307550 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18d73d-e673-4066-884f-52cbe52e2d8d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.319819 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18d73d-e673-4066-884f-52cbe52e2d8d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.324249 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e86993-729d-4488-bd3d-199bcd87809a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.324886 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e86993-729d-4488-bd3d-199bcd87809a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.325193 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e86993-729d-4488-bd3d-199bcd87809a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.325462 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e86993-729d-4488-bd3d-199bcd87809a admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.326220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e86993-729d-4488-bd3d-199bcd87809a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.327924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e86993-729d-4488-bd3d-199bcd87809a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.338682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 785/1561] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:26.339495 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e86993-729d-4488-bd3d-199bcd87809a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.349367 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e86993-729d-4488-bd3d-199bcd87809a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.354169 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb135e24-dd29-4291-ba7c-3d05eb0cb464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.354765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb135e24-dd29-4291-ba7c-3d05eb0cb464 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.355044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb135e24-dd29-4291-ba7c-3d05eb0cb464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.359826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb135e24-dd29-4291-ba7c-3d05eb0cb464 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.359826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb135e24-dd29-4291-ba7c-3d05eb0cb464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.359826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb135e24-dd29-4291-ba7c-3d05eb0cb464 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.384532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 777/1562] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/users => generated 288 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:26.385976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c7831-62b8-4e6e-aeb4-20d2f03aa9b2 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.386260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c7831-62b8-4e6e-aeb4-20d2f03aa9b2 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.386537 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c7831-62b8-4e6e-aeb4-20d2f03aa9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.404357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-056c7831-62b8-4e6e-aeb4-20d2f03aa9b2 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:26.405533 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-056c7831-62b8-4e6e-aeb4-20d2f03aa9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:26.413301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 778/1563] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:26.414622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c890-cf86-4c13-a161-93d509d2566d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.414908 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c890-cf86-4c13-a161-93d509d2566d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.415183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034c890-cf86-4c13-a161-93d509d2566d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.431876 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-e034c890-cf86-4c13-a161-93d509d2566d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:26.433040 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e034c890-cf86-4c13-a161-93d509d2566d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:26.436899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 786/1564] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:26.440014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb135e24-dd29-4291-ba7c-3d05eb0cb464 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.444760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 779/1565] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:26.444760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034c890-cf86-4c13-a161-93d509d2566d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.451798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034c890-cf86-4c13-a161-93d509d2566d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.501305 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb135e24-dd29-4291-ba7c-3d05eb0cb464 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.506472 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b2bb1-9331-4f54-a492-a36834acb29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.506801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a1575-ab17-47ba-a3ca-190a210eb2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.507126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2bb1-9331-4f54-a492-a36834acb29d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.507449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2bb1-9331-4f54-a492-a36834acb29d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.507546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a1575-ab17-47ba-a3ca-190a210eb2fb admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.507730 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510b2bb1-9331-4f54-a492-a36834acb29d admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.507833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a1575-ab17-47ba-a3ca-190a210eb2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.508017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a1575-ab17-47ba-a3ca-190a210eb2fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.508464 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b2bb1-9331-4f54-a492-a36834acb29d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:33:26.508767 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b2bb1-9331-4f54-a492-a36834acb29d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.509082 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a1575-ab17-47ba-a3ca-190a210eb2fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:33:26.509399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a1575-ab17-47ba-a3ca-190a210eb2fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.510352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510b2bb1-9331-4f54-a492-a36834acb29d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.510968 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a1575-ab17-47ba-a3ca-190a210eb2fb admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.521748 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 787/1566] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:33:26.529462 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 780/1567] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:33:26.529608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b2bb1-9331-4f54-a492-a36834acb29d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.529704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a1575-ab17-47ba-a3ca-190a210eb2fb admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.539094 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a1575-ab17-47ba-a3ca-190a210eb2fb admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.539257 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510b2bb1-9331-4f54-a492-a36834acb29d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.543802 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983026-df03-4659-833d-130dbc8f965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.543944 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f547f6-9e9e-42b1-942a-a3cfd031f719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.544443 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983026-df03-4659-833d-130dbc8f965a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.544541 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f547f6-9e9e-42b1-942a-a3cfd031f719 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.544723 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983026-df03-4659-833d-130dbc8f965a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.544818 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f547f6-9e9e-42b1-942a-a3cfd031f719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.544996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02983026-df03-4659-833d-130dbc8f965a admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.545090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f547f6-9e9e-42b1-942a-a3cfd031f719 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.545731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02983026-df03-4659-833d-130dbc8f965a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:33:26.545852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f547f6-9e9e-42b1-942a-a3cfd031f719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.546031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02983026-df03-4659-833d-130dbc8f965a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.547321 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f547f6-9e9e-42b1-942a-a3cfd031f719 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.547702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02983026-df03-4659-833d-130dbc8f965a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.560830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 781/1568] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:26.560830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f547f6-9e9e-42b1-942a-a3cfd031f719 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.561147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 788/1569] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:33:26.564108 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983026-df03-4659-833d-130dbc8f965a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.569001 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f547f6-9e9e-42b1-942a-a3cfd031f719 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.573578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054d9c2-f50f-425e-a964-6cefc04b9237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.574156 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d9c2-f50f-425e-a964-6cefc04b9237 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.574432 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d9c2-f50f-425e-a964-6cefc04b9237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.574717 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d054d9c2-f50f-425e-a964-6cefc04b9237 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.575432 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02983026-df03-4659-833d-130dbc8f965a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.575567 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054d9c2-f50f-425e-a964-6cefc04b9237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.577032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d054d9c2-f50f-425e-a964-6cefc04b9237 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.580217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c7c00-8caf-4d1b-a3e6-1dd1125cbfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.580846 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c7c00-8caf-4d1b-a3e6-1dd1125cbfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.581127 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c7c00-8caf-4d1b-a3e6-1dd1125cbfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.581402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c7c00-8caf-4d1b-a3e6-1dd1125cbfc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.582139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c7c00-8caf-4d1b-a3e6-1dd1125cbfc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:33:26.582435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c7c00-8caf-4d1b-a3e6-1dd1125cbfc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.584714 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c7c00-8caf-4d1b-a3e6-1dd1125cbfc1 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.588521 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 782/1570] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:26.589324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054d9c2-f50f-425e-a964-6cefc04b9237 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.596396 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 789/1571] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:33:26.597143 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c7c00-8caf-4d1b-a3e6-1dd1125cbfc1 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.605751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d054d9c2-f50f-425e-a964-6cefc04b9237 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.607449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c7c00-8caf-4d1b-a3e6-1dd1125cbfc1 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.610444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fe0eb-a283-4b29-a3b4-08f8ae7c5d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.611217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fe0eb-a283-4b29-a3b4-08f8ae7c5d93 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.611535 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fe0eb-a283-4b29-a3b4-08f8ae7c5d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.611911 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572fe0eb-a283-4b29-a3b4-08f8ae7c5d93 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.612029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4c02b-990e-4feb-b63b-83c8f1e7e5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.612666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4c02b-990e-4feb-b63b-83c8f1e7e5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.612785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fe0eb-a283-4b29-a3b4-08f8ae7c5d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.612948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4c02b-990e-4feb-b63b-83c8f1e7e5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.613419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b4c02b-990e-4feb-b63b-83c8f1e7e5b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.614561 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4c02b-990e-4feb-b63b-83c8f1e7e5b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:33:26.614921 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572fe0eb-a283-4b29-a3b4-08f8ae7c5d93 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.615094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4c02b-990e-4feb-b63b-83c8f1e7e5b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.616793 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b4c02b-990e-4feb-b63b-83c8f1e7e5b5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.628571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 790/1572] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:33:26.629495 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4c02b-990e-4feb-b63b-83c8f1e7e5b5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.639393 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b4c02b-990e-4feb-b63b-83c8f1e7e5b5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.644043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec19fe-4114-4fa5-b626-daaa20a979db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.644666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec19fe-4114-4fa5-b626-daaa20a979db admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.644947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec19fe-4114-4fa5-b626-daaa20a979db admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.645800 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec19fe-4114-4fa5-b626-daaa20a979db admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.646579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec19fe-4114-4fa5-b626-daaa20a979db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.648485 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec19fe-4114-4fa5-b626-daaa20a979db admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.674985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 783/1573] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/users => generated 290 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:26.675821 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fe0eb-a283-4b29-a3b4-08f8ae7c5d93 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.685085 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572fe0eb-a283-4b29-a3b4-08f8ae7c5d93 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.689708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a41b9f-aaae-4242-b24a-d879829760e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.690340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a41b9f-aaae-4242-b24a-d879829760e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.690625 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a41b9f-aaae-4242-b24a-d879829760e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.690951 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a41b9f-aaae-4242-b24a-d879829760e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.691676 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a41b9f-aaae-4242-b24a-d879829760e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.694219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a41b9f-aaae-4242-b24a-d879829760e6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.736438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 791/1574] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:26.736438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec19fe-4114-4fa5-b626-daaa20a979db admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.779544 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 784/1575] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:26.780354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a41b9f-aaae-4242-b24a-d879829760e6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.796652 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec19fe-4114-4fa5-b626-daaa20a979db admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.841081 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a41b9f-aaae-4242-b24a-d879829760e6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:26.845581 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c58bda-a473-41e6-bd21-3096be72fa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.846231 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c58bda-a473-41e6-bd21-3096be72fa70 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.846514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c58bda-a473-41e6-bd21-3096be72fa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.846792 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c58bda-a473-41e6-bd21-3096be72fa70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.847524 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c58bda-a473-41e6-bd21-3096be72fa70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.849544 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c58bda-a473-41e6-bd21-3096be72fa70 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.850360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33750c74-022c-42d1-896a-60f8b184fb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:26.851254 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33750c74-022c-42d1-896a-60f8b184fb27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:26.851540 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33750c74-022c-42d1-896a-60f8b184fb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:26.851812 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33750c74-022c-42d1-896a-60f8b184fb27 admin admin] PATH_INFO: `/v3/projects/8a8defa94eb34a91a83ff931804a4f31/users/46193f5323954ed6b3a5e52fa0b3f0dc/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:26.867632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33750c74-022c-42d1-896a-60f8b184fb27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a8defa94eb34a91a83ff931804a4f31, user_id=46193f5323954ed6b3a5e52fa0b3f0dc, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:26.870262 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33750c74-022c-42d1-896a-60f8b184fb27 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:26.951363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 785/1576] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:26.952259 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c58bda-a473-41e6-bd21-3096be72fa70 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:26.962051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 792/1577] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:26 2022] PUT /identity/v3/projects/8a8defa94eb34a91a83ff931804a4f31/users/46193f5323954ed6b3a5e52fa0b3f0dc/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:26.963087 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33750c74-022c-42d1-896a-60f8b184fb27 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.011852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c58bda-a473-41e6-bd21-3096be72fa70 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.025394 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33750c74-022c-42d1-896a-60f8b184fb27 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.031694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b5452-1b95-4dcd-8bad-52aa6f6ca215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.032343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5452-1b95-4dcd-8bad-52aa6f6ca215 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.032625 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5452-1b95-4dcd-8bad-52aa6f6ca215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.032899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b5452-1b95-4dcd-8bad-52aa6f6ca215 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.033624 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b5452-1b95-4dcd-8bad-52aa6f6ca215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.035599 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b5452-1b95-4dcd-8bad-52aa6f6ca215 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.065464 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53ccb2-22df-4760-b7a3-40d7df8f791f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.066119 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53ccb2-22df-4760-b7a3-40d7df8f791f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.066396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53ccb2-22df-4760-b7a3-40d7df8f791f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.066686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b53ccb2-22df-4760-b7a3-40d7df8f791f admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.068117 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53ccb2-22df-4760-b7a3-40d7df8f791f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.069793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b53ccb2-22df-4760-b7a3-40d7df8f791f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.079250 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 786/1578] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:27.080078 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53ccb2-22df-4760-b7a3-40d7df8f791f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.089241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b53ccb2-22df-4760-b7a3-40d7df8f791f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.093751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf4e2d-56a5-4008-9d8c-d1d31840339c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.094301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf4e2d-56a5-4008-9d8c-d1d31840339c admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.094578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf4e2d-56a5-4008-9d8c-d1d31840339c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.094851 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf4e2d-56a5-4008-9d8c-d1d31840339c admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.095557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf4e2d-56a5-4008-9d8c-d1d31840339c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.097382 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf4e2d-56a5-4008-9d8c-d1d31840339c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.118255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 793/1579] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:26 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:27.119084 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b5452-1b95-4dcd-8bad-52aa6f6ca215 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.182494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b5452-1b95-4dcd-8bad-52aa6f6ca215 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.187647 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2dec1-1f50-442f-8c3f-093933467614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.188302 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2dec1-1f50-442f-8c3f-093933467614 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.188585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2dec1-1f50-442f-8c3f-093933467614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.188861 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2dec1-1f50-442f-8c3f-093933467614 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.189589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2dec1-1f50-442f-8c3f-093933467614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.191182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2dec1-1f50-442f-8c3f-093933467614 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.201159 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 794/1580] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:27.203172 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2dec1-1f50-442f-8c3f-093933467614 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.212165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2dec1-1f50-442f-8c3f-093933467614 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.216856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937b44e-6924-4e5d-819c-b5506bbcb8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.217467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b44e-6924-4e5d-819c-b5506bbcb8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.217755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b44e-6924-4e5d-819c-b5506bbcb8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.218030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b44e-6924-4e5d-819c-b5506bbcb8a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.218720 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937b44e-6924-4e5d-819c-b5506bbcb8a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.220614 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937b44e-6924-4e5d-819c-b5506bbcb8a0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.225823 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 787/1581] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:27 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:27.226484 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf4e2d-56a5-4008-9d8c-d1d31840339c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.288008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf4e2d-56a5-4008-9d8c-d1d31840339c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.292692 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d445480-4b07-4a3b-8808-a2352e15b046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.293343 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d445480-4b07-4a3b-8808-a2352e15b046 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.293619 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d445480-4b07-4a3b-8808-a2352e15b046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.293885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d445480-4b07-4a3b-8808-a2352e15b046 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.294581 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d445480-4b07-4a3b-8808-a2352e15b046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.296580 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d445480-4b07-4a3b-8808-a2352e15b046 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.313338 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 795/1582] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:27 2022] POST /identity/v3/users => generated 297 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:27.314286 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937b44e-6924-4e5d-819c-b5506bbcb8a0 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.323922 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937b44e-6924-4e5d-819c-b5506bbcb8a0 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.328422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51331180-b4df-4ff2-8b78-62070bb029c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.329052 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331180-b4df-4ff2-8b78-62070bb029c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.329332 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331180-b4df-4ff2-8b78-62070bb029c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.329606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51331180-b4df-4ff2-8b78-62070bb029c9 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.330299 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51331180-b4df-4ff2-8b78-62070bb029c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.332267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51331180-b4df-4ff2-8b78-62070bb029c9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.371031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 788/1583] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:27 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:27.372372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc40b64-d420-4ada-b2e4-9c3bfbbd863e None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.372719 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc40b64-d420-4ada-b2e4-9c3bfbbd863e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.373053 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc40b64-d420-4ada-b2e4-9c3bfbbd863e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.389869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-bdc40b64-d420-4ada-b2e4-9c3bfbbd863e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:27.391094 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-bdc40b64-d420-4ada-b2e4-9c3bfbbd863e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:27.398920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 789/1584] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:27.399689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc40b64-d420-4ada-b2e4-9c3bfbbd863e None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.408962 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc40b64-d420-4ada-b2e4-9c3bfbbd863e None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.414088 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18196d-6b32-4839-b604-0dcf06fddbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.414946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18196d-6b32-4839-b604-0dcf06fddbf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.415240 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18196d-6b32-4839-b604-0dcf06fddbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.415520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd18196d-6b32-4839-b604-0dcf06fddbf3 admin admin] PATH_INFO: `/v3/projects/d551ab6c12f94141ad2123a8c631e98d/users/b030acfe033d4d6d8cca6f79d02594a7/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.430757 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18196d-6b32-4839-b604-0dcf06fddbf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d551ab6c12f94141ad2123a8c631e98d, user_id=b030acfe033d4d6d8cca6f79d02594a7, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.433411 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd18196d-6b32-4839-b604-0dcf06fddbf3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.452457 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 796/1585] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:27 2022] POST /identity/v3/users => generated 288 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:27.484197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51331180-b4df-4ff2-8b78-62070bb029c9 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.484197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51331180-b4df-4ff2-8b78-62070bb029c9 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.484197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ba96a-7c8c-42ef-a9ea-d918c62ecc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.484197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ba96a-7c8c-42ef-a9ea-d918c62ecc97 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.484661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ba96a-7c8c-42ef-a9ea-d918c62ecc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.484661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ba96a-7c8c-42ef-a9ea-d918c62ecc97 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.484661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ba96a-7c8c-42ef-a9ea-d918c62ecc97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.484661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ba96a-7c8c-42ef-a9ea-d918c62ecc97 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.566572 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 790/1586] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:27 2022] PUT /identity/v3/projects/d551ab6c12f94141ad2123a8c631e98d/users/b030acfe033d4d6d8cca6f79d02594a7/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:27.567532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18196d-6b32-4839-b604-0dcf06fddbf3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.584064 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 797/1587] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:27 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:27.584973 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ba96a-7c8c-42ef-a9ea-d918c62ecc97 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.594358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ba96a-7c8c-42ef-a9ea-d918c62ecc97 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.633105 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd18196d-6b32-4839-b604-0dcf06fddbf3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.637933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96033c13-ace1-4912-86c0-8231875596a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.638605 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96033c13-ace1-4912-86c0-8231875596a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.638893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96033c13-ace1-4912-86c0-8231875596a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.639173 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96033c13-ace1-4912-86c0-8231875596a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.640053 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96033c13-ace1-4912-86c0-8231875596a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.641817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96033c13-ace1-4912-86c0-8231875596a6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.652830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5c9c0-146a-4914-8dba-1a20453d0bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.653490 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 791/1588] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:27.653601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5c9c0-146a-4914-8dba-1a20453d0bc8 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.653786 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5c9c0-146a-4914-8dba-1a20453d0bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.654059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5c9c0-146a-4914-8dba-1a20453d0bc8 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.654460 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96033c13-ace1-4912-86c0-8231875596a6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.654762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5c9c0-146a-4914-8dba-1a20453d0bc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.656672 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5c9c0-146a-4914-8dba-1a20453d0bc8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.664864 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96033c13-ace1-4912-86c0-8231875596a6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.669658 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a9c4e-a3f4-4f07-95a6-a51b1c7e2964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.670328 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a9c4e-a3f4-4f07-95a6-a51b1c7e2964 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.670614 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a9c4e-a3f4-4f07-95a6-a51b1c7e2964 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.670897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a9c4e-a3f4-4f07-95a6-a51b1c7e2964 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.671654 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a9c4e-a3f4-4f07-95a6-a51b1c7e2964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.673251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a9c4e-a3f4-4f07-95a6-a51b1c7e2964 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.683045 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 792/1589] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:27.683882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a9c4e-a3f4-4f07-95a6-a51b1c7e2964 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.693260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a9c4e-a3f4-4f07-95a6-a51b1c7e2964 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.697838 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913e31d-48bc-4b02-9cef-c4158caa5718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.698437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913e31d-48bc-4b02-9cef-c4158caa5718 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.698720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913e31d-48bc-4b02-9cef-c4158caa5718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.698994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4913e31d-48bc-4b02-9cef-c4158caa5718 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.699733 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913e31d-48bc-4b02-9cef-c4158caa5718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.701314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4913e31d-48bc-4b02-9cef-c4158caa5718 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.711273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 793/1590] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:27.712029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913e31d-48bc-4b02-9cef-c4158caa5718 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.733626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 798/1591] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:27 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:27.733626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5c9c0-146a-4914-8dba-1a20453d0bc8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.743085 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5c9c0-146a-4914-8dba-1a20453d0bc8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.748093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed647632-4fe6-4d3a-a9b6-818f56e0023f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.748870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed647632-4fe6-4d3a-a9b6-818f56e0023f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.749228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed647632-4fe6-4d3a-a9b6-818f56e0023f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.749574 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed647632-4fe6-4d3a-a9b6-818f56e0023f admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.750443 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed647632-4fe6-4d3a-a9b6-818f56e0023f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.752256 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed647632-4fe6-4d3a-a9b6-818f56e0023f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.762737 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 799/1592] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:27.764103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccd119-b4ef-4e98-89f6-ef54bfffd8ec None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.767419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccd119-b4ef-4e98-89f6-ef54bfffd8ec None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.767419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccd119-b4ef-4e98-89f6-ef54bfffd8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.767605 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4913e31d-48bc-4b02-9cef-c4158caa5718 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.771952 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294645b3-c2f0-49a1-86c4-5ddefb1551e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.772589 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294645b3-c2f0-49a1-86c4-5ddefb1551e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.772867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294645b3-c2f0-49a1-86c4-5ddefb1551e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.773141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294645b3-c2f0-49a1-86c4-5ddefb1551e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.782539 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294645b3-c2f0-49a1-86c4-5ddefb1551e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.783982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294645b3-c2f0-49a1-86c4-5ddefb1551e7 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.784289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-16ccd119-b4ef-4e98-89f6-ef54bfffd8ec None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:27.785472 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-16ccd119-b4ef-4e98-89f6-ef54bfffd8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:27.794111 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 800/1593] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:27.794908 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccd119-b4ef-4e98-89f6-ef54bfffd8ec None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.795050 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 794/1594] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:27.795944 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294645b3-c2f0-49a1-86c4-5ddefb1551e7 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.806593 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccd119-b4ef-4e98-89f6-ef54bfffd8ec None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.809335 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294645b3-c2f0-49a1-86c4-5ddefb1551e7 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.811998 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffa70b-d1b5-4d74-a6af-cb0b4676d11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.812836 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffa70b-d1b5-4d74-a6af-cb0b4676d11c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.813262 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffa70b-d1b5-4d74-a6af-cb0b4676d11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.813740 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ffa70b-d1b5-4d74-a6af-cb0b4676d11c admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.814176 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2e7c3-03f7-408b-be23-475adbd0dc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.814835 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffa70b-d1b5-4d74-a6af-cb0b4676d11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.815041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2e7c3-03f7-408b-be23-475adbd0dc48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.815368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2e7c3-03f7-408b-be23-475adbd0dc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.815646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa2e7c3-03f7-408b-be23-475adbd0dc48 admin admin] PATH_INFO: `/v3/projects/a83d4bf3604840f4be5877a0081825e7/users/79b9e6bee639494ba78fb2117d51239f/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.816439 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ffa70b-d1b5-4d74-a6af-cb0b4676d11c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.826485 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 801/1595] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:27.827323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffa70b-d1b5-4d74-a6af-cb0b4676d11c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.834200 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2e7c3-03f7-408b-be23-475adbd0dc48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83d4bf3604840f4be5877a0081825e7, user_id=79b9e6bee639494ba78fb2117d51239f, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.836901 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa2e7c3-03f7-408b-be23-475adbd0dc48 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.837935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ffa70b-d1b5-4d74-a6af-cb0b4676d11c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.842481 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dff2e2-466d-47d3-a681-763a61ac5e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.843122 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dff2e2-466d-47d3-a681-763a61ac5e35 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.843442 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dff2e2-466d-47d3-a681-763a61ac5e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.843714 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dff2e2-466d-47d3-a681-763a61ac5e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.844440 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dff2e2-466d-47d3-a681-763a61ac5e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.846012 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dff2e2-466d-47d3-a681-763a61ac5e35 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.855767 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 802/1596] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:27.859437 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dff2e2-466d-47d3-a681-763a61ac5e35 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.865954 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dff2e2-466d-47d3-a681-763a61ac5e35 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.870504 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b9666-053f-4c9e-b0f4-fe3b70cb85e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.871122 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b9666-053f-4c9e-b0f4-fe3b70cb85e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.871429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b9666-053f-4c9e-b0f4-fe3b70cb85e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.871698 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b9666-053f-4c9e-b0f4-fe3b70cb85e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.872523 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b9666-053f-4c9e-b0f4-fe3b70cb85e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.874070 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893b9666-053f-4c9e-b0f4-fe3b70cb85e5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.884553 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 803/1597] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:27.885257 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b9666-053f-4c9e-b0f4-fe3b70cb85e5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.894146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b9666-053f-4c9e-b0f4-fe3b70cb85e5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.899173 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da47234-6b8d-4940-bf7e-7ce79902d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.899797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da47234-6b8d-4940-bf7e-7ce79902d596 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.900073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da47234-6b8d-4940-bf7e-7ce79902d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.900348 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da47234-6b8d-4940-bf7e-7ce79902d596 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.901326 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da47234-6b8d-4940-bf7e-7ce79902d596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.902840 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da47234-6b8d-4940-bf7e-7ce79902d596 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.912350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 804/1598] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:27.913117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da47234-6b8d-4940-bf7e-7ce79902d596 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.922158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da47234-6b8d-4940-bf7e-7ce79902d596 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:27.926752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed2ecb-98fb-4130-9973-bbf6615019c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:27.927411 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed2ecb-98fb-4130-9973-bbf6615019c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:27.927689 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed2ecb-98fb-4130-9973-bbf6615019c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:27.927957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed2ecb-98fb-4130-9973-bbf6615019c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:27.928670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed2ecb-98fb-4130-9973-bbf6615019c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:27.930215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed2ecb-98fb-4130-9973-bbf6615019c0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:27.939313 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 795/1599] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:27 2022] PUT /identity/v3/projects/a83d4bf3604840f4be5877a0081825e7/users/79b9e6bee639494ba78fb2117d51239f/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:27.944411 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 805/1600] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:27.944411 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed2ecb-98fb-4130-9973-bbf6615019c0 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.944818 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2e7c3-03f7-408b-be23-475adbd0dc48 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:27.953139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed2ecb-98fb-4130-9973-bbf6615019c0 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:28.005362 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa2e7c3-03f7-408b-be23-475adbd0dc48 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:28.009145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab869b85-15d8-4a50-bd4e-e83c17329b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:28.009788 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab869b85-15d8-4a50-bd4e-e83c17329b47 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.010534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab869b85-15d8-4a50-bd4e-e83c17329b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.010534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab869b85-15d8-4a50-bd4e-e83c17329b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:28.012582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929755cf-de9f-4ce9-bb92-be5eae66e781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:28.013241 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929755cf-de9f-4ce9-bb92-be5eae66e781 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.013521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929755cf-de9f-4ce9-bb92-be5eae66e781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.013789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929755cf-de9f-4ce9-bb92-be5eae66e781 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:28.014514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929755cf-de9f-4ce9-bb92-be5eae66e781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:28.016419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929755cf-de9f-4ce9-bb92-be5eae66e781 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:28.019538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab869b85-15d8-4a50-bd4e-e83c17329b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:28.021187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab869b85-15d8-4a50-bd4e-e83c17329b47 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:28.026675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 806/1601] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:28.027494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929755cf-de9f-4ce9-bb92-be5eae66e781 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:28.031632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 796/1602] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:28.032429 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab869b85-15d8-4a50-bd4e-e83c17329b47 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:28.037729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929755cf-de9f-4ce9-bb92-be5eae66e781 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:28.042426 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf2787-8b71-4da4-bcfc-56cd329b4ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:28.043369 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2787-8b71-4da4-bcfc-56cd329b4ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.043506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab869b85-15d8-4a50-bd4e-e83c17329b47 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:28.043681 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2787-8b71-4da4-bcfc-56cd329b4ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.044006 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bf2787-8b71-4da4-bcfc-56cd329b4ad6 admin admin] PATH_INFO: `/v3/projects/be2efad4da384b669f8e000fc5c25830/users/5e95a2f25a1b40af90995bdb6f871e3c/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:28.048380 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b0191e-6e59-43cd-a7e5-9a4be84327eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:28.049237 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0191e-6e59-43cd-a7e5-9a4be84327eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.049517 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0191e-6e59-43cd-a7e5-9a4be84327eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.049818 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b0191e-6e59-43cd-a7e5-9a4be84327eb admin admin] PATH_INFO: `/v3/projects/eb594a2ed9f94d8ca9cb7806609ad9f1/users/0568be0798cd4fc388fe6338d3334c78/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:28.059853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf2787-8b71-4da4-bcfc-56cd329b4ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2efad4da384b669f8e000fc5c25830, user_id=5e95a2f25a1b40af90995bdb6f871e3c, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:28.062513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bf2787-8b71-4da4-bcfc-56cd329b4ad6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:28.070535 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0191e-6e59-43cd-a7e5-9a4be84327eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb594a2ed9f94d8ca9cb7806609ad9f1, user_id=0568be0798cd4fc388fe6338d3334c78, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:28.073273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b0191e-6e59-43cd-a7e5-9a4be84327eb admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:28.163798 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 807/1603] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:28 2022] PUT /identity/v3/projects/be2efad4da384b669f8e000fc5c25830/users/5e95a2f25a1b40af90995bdb6f871e3c/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:28.168213 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf2787-8b71-4da4-bcfc-56cd329b4ad6 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:28.186508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 797/1604] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:28 2022] PUT /identity/v3/projects/eb594a2ed9f94d8ca9cb7806609ad9f1/users/0568be0798cd4fc388fe6338d3334c78/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:28.190264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ee1f4-32f5-43bc-99fb-5c84ba45eda1 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.190264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ee1f4-32f5-43bc-99fb-5c84ba45eda1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.190264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ee1f4-32f5-43bc-99fb-5c84ba45eda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:28.243168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-863ee1f4-32f5-43bc-99fb-5c84ba45eda1 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:28.243958 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bf2787-8b71-4da4-bcfc-56cd329b4ad6 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:28.247661 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-863ee1f4-32f5-43bc-99fb-5c84ba45eda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:28.308678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f302c3-6a2d-4851-9f43-0c04e91f31ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:28.309656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f302c3-6a2d-4851-9f43-0c04e91f31ab admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.310036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f302c3-6a2d-4851-9f43-0c04e91f31ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.310410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f302c3-6a2d-4851-9f43-0c04e91f31ab admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:28.311285 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f302c3-6a2d-4851-9f43-0c04e91f31ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:28.313478 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f302c3-6a2d-4851-9f43-0c04e91f31ab admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:28.314463 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 798/1605] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:28.315718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ee1f4-32f5-43bc-99fb-5c84ba45eda1 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:28.326841 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 808/1606] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:28 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:28.332340 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f302c3-6a2d-4851-9f43-0c04e91f31ab admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:28.337953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ee1f4-32f5-43bc-99fb-5c84ba45eda1 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:28.344106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4825d9-fa11-4a9b-a196-14f8d15c7b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:28.345195 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4825d9-fa11-4a9b-a196-14f8d15c7b7c admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.345920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4825d9-fa11-4a9b-a196-14f8d15c7b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.346208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4825d9-fa11-4a9b-a196-14f8d15c7b7c admin admin] PATH_INFO: `/v3/projects/a106e82a340945c78b398a2c8465107e/users/1763924f0aad40f58707801e83f1c21e/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:28.347190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f302c3-6a2d-4851-9f43-0c04e91f31ab admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:28.355648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91278c8c-1fe6-4b2d-9b2d-51b49ef4a75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:28.357198 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91278c8c-1fe6-4b2d-9b2d-51b49ef4a75f admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.363411 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91278c8c-1fe6-4b2d-9b2d-51b49ef4a75f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.363411 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91278c8c-1fe6-4b2d-9b2d-51b49ef4a75f admin admin] PATH_INFO: `/v3/projects/6ca538d34a494414ae588c331a3bab1e/users/083f3be983df469bab10ba61a0fad062/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:28.365506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4825d9-fa11-4a9b-a196-14f8d15c7b7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a106e82a340945c78b398a2c8465107e, user_id=1763924f0aad40f58707801e83f1c21e, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:28.368879 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4825d9-fa11-4a9b-a196-14f8d15c7b7c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:28.379056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91278c8c-1fe6-4b2d-9b2d-51b49ef4a75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ca538d34a494414ae588c331a3bab1e, user_id=083f3be983df469bab10ba61a0fad062, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:28.382057 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91278c8c-1fe6-4b2d-9b2d-51b49ef4a75f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:28.439475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 799/1607] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:28 2022] PUT /identity/v3/projects/a106e82a340945c78b398a2c8465107e/users/1763924f0aad40f58707801e83f1c21e/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:28.440884 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e526c-4234-47de-95a9-4dbe5eb6b283 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.443590 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e526c-4234-47de-95a9-4dbe5eb6b283 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.443590 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e526c-4234-47de-95a9-4dbe5eb6b283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:28.460180 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-433e526c-4234-47de-95a9-4dbe5eb6b283 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:28.461451 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-433e526c-4234-47de-95a9-4dbe5eb6b283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:28.495425 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 809/1608] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:28 2022] PUT /identity/v3/projects/6ca538d34a494414ae588c331a3bab1e/users/083f3be983df469bab10ba61a0fad062/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:28.496837 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4c955-b319-4175-b986-69fe704c56ba None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.497772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4c955-b319-4175-b986-69fe704c56ba None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.498053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4c955-b319-4175-b986-69fe704c56ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:28.535762 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 800/1609] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:28.537546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e526c-4234-47de-95a9-4dbe5eb6b283 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:28.553577 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-54d4c955-b319-4175-b986-69fe704c56ba None None] MFA Rules not processed for user `0568be0798cd4fc388fe6338d3334c78`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:28.555504 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-54d4c955-b319-4175-b986-69fe704c56ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:28.599715 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e526c-4234-47de-95a9-4dbe5eb6b283 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:28.629030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 810/1610] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:28.629030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4c955-b319-4175-b986-69fe704c56ba None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:28.654682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c4bbc-5505-46a8-9f80-7ae5d971a7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:28.660884 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c4bbc-5505-46a8-9f80-7ae5d971a7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.660884 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c4bbc-5505-46a8-9f80-7ae5d971a7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.660884 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c4bbc-5505-46a8-9f80-7ae5d971a7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:28.711008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4c955-b319-4175-b986-69fe704c56ba None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:28.717673 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579339e-2506-4e58-9ab4-7e2310f947b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:28.718738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579339e-2506-4e58-9ab4-7e2310f947b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.719068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579339e-2506-4e58-9ab4-7e2310f947b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.719440 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a579339e-2506-4e58-9ab4-7e2310f947b1 admin admin] PATH_INFO: `/v3/projects/873a37121e2f41548f1e6f6e2dd0cd7e/users/54439b72f4af4cbaae41645eb301d6a8/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:28.729257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c4bbc-5505-46a8-9f80-7ae5d971a7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:28.730938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c4bbc-5505-46a8-9f80-7ae5d971a7a0 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:28.738366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579339e-2506-4e58-9ab4-7e2310f947b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873a37121e2f41548f1e6f6e2dd0cd7e, user_id=54439b72f4af4cbaae41645eb301d6a8, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:28.741757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a579339e-2506-4e58-9ab4-7e2310f947b1 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:28.743196 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 801/1611] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:28.744836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e8ede-4398-462a-b5d5-70d8fd5a4f45 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.745174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e8ede-4398-462a-b5d5-70d8fd5a4f45 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.745514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e8ede-4398-462a-b5d5-70d8fd5a4f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:28.780644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-047e8ede-4398-462a-b5d5-70d8fd5a4f45 None None] MFA Rules not processed for user `1763924f0aad40f58707801e83f1c21e`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:28.782005 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-047e8ede-4398-462a-b5d5-70d8fd5a4f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:28.831815 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 811/1612] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:28 2022] PUT /identity/v3/projects/873a37121e2f41548f1e6f6e2dd0cd7e/users/54439b72f4af4cbaae41645eb301d6a8/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:28.833731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579339e-2506-4e58-9ab4-7e2310f947b1 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:28.869559 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 802/1613] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:28.871742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95acd-487a-4b45-b8ff-8b73f9a20347 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.872141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95acd-487a-4b45-b8ff-8b73f9a20347 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.872520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95acd-487a-4b45-b8ff-8b73f9a20347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:28.929082 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a579339e-2506-4e58-9ab4-7e2310f947b1 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:28.929638 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-14b95acd-487a-4b45-b8ff-8b73f9a20347 None None] MFA Rules not processed for user `083f3be983df469bab10ba61a0fad062`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:28.932131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-14b95acd-487a-4b45-b8ff-8b73f9a20347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:28.933098 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ab39f-8bdd-4806-88f0-3b3a1b0a80e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:28.933803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ab39f-8bdd-4806-88f0-3b3a1b0a80e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:28.934364 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ab39f-8bdd-4806-88f0-3b3a1b0a80e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:28.934364 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ab39f-8bdd-4806-88f0-3b3a1b0a80e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.029878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ab39f-8bdd-4806-88f0-3b3a1b0a80e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:29.031343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ab39f-8bdd-4806-88f0-3b3a1b0a80e5 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:29.039315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 803/1614] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:29.039315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0149e-190b-4b47-ab7f-880c30a87131 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:29.039315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0149e-190b-4b47-ab7f-880c30a87131 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:29.039315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0149e-190b-4b47-ab7f-880c30a87131 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.041014 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 804/1615] 10.222.0.35 () {54 vars in 961 bytes} [Sat Feb 12 04:33:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:33:29.042357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f657b4d-ab13-4810-891d-82431f2cff68 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:29.042562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f657b4d-ab13-4810-891d-82431f2cff68 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:29.042827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f657b4d-ab13-4810-891d-82431f2cff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.050597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 812/1616] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:29.052494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e743af-0068-4138-b7e8-54ee662dbe2d None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:29.053698 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e743af-0068-4138-b7e8-54ee662dbe2d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:29.054048 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e743af-0068-4138-b7e8-54ee662dbe2d None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.056135 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 813/1617] 10.222.0.35 () {54 vars in 961 bytes} [Sat Feb 12 04:33:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:33:29.056772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e743af-0068-4138-b7e8-54ee662dbe2d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:29.079775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-5f657b4d-ab13-4810-891d-82431f2cff68 None None] MFA Rules not processed for user `54439b72f4af4cbaae41645eb301d6a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:29.080479 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e743af-0068-4138-b7e8-54ee662dbe2d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:29.081016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5f657b4d-ab13-4810-891d-82431f2cff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:29.086876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd650daa-03f8-4d92-b37f-2fd96532067e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:29.087683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd650daa-03f8-4d92-b37f-2fd96532067e admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:29.088030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd650daa-03f8-4d92-b37f-2fd96532067e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:29.088390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd650daa-03f8-4d92-b37f-2fd96532067e admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.089181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd650daa-03f8-4d92-b37f-2fd96532067e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:29.091203 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd650daa-03f8-4d92-b37f-2fd96532067e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:29.155275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 805/1618] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:29.159219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa44e65-a7e2-4c4a-8aa1-328847b98196 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:29.159219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa44e65-a7e2-4c4a-8aa1-328847b98196 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:29.159219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa44e65-a7e2-4c4a-8aa1-328847b98196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.169550 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 814/1619] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:29 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:29.170884 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb5d24-d7e3-4298-876c-55ac0e21c3cc None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:29.171626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb5d24-d7e3-4298-876c-55ac0e21c3cc None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:29.171626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb5d24-d7e3-4298-876c-55ac0e21c3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.191174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-dfa44e65-a7e2-4c4a-8aa1-328847b98196 None None] MFA Rules not processed for user `362ab4aeb88746d8b8a14a238c877a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:29.193065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-0dcb5d24-d7e3-4298-876c-55ac0e21c3cc None None] MFA Rules not processed for user `362ab4aeb88746d8b8a14a238c877a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:29.193314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-dfa44e65-a7e2-4c4a-8aa1-328847b98196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:29.193797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0dcb5d24-d7e3-4298-876c-55ac0e21c3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:29.290838 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 815/1620] 10.222.0.35 () {58 vars in 1058 bytes} [Sat Feb 12 04:33:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:29.291788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb5d24-d7e3-4298-876c-55ac0e21c3cc None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:29.304091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 806/1621] 10.222.0.35 () {58 vars in 1058 bytes} [Sat Feb 12 04:33:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:29.304839 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa44e65-a7e2-4c4a-8aa1-328847b98196 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:29.377051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb5d24-d7e3-4298-876c-55ac0e21c3cc None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:29.383133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e7c53-31d2-4ef7-b3c1-a90334b5cb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:29.383685 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa44e65-a7e2-4c4a-8aa1-328847b98196 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:29.384238 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e7c53-31d2-4ef7-b3c1-a90334b5cb3c admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:29.384817 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e7c53-31d2-4ef7-b3c1-a90334b5cb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:29.385242 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e7c53-31d2-4ef7-b3c1-a90334b5cb3c admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.386179 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e7c53-31d2-4ef7-b3c1-a90334b5cb3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:29.388568 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e7c53-31d2-4ef7-b3c1-a90334b5cb3c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:29.388983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470757c-bfb1-4db9-a8f8-42df32c5d35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:29.389655 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470757c-bfb1-4db9-a8f8-42df32c5d35c admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:29.389934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470757c-bfb1-4db9-a8f8-42df32c5d35c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:29.390209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470757c-bfb1-4db9-a8f8-42df32c5d35c admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.390910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470757c-bfb1-4db9-a8f8-42df32c5d35c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:29.401571 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470757c-bfb1-4db9-a8f8-42df32c5d35c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:29.489416 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 816/1622] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:29 2022] POST /identity/v3/projects => generated 371 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:29.490334 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e7c53-31d2-4ef7-b3c1-a90334b5cb3c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:29.521633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 807/1623] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:29 2022] POST /identity/v3/users => generated 296 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:29.527397 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470757c-bfb1-4db9-a8f8-42df32c5d35c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:29.545902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470757c-bfb1-4db9-a8f8-42df32c5d35c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:29.599525 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e7c53-31d2-4ef7-b3c1-a90334b5cb3c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:29.606084 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5207798-cbd7-47ca-b510-d02cb2d3cf11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:29.607078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5207798-cbd7-47ca-b510-d02cb2d3cf11 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:29.608463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5207798-cbd7-47ca-b510-d02cb2d3cf11 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:29.608964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5207798-cbd7-47ca-b510-d02cb2d3cf11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.640836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35271ea-2717-4e01-ac62-9686abcdc70d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:29.641612 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35271ea-2717-4e01-ac62-9686abcdc70d service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:29.641895 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35271ea-2717-4e01-ac62-9686abcdc70d service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:29.642175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35271ea-2717-4e01-ac62-9686abcdc70d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.675204 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5207798-cbd7-47ca-b510-d02cb2d3cf11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:29.677988 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5207798-cbd7-47ca-b510-d02cb2d3cf11 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:29.690614 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 817/1624] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:29.691892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5207798-cbd7-47ca-b510-d02cb2d3cf11 service nova] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:29.764547 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35271ea-2717-4e01-ac62-9686abcdc70d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:29.765975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35271ea-2717-4e01-ac62-9686abcdc70d service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:29.784071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 808/1625] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:29.784805 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35271ea-2717-4e01-ac62-9686abcdc70d service nova] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:29.814279 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5207798-cbd7-47ca-b510-d02cb2d3cf11 service nova] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:29.814703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35271ea-2717-4e01-ac62-9686abcdc70d service nova] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:29.820738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915192f-c536-47f7-a78d-8d42fd6d1e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:29.820910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915192f-c536-47f7-a78d-8d42fd6d1e65 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:29.821306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915192f-c536-47f7-a78d-8d42fd6d1e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:29.821608 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915192f-c536-47f7-a78d-8d42fd6d1e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.822353 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915192f-c536-47f7-a78d-8d42fd6d1e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:29.823734 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee3d70-a1e5-4809-b8fa-e354556f983c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:29.823974 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915192f-c536-47f7-a78d-8d42fd6d1e65 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:29.824418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee3d70-a1e5-4809-b8fa-e354556f983c admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:29.824699 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee3d70-a1e5-4809-b8fa-e354556f983c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:29.824973 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee3d70-a1e5-4809-b8fa-e354556f983c admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.826860 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee3d70-a1e5-4809-b8fa-e354556f983c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:29.832752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee3d70-a1e5-4809-b8fa-e354556f983c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:29.851742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 809/1626] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:29.853154 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915192f-c536-47f7-a78d-8d42fd6d1e65 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:29.872454 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915192f-c536-47f7-a78d-8d42fd6d1e65 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:29.879452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafdcaf-4d66-4191-854d-28d1d8f6335b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:29.881164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafdcaf-4d66-4191-854d-28d1d8f6335b admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:29.881617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafdcaf-4d66-4191-854d-28d1d8f6335b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:29.882046 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfafdcaf-4d66-4191-854d-28d1d8f6335b admin admin] PATH_INFO: `/v3/projects/a81920da22d9449b87859d57a78e5331/users/19020356f13a400aaeeaabb5ab2692ae/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.914089 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafdcaf-4d66-4191-854d-28d1d8f6335b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81920da22d9449b87859d57a78e5331, user_id=19020356f13a400aaeeaabb5ab2692ae, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:29.917078 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfafdcaf-4d66-4191-854d-28d1d8f6335b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:29.952711 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 818/1627] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:29 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:29.952711 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee3d70-a1e5-4809-b8fa-e354556f983c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:29.967631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee3d70-a1e5-4809-b8fa-e354556f983c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:29.981502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fadc6f-6251-49e3-b9d8-4aa17fd01b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:29.982189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fadc6f-6251-49e3-b9d8-4aa17fd01b81 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:29.982471 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fadc6f-6251-49e3-b9d8-4aa17fd01b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:29.982744 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fadc6f-6251-49e3-b9d8-4aa17fd01b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:29.983772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fadc6f-6251-49e3-b9d8-4aa17fd01b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:29.985370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fadc6f-6251-49e3-b9d8-4aa17fd01b81 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:30.017036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 819/1628] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:33:30.019168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fadc6f-6251-49e3-b9d8-4aa17fd01b81 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:30.036971 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fadc6f-6251-49e3-b9d8-4aa17fd01b81 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:30.049714 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 810/1629] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:29 2022] PUT /identity/v3/projects/a81920da22d9449b87859d57a78e5331/users/19020356f13a400aaeeaabb5ab2692ae/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:30.050823 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafdcaf-4d66-4191-854d-28d1d8f6335b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:30.144978 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2087c75-f0cd-4f40-b52f-229b7a7ba213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:30.146081 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2087c75-f0cd-4f40-b52f-229b7a7ba213 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:30.146363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2087c75-f0cd-4f40-b52f-229b7a7ba213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:30.147079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2087c75-f0cd-4f40-b52f-229b7a7ba213 admin admin] PATH_INFO: `/v3/projects/1aea36d52fd3407a893ce427a7111b16/users/5bcc6bd867c14d95a27102d5636b4cc5/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:30.185106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfafdcaf-4d66-4191-854d-28d1d8f6335b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:30.191634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587676c-a9a5-4ad9-b353-d9d16cd4479e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:30.192476 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587676c-a9a5-4ad9-b353-d9d16cd4479e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:30.192584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2087c75-f0cd-4f40-b52f-229b7a7ba213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aea36d52fd3407a893ce427a7111b16, user_id=5bcc6bd867c14d95a27102d5636b4cc5, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:30.192984 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587676c-a9a5-4ad9-b353-d9d16cd4479e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:30.193322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587676c-a9a5-4ad9-b353-d9d16cd4479e admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:30.195048 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587676c-a9a5-4ad9-b353-d9d16cd4479e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:30.196802 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587676c-a9a5-4ad9-b353-d9d16cd4479e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:30.198418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2087c75-f0cd-4f40-b52f-229b7a7ba213 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:30.211840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 811/1630] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:30.211840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb7453-1a7c-4901-bc7a-36423901975c None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:30.211840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb7453-1a7c-4901-bc7a-36423901975c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:30.211840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb7453-1a7c-4901-bc7a-36423901975c None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:30.215613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 812/1631] 10.222.0.35 () {54 vars in 912 bytes} [Sat Feb 12 04:33:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:33:30.217374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a21fea-52e5-4a89-85a0-7c0a38d560c3 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:30.217948 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a21fea-52e5-4a89-85a0-7c0a38d560c3 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:30.218775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a21fea-52e5-4a89-85a0-7c0a38d560c3 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:30.227578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 813/1632] 10.222.0.35 () {54 vars in 912 bytes} [Sat Feb 12 04:33:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:33:30.228872 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a21fea-52e5-4a89-85a0-7c0a38d560c3 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:30.259021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a21fea-52e5-4a89-85a0-7c0a38d560c3 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:30.265082 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8d3af8-11ff-414a-a7e1-dd850b7f4d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:30.266706 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d3af8-11ff-414a-a7e1-dd850b7f4d71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:30.267257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d3af8-11ff-414a-a7e1-dd850b7f4d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:30.267858 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8d3af8-11ff-414a-a7e1-dd850b7f4d71 admin admin] PATH_INFO: `/v3/projects/a81920da22d9449b87859d57a78e5331/users/19020356f13a400aaeeaabb5ab2692ae/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:30.271437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d3af8-11ff-414a-a7e1-dd850b7f4d71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a81920da22d9449b87859d57a78e5331, user_id=19020356f13a400aaeeaabb5ab2692ae, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:30.283505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8d3af8-11ff-414a-a7e1-dd850b7f4d71 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:30.300335 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 820/1633] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:30 2022] PUT /identity/v3/projects/1aea36d52fd3407a893ce427a7111b16/users/5bcc6bd867c14d95a27102d5636b4cc5/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:33:30.302846 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634d0b2-431d-4c7b-be76-149f458a9081 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:30.303933 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634d0b2-431d-4c7b-be76-149f458a9081 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:30.305062 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634d0b2-431d-4c7b-be76-149f458a9081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:30.329489 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 814/1634] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:30 2022] PUT /identity/v3/projects/a81920da22d9449b87859d57a78e5331/users/19020356f13a400aaeeaabb5ab2692ae/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:30.334751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866deff1-c317-4570-8d86-b8378c889dc7 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:30.336942 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866deff1-c317-4570-8d86-b8378c889dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:30.337726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866deff1-c317-4570-8d86-b8378c889dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:30.354805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-6634d0b2-431d-4c7b-be76-149f458a9081 None None] MFA Rules not processed for user `362ab4aeb88746d8b8a14a238c877a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:30.362883 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-6634d0b2-431d-4c7b-be76-149f458a9081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:30.371481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-866deff1-c317-4570-8d86-b8378c889dc7 None None] MFA Rules not processed for user `362ab4aeb88746d8b8a14a238c877a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:30.372896 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-866deff1-c317-4570-8d86-b8378c889dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:30.487583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 821/1635] 10.222.0.35 () {58 vars in 1009 bytes} [Sat Feb 12 04:33:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:30.490068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634d0b2-431d-4c7b-be76-149f458a9081 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:30.526251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 815/1636] 10.222.0.35 () {58 vars in 1009 bytes} [Sat Feb 12 04:33:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:30.527696 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe15d28-3f56-4b6c-bc00-1ba4f8eb0d6d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:30.527993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe15d28-3f56-4b6c-bc00-1ba4f8eb0d6d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:30.528270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe15d28-3f56-4b6c-bc00-1ba4f8eb0d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:30.586869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-fbe15d28-3f56-4b6c-bc00-1ba4f8eb0d6d None None] MFA Rules not processed for user `19020356f13a400aaeeaabb5ab2692ae`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:30.594533 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-fbe15d28-3f56-4b6c-bc00-1ba4f8eb0d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:30.638510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634d0b2-431d-4c7b-be76-149f458a9081 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:30.645067 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b07771-4b8a-4bd0-9f04-28109efee076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:30.646595 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b07771-4b8a-4bd0-9f04-28109efee076 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:30.647301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b07771-4b8a-4bd0-9f04-28109efee076 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:30.647600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b07771-4b8a-4bd0-9f04-28109efee076 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:30.648732 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b07771-4b8a-4bd0-9f04-28109efee076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:30.651566 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b07771-4b8a-4bd0-9f04-28109efee076 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:30.669532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 822/1637] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:30.670576 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b07771-4b8a-4bd0-9f04-28109efee076 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:30.754316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b07771-4b8a-4bd0-9f04-28109efee076 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:30.758948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7250b3-3e9a-41a6-b5fd-b48157b54f2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:30.759698 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7250b3-3e9a-41a6-b5fd-b48157b54f2c service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:30.759984 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7250b3-3e9a-41a6-b5fd-b48157b54f2c service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:30.760523 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7250b3-3e9a-41a6-b5fd-b48157b54f2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:30.762881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 816/1638] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:30.763923 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe15d28-3f56-4b6c-bc00-1ba4f8eb0d6d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:30.777698 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7250b3-3e9a-41a6-b5fd-b48157b54f2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:30.780054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7250b3-3e9a-41a6-b5fd-b48157b54f2c service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:30.783591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe15d28-3f56-4b6c-bc00-1ba4f8eb0d6d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:30.791559 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582693e2-785c-45f9-8475-b4d8982eb63f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:30.792330 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582693e2-785c-45f9-8475-b4d8982eb63f service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:30.795391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582693e2-785c-45f9-8475-b4d8982eb63f service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:30.795391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582693e2-785c-45f9-8475-b4d8982eb63f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:30.798884 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 823/1639] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:30.800303 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7250b3-3e9a-41a6-b5fd-b48157b54f2c service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:30.815559 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7250b3-3e9a-41a6-b5fd-b48157b54f2c service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:30.823717 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094458a-8985-4e55-b87d-11a04c085de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:30.824693 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094458a-8985-4e55-b87d-11a04c085de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:30.824975 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094458a-8985-4e55-b87d-11a04c085de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:30.825294 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094458a-8985-4e55-b87d-11a04c085de7 admin admin] PATH_INFO: `/v3/projects/1aea36d52fd3407a893ce427a7111b16/users/5bcc6bd867c14d95a27102d5636b4cc5/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:30.827743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094458a-8985-4e55-b87d-11a04c085de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1aea36d52fd3407a893ce427a7111b16, user_id=5bcc6bd867c14d95a27102d5636b4cc5, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:30.830636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094458a-8985-4e55-b87d-11a04c085de7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:30.839774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582693e2-785c-45f9-8475-b4d8982eb63f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:30.841465 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582693e2-785c-45f9-8475-b4d8982eb63f service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:30.862769 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 824/1640] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:30 2022] PUT /identity/v3/projects/1aea36d52fd3407a893ce427a7111b16/users/5bcc6bd867c14d95a27102d5636b4cc5/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:30.866460 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80ecc3-bff6-4d69-8793-2a4c6d40348a None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:30.866753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80ecc3-bff6-4d69-8793-2a4c6d40348a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:30.870029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80ecc3-bff6-4d69-8793-2a4c6d40348a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:30.891511 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 817/1641] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:30.895784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031a19d-b262-431b-aaaa-857eb4aae68b None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:30.895784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031a19d-b262-431b-aaaa-857eb4aae68b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:30.895784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7031a19d-b262-431b-aaaa-857eb4aae68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:30.948833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-8a80ecc3-bff6-4d69-8793-2a4c6d40348a None None] MFA Rules not processed for user `79b9e6bee639494ba78fb2117d51239f`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:30.956608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8a80ecc3-bff6-4d69-8793-2a4c6d40348a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:30.967561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-7031a19d-b262-431b-aaaa-857eb4aae68b None None] MFA Rules not processed for user `5bcc6bd867c14d95a27102d5636b4cc5`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:30.969239 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-7031a19d-b262-431b-aaaa-857eb4aae68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:31.178605 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 818/1642] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:31.179506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031a19d-b262-431b-aaaa-857eb4aae68b None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:31.235026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 825/1643] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:31.237797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4d2d4-ce40-4358-8b58-c638fd430faa None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:31.238096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4d2d4-ce40-4358-8b58-c638fd430faa None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:31.238379 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4d2d4-ce40-4358-8b58-c638fd430faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:31.295704 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-73f4d2d4-ce40-4358-8b58-c638fd430faa None None] MFA Rules not processed for user `79b9e6bee639494ba78fb2117d51239f`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:31.298115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-73f4d2d4-ce40-4358-8b58-c638fd430faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:31.312553 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 826/1644] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:31.317693 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7031a19d-b262-431b-aaaa-857eb4aae68b None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:31.325093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b7de0-f007-479b-8396-dcb2d334a4b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:31.325672 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b7de0-f007-479b-8396-dcb2d334a4b7 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:31.325957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b7de0-f007-479b-8396-dcb2d334a4b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:31.326236 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b7de0-f007-479b-8396-dcb2d334a4b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:31.495471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b7de0-f007-479b-8396-dcb2d334a4b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:31.495471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b7de0-f007-479b-8396-dcb2d334a4b7 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:31.495471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 819/1645] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:31.768741 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4d2d4-ce40-4358-8b58-c638fd430faa None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:31.784188 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4d2d4-ce40-4358-8b58-c638fd430faa None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:31.791165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e04ab8-fba4-4012-b258-0163553dd457 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:31.791165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e04ab8-fba4-4012-b258-0163553dd457 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:31.791165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e04ab8-fba4-4012-b258-0163553dd457 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:31.791165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e04ab8-fba4-4012-b258-0163553dd457 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:31.800398 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e04ab8-fba4-4012-b258-0163553dd457 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:31.802564 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e04ab8-fba4-4012-b258-0163553dd457 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:31.825051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 827/1646] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:31 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:32.166452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b7de0-f007-479b-8396-dcb2d334a4b7 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:32.350098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b7de0-f007-479b-8396-dcb2d334a4b7 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:32.362343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e04ab8-fba4-4012-b258-0163553dd457 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:32.370712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa126d-cd32-4625-aa1e-dc2fc97d46ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:32.370712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa126d-cd32-4625-aa1e-dc2fc97d46ea service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:32.370967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa126d-cd32-4625-aa1e-dc2fc97d46ea service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:32.371455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa126d-cd32-4625-aa1e-dc2fc97d46ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:32.391821 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa126d-cd32-4625-aa1e-dc2fc97d46ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:32.396008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e04ab8-fba4-4012-b258-0163553dd457 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:32.396339 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfa126d-cd32-4625-aa1e-dc2fc97d46ea service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:32.404090 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddc9f4-a702-41ac-8138-b013f1b98863 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:32.404785 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddc9f4-a702-41ac-8138-b013f1b98863 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:32.405065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddc9f4-a702-41ac-8138-b013f1b98863 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:32.405339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddc9f4-a702-41ac-8138-b013f1b98863 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:32.422442 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 820/1647] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:32.544203 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddc9f4-a702-41ac-8138-b013f1b98863 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:32.545665 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddc9f4-a702-41ac-8138-b013f1b98863 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:32.564909 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 828/1648] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:32.630898 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa126d-cd32-4625-aa1e-dc2fc97d46ea service nova] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:32.646498 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfa126d-cd32-4625-aa1e-dc2fc97d46ea service nova] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:32.664655 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022850-8c14-4634-baee-0332396872cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:32.665790 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022850-8c14-4634-baee-0332396872cf service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:32.666070 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022850-8c14-4634-baee-0332396872cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:32.666437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022850-8c14-4634-baee-0332396872cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:32.750277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a022850-8c14-4634-baee-0332396872cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:32.753128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a022850-8c14-4634-baee-0332396872cf service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:32.766948 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 821/1649] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:33.341129 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddc9f4-a702-41ac-8138-b013f1b98863 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:33.469056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddc9f4-a702-41ac-8138-b013f1b98863 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:33.477255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:33.478354 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:33.478483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:33.479321 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] PATH_INFO: `/v3/users/1763924f0aad40f58707801e83f1c21e` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:33.480889 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1763924f0aad40f58707801e83f1c21e)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:33.482269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING py.warnings [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:33:33.482269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: warnings.warn(msg) Feb 12 04:33:33.482269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: Feb 12 04:33:33.483648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:33.565539 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84503b19-cb6b-4443-82ad-b0208a7c0833 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:33.566080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84503b19-cb6b-4443-82ad-b0208a7c0833 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:33.566080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84503b19-cb6b-4443-82ad-b0208a7c0833 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:33.570782 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 822/1650] 10.222.0.35 () {54 vars in 912 bytes} [Sat Feb 12 04:33:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:33:33.576724 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0065-4ccf-43c2-b7c1-4d47567c16e4 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:33.577206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0065-4ccf-43c2-b7c1-4d47567c16e4 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:33.577677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b0065-4ccf-43c2-b7c1-4d47567c16e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:33.622526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-0a2b0065-4ccf-43c2-b7c1-4d47567c16e4 None None] MFA Rules not processed for user `d9c5541a29cf42f6ab394133baa05fae`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:33.624293 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-0a2b0065-4ccf-43c2-b7c1-4d47567c16e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:33.689279 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 823/1651] 10.222.0.35 () {58 vars in 1009 bytes} [Sat Feb 12 04:33:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:33:33.701839 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b0065-4ccf-43c2-b7c1-4d47567c16e4 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:33.722242 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b0065-4ccf-43c2-b7c1-4d47567c16e4 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:33.730185 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb941642-d65c-449d-92d4-ef64ef11461f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:33.731367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941642-d65c-449d-92d4-ef64ef11461f service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:33.731913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941642-d65c-449d-92d4-ef64ef11461f service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:33.732391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb941642-d65c-449d-92d4-ef64ef11461f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:33.744375 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb941642-d65c-449d-92d4-ef64ef11461f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:33.748749 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb941642-d65c-449d-92d4-ef64ef11461f service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:33.764583 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 824/1652] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:33:33.770124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1763924f0aad40f58707801e83f1c21e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:33.770124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1763924f0aad40f58707801e83f1c21e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:33.770124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1763924f0aad40f58707801e83f1c21e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:33.819797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1763924f0aad40f58707801e83f1c21e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:33.840527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1763924f0aad40f58707801e83f1c21e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:33.927420 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 829/1653] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:33:33 2022] DELETE /identity/v3/users/1763924f0aad40f58707801e83f1c21e => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:33.932354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d53b04-e3df-4715-86bb-25504ee90850 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:33.933771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d53b04-e3df-4715-86bb-25504ee90850 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:33.936515 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d53b04-e3df-4715-86bb-25504ee90850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:33.969035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-84d53b04-e3df-4715-86bb-25504ee90850 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:33.974774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-84d53b04-e3df-4715-86bb-25504ee90850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:34.093357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 825/1654] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:34.141257 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:34.143254 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:34.214376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9d754-5225-49b3-8e3b-1cbe6c85b009 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:34.220967 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de270f5b-d859-4e6e-83bd-fc442a40442a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:34.220967 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de270f5b-d859-4e6e-83bd-fc442a40442a service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:34.220967 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de270f5b-d859-4e6e-83bd-fc442a40442a service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:34.220967 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de270f5b-d859-4e6e-83bd-fc442a40442a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:34.243605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de270f5b-d859-4e6e-83bd-fc442a40442a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:34.245206 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de270f5b-d859-4e6e-83bd-fc442a40442a service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:34.255782 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 830/1655] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:34.800628 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d53b04-e3df-4715-86bb-25504ee90850 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:34.802778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-84d53b04-e3df-4715-86bb-25504ee90850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:34.979042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d53b04-e3df-4715-86bb-25504ee90850 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:34.991787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d03e3f-f583-48d3-88de-f7811e937da9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:34.992458 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d03e3f-f583-48d3-88de-f7811e937da9 service placement] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:34.992744 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d03e3f-f583-48d3-88de-f7811e937da9 service placement] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:34.993025 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d03e3f-f583-48d3-88de-f7811e937da9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:35.000420 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c0d03e3f-f583-48d3-88de-f7811e937da9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:35.036913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d03e3f-f583-48d3-88de-f7811e937da9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:35.043466 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d03e3f-f583-48d3-88de-f7811e937da9 service placement] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:35.063334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 826/1656] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:35.862521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de270f5b-d859-4e6e-83bd-fc442a40442a service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:35.867775 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-de270f5b-d859-4e6e-83bd-fc442a40442a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:35.915477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de270f5b-d859-4e6e-83bd-fc442a40442a service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:35.935055 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa11adfd-cf43-467d-b773-0929a7abd44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:35.935984 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11adfd-cf43-467d-b773-0929a7abd44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:35.936256 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11adfd-cf43-467d-b773-0929a7abd44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:35.944860 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa11adfd-cf43-467d-b773-0929a7abd44b admin admin] PATH_INFO: `/v3/projects/a106e82a340945c78b398a2c8465107e` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:35.951013 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11adfd-cf43-467d-b773-0929a7abd44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a106e82a340945c78b398a2c8465107e)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:35.960976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa11adfd-cf43-467d-b773-0929a7abd44b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:36.235002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-fa11adfd-cf43-467d-b773-0929a7abd44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a106e82a340945c78b398a2c8465107e', 'request_id': 'req-fa11adfd-cf43-467d-b773-0929a7abd44b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:36.244456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-fa11adfd-cf43-467d-b773-0929a7abd44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a106e82a340945c78b398a2c8465107e', 'request_id': 'req-fa11adfd-cf43-467d-b773-0929a7abd44b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:36.253948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-fa11adfd-cf43-467d-b773-0929a7abd44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a106e82a340945c78b398a2c8465107e', 'request_id': 'req-fa11adfd-cf43-467d-b773-0929a7abd44b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:36.412243 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-fa11adfd-cf43-467d-b773-0929a7abd44b admin admin] The token cache is being invalidate because project a106e82a340945c78b398a2c8465107e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:33:36.412723 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-fa11adfd-cf43-467d-b773-0929a7abd44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:36.413458 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-fa11adfd-cf43-467d-b773-0929a7abd44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:36.415451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 831/1657] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:33:35 2022] DELETE /identity/v3/projects/a106e82a340945c78b398a2c8465107e => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:36.421647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b6c93-8988-4331-ade8-b413905bedcb None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:36.422503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b6c93-8988-4331-ade8-b413905bedcb None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:36.422946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b6c93-8988-4331-ade8-b413905bedcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:36.457263 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-110b6c93-8988-4331-ade8-b413905bedcb None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:36.459317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-110b6c93-8988-4331-ade8-b413905bedcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:36.611790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab688-052b-4d0d-8565-de4a05a55150 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:36.612086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab688-052b-4d0d-8565-de4a05a55150 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:36.612356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ab688-052b-4d0d-8565-de4a05a55150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:36.625377 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 827/1658] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:36.676932 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-c43ab688-052b-4d0d-8565-de4a05a55150 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:36.681727 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c43ab688-052b-4d0d-8565-de4a05a55150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:36.709627 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 832/1659] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:36.714114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b6c93-8988-4331-ade8-b413905bedcb None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:36.726663 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b6c93-8988-4331-ade8-b413905bedcb None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:36.732468 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd09a91-78c0-4e63-8018-5972425d4061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:36.733555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd09a91-78c0-4e63-8018-5972425d4061 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:36.734508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd09a91-78c0-4e63-8018-5972425d4061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:36.735127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd09a91-78c0-4e63-8018-5972425d4061 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:36.736809 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd09a91-78c0-4e63-8018-5972425d4061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:33:36.737390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd09a91-78c0-4e63-8018-5972425d4061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:36.739985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd09a91-78c0-4e63-8018-5972425d4061 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:36.761719 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ab688-052b-4d0d-8565-de4a05a55150 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:36.785658 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 828/1660] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:33:36.787987 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ab688-052b-4d0d-8565-de4a05a55150 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:36.804245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12944642-afae-4483-928f-d2e01e1991c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:36.805337 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12944642-afae-4483-928f-d2e01e1991c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:36.805855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12944642-afae-4483-928f-d2e01e1991c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:36.806344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12944642-afae-4483-928f-d2e01e1991c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:36.807356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12944642-afae-4483-928f-d2e01e1991c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:36.809607 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12944642-afae-4483-928f-d2e01e1991c0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:36.925573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 833/1661] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:36 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:36.931089 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd09a91-78c0-4e63-8018-5972425d4061 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:36.945579 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd09a91-78c0-4e63-8018-5972425d4061 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:37.063962 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba0ab1-a779-4e00-88d9-d30ca547a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:37.064897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0ab1-a779-4e00-88d9-d30ca547a871 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:37.065184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0ab1-a779-4e00-88d9-d30ca547a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:37.065464 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba0ab1-a779-4e00-88d9-d30ca547a871 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:37.066239 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba0ab1-a779-4e00-88d9-d30ca547a871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:37.070177 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ba0ab1-a779-4e00-88d9-d30ca547a871 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:37.216545 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 829/1662] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:36 2022] POST /identity/v3/users => generated 288 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:37.220581 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12944642-afae-4483-928f-d2e01e1991c0 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:37.252050 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12944642-afae-4483-928f-d2e01e1991c0 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:37.267968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac457d-c925-46e9-ab41-3d76e607352f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:37.267968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac457d-c925-46e9-ab41-3d76e607352f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:37.268294 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac457d-c925-46e9-ab41-3d76e607352f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:37.268554 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac457d-c925-46e9-ab41-3d76e607352f admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:37.270996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac457d-c925-46e9-ab41-3d76e607352f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:37.272626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac457d-c925-46e9-ab41-3d76e607352f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:37.307067 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 834/1663] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:37.309024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba0ab1-a779-4e00-88d9-d30ca547a871 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:37.328745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba0ab1-a779-4e00-88d9-d30ca547a871 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:37.342783 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0b395-7779-424c-9b76-4f17aa58e77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:37.343925 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b395-7779-424c-9b76-4f17aa58e77d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:37.345010 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b395-7779-424c-9b76-4f17aa58e77d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:37.345670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0b395-7779-424c-9b76-4f17aa58e77d admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:37.351553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0b395-7779-424c-9b76-4f17aa58e77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:37.353727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0b395-7779-424c-9b76-4f17aa58e77d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:37.385148 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 830/1664] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:33:37.389122 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac457d-c925-46e9-ab41-3d76e607352f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:37.412763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac457d-c925-46e9-ab41-3d76e607352f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:37.426948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3b420-7350-4814-a2bc-b92eff27d6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:37.429061 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3b420-7350-4814-a2bc-b92eff27d6ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:37.429363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3b420-7350-4814-a2bc-b92eff27d6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:37.429694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3b420-7350-4814-a2bc-b92eff27d6ce admin admin] PATH_INFO: `/v3/projects/9435281bcf7f4d2b9054c9dbff2039a3/users/1c295fed94bf41858dd0c8f41304462a/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:37.462859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3b420-7350-4814-a2bc-b92eff27d6ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=9435281bcf7f4d2b9054c9dbff2039a3, user_id=1c295fed94bf41858dd0c8f41304462a, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:37.469752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3b420-7350-4814-a2bc-b92eff27d6ce admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:37.587190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 835/1665] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:37 2022] PUT /identity/v3/projects/9435281bcf7f4d2b9054c9dbff2039a3/users/1c295fed94bf41858dd0c8f41304462a/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:37.603773 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d38da-394a-4a19-a2c8-8a9ac1e86c5c None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:37.605691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d38da-394a-4a19-a2c8-8a9ac1e86c5c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:37.605977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d38da-394a-4a19-a2c8-8a9ac1e86c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:37.684443 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-535d38da-394a-4a19-a2c8-8a9ac1e86c5c None None] MFA Rules not processed for user `1c295fed94bf41858dd0c8f41304462a`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:37.691461 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-535d38da-394a-4a19-a2c8-8a9ac1e86c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:37.776487 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3b420-7350-4814-a2bc-b92eff27d6ce admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:37.779906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 831/1666] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:37.909035 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3b420-7350-4814-a2bc-b92eff27d6ce admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:37.921152 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973b080-c43c-4f9b-b94a-d4babdd91fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:37.921431 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973b080-c43c-4f9b-b94a-d4babdd91fbf admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:37.921720 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973b080-c43c-4f9b-b94a-d4babdd91fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:37.921995 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a973b080-c43c-4f9b-b94a-d4babdd91fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:37.922718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973b080-c43c-4f9b-b94a-d4babdd91fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:37.924665 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a973b080-c43c-4f9b-b94a-d4babdd91fbf admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:38.080535 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 836/1667] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:37 2022] POST /identity/v3/projects => generated 375 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:38.082804 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d38da-394a-4a19-a2c8-8a9ac1e86c5c None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:38.110016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d38da-394a-4a19-a2c8-8a9ac1e86c5c None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:38.434668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486ea16-758b-4737-b8fc-d4ce66b3ac20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:38.434668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486ea16-758b-4737-b8fc-d4ce66b3ac20 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:38.434668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486ea16-758b-4737-b8fc-d4ce66b3ac20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:38.434668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486ea16-758b-4737-b8fc-d4ce66b3ac20 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:38.443186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486ea16-758b-4737-b8fc-d4ce66b3ac20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:38.443186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486ea16-758b-4737-b8fc-d4ce66b3ac20 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:38.443186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 832/1668] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:38 2022] POST /identity/v3/users => generated 294 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:38.445896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973b080-c43c-4f9b-b94a-d4babdd91fbf admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:38.445896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a973b080-c43c-4f9b-b94a-d4babdd91fbf admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:38.459927 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8b90f-a5d3-413a-b069-66d1a9758e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:38.462153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b90f-a5d3-413a-b069-66d1a9758e8d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:38.462523 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b90f-a5d3-413a-b069-66d1a9758e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:38.462811 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8b90f-a5d3-413a-b069-66d1a9758e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:38.468080 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8b90f-a5d3-413a-b069-66d1a9758e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:38.470353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8b90f-a5d3-413a-b069-66d1a9758e8d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:38.508043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486ea16-758b-4737-b8fc-d4ce66b3ac20 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:38.512780 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 837/1669] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:38.530845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca38084-409d-47dc-85e7-06929b7c5814 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:38.531443 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca38084-409d-47dc-85e7-06929b7c5814 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:38.531869 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca38084-409d-47dc-85e7-06929b7c5814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:38.581811 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486ea16-758b-4737-b8fc-d4ce66b3ac20 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:38.593797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-cca38084-409d-47dc-85e7-06929b7c5814 None None] MFA Rules not processed for user `5e95a2f25a1b40af90995bdb6f871e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:38.595480 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-cca38084-409d-47dc-85e7-06929b7c5814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:38.608839 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee78da9-22b3-49e8-96ad-a1ab5d9b50bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:38.609757 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee78da9-22b3-49e8-96ad-a1ab5d9b50bb admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:38.610169 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee78da9-22b3-49e8-96ad-a1ab5d9b50bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:38.610453 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee78da9-22b3-49e8-96ad-a1ab5d9b50bb admin admin] PATH_INFO: `/v3/projects/ecf87b205be642f7a121d5f7de51749e/users/392d998116de480892dea5cae8fec72e/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:38.657859 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee78da9-22b3-49e8-96ad-a1ab5d9b50bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf87b205be642f7a121d5f7de51749e, user_id=392d998116de480892dea5cae8fec72e, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:38.662114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee78da9-22b3-49e8-96ad-a1ab5d9b50bb admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:38.758620 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 838/1670] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:38.784279 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441adad-a30e-4810-bc22-4d49a6057406 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:38.784811 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441adad-a30e-4810-bc22-4d49a6057406 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:38.785229 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441adad-a30e-4810-bc22-4d49a6057406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:38.814959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-d441adad-a30e-4810-bc22-4d49a6057406 None None] MFA Rules not processed for user `5e95a2f25a1b40af90995bdb6f871e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:38.817014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d441adad-a30e-4810-bc22-4d49a6057406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:38.826825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 839/1671] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:38.840162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441adad-a30e-4810-bc22-4d49a6057406 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:38.850286 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d441adad-a30e-4810-bc22-4d49a6057406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:38.879990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 833/1672] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:38 2022] PUT /identity/v3/projects/ecf87b205be642f7a121d5f7de51749e/users/392d998116de480892dea5cae8fec72e/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:33:38.881842 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee78da9-22b3-49e8-96ad-a1ab5d9b50bb admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:39.074506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee78da9-22b3-49e8-96ad-a1ab5d9b50bb admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:39.088430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797215e-f062-441c-b429-63e4a3f2c875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:39.089438 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797215e-f062-441c-b429-63e4a3f2c875 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:39.089869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797215e-f062-441c-b429-63e4a3f2c875 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:39.090289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797215e-f062-441c-b429-63e4a3f2c875 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:39.091191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797215e-f062-441c-b429-63e4a3f2c875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:39.092980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797215e-f062-441c-b429-63e4a3f2c875 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:39.121228 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 834/1673] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:39.122340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797215e-f062-441c-b429-63e4a3f2c875 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:39.140236 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797215e-f062-441c-b429-63e4a3f2c875 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:39.156238 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441adad-a30e-4810-bc22-4d49a6057406 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:39.164634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59aac0-2901-4e49-ad32-684f6a2965cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:39.165554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59aac0-2901-4e49-ad32-684f6a2965cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:39.165893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59aac0-2901-4e49-ad32-684f6a2965cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:39.166176 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59aac0-2901-4e49-ad32-684f6a2965cc admin admin] PATH_INFO: `/v3/projects/ecf87b205be642f7a121d5f7de51749e/users/392d998116de480892dea5cae8fec72e/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:39.180750 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59aac0-2901-4e49-ad32-684f6a2965cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf87b205be642f7a121d5f7de51749e, user_id=392d998116de480892dea5cae8fec72e, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:39.200907 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59aac0-2901-4e49-ad32-684f6a2965cc admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:39.251320 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 835/1674] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:39 2022] PUT /identity/v3/projects/ecf87b205be642f7a121d5f7de51749e/users/392d998116de480892dea5cae8fec72e/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:39.259136 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202cca-e17f-4d36-9dc9-4112dc8c51bd None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:39.259502 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202cca-e17f-4d36-9dc9-4112dc8c51bd None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:39.259815 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e202cca-e17f-4d36-9dc9-4112dc8c51bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:39.343583 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-9e202cca-e17f-4d36-9dc9-4112dc8c51bd None None] MFA Rules not processed for user `392d998116de480892dea5cae8fec72e`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:39.346121 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9e202cca-e17f-4d36-9dc9-4112dc8c51bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:39.386594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcdb69c-beb8-4fec-9c64-f04c534079e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:39.390718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdb69c-beb8-4fec-9c64-f04c534079e0 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:39.391023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdb69c-beb8-4fec-9c64-f04c534079e0 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:39.391363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcdb69c-beb8-4fec-9c64-f04c534079e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:39.511284 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 836/1675] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:39 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:39.522183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202cca-e17f-4d36-9dc9-4112dc8c51bd None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:39.524993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9e202cca-e17f-4d36-9dc9-4112dc8c51bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:39.597349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdb69c-beb8-4fec-9c64-f04c534079e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:39.599405 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcdb69c-beb8-4fec-9c64-f04c534079e0 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:39.622029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 840/1676] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 783 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:39.692620 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e202cca-e17f-4d36-9dc9-4112dc8c51bd None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:39.713218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602f3e6-03d0-4b41-b2cf-1cb38a28267d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:39.713218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f3e6-03d0-4b41-b2cf-1cb38a28267d service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:39.713218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f3e6-03d0-4b41-b2cf-1cb38a28267d service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:39.713218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602f3e6-03d0-4b41-b2cf-1cb38a28267d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:39.820716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602f3e6-03d0-4b41-b2cf-1cb38a28267d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:39.822722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602f3e6-03d0-4b41-b2cf-1cb38a28267d service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:39.859298 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 837/1677] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:33:40.876854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0620006-9e1c-4a94-b85b-ca02a7b36cf4 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:40.877324 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0620006-9e1c-4a94-b85b-ca02a7b36cf4 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:40.877519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0620006-9e1c-4a94-b85b-ca02a7b36cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:40.915165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-d0620006-9e1c-4a94-b85b-ca02a7b36cf4 None None] MFA Rules not processed for user `46193f5323954ed6b3a5e52fa0b3f0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:40.917030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d0620006-9e1c-4a94-b85b-ca02a7b36cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:41.131049 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 841/1678] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:33:41.151938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602f3e6-03d0-4b41-b2cf-1cb38a28267d service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:41.153543 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9602f3e6-03d0-4b41-b2cf-1cb38a28267d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:41.290394 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602f3e6-03d0-4b41-b2cf-1cb38a28267d service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:41.306126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a306466-808e-4e46-8e2b-ab073a9391c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:41.309464 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a306466-808e-4e46-8e2b-ab073a9391c0 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:41.309464 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a306466-808e-4e46-8e2b-ab073a9391c0 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:41.309464 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a306466-808e-4e46-8e2b-ab073a9391c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:41.333153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a306466-808e-4e46-8e2b-ab073a9391c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:41.334852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a306466-808e-4e46-8e2b-ab073a9391c0 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:41.353286 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 838/1679] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:41.592987 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2affe4e-3645-4de1-b7d4-341f0a82650d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:41.593402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2affe4e-3645-4de1-b7d4-341f0a82650d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:41.593794 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2affe4e-3645-4de1-b7d4-341f0a82650d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:41.698319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-a2affe4e-3645-4de1-b7d4-341f0a82650d None None] MFA Rules not processed for user `b030acfe033d4d6d8cca6f79d02594a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:41.700715 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a2affe4e-3645-4de1-b7d4-341f0a82650d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:41.834278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33188823-2d0e-4bcb-8f46-e62ba673ad5d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:41.835002 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33188823-2d0e-4bcb-8f46-e62ba673ad5d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:41.835542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33188823-2d0e-4bcb-8f46-e62ba673ad5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:41.897023 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-33188823-2d0e-4bcb-8f46-e62ba673ad5d None None] MFA Rules not processed for user `5e95a2f25a1b40af90995bdb6f871e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:41.902468 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 842/1680] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:41.906520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-33188823-2d0e-4bcb-8f46-e62ba673ad5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:41.919509 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2affe4e-3645-4de1-b7d4-341f0a82650d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:41.937533 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2affe4e-3645-4de1-b7d4-341f0a82650d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:41.946982 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a23be5-8b5c-4b02-b81e-f854463c5a50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:41.948757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23be5-8b5c-4b02-b81e-f854463c5a50 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:41.949287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23be5-8b5c-4b02-b81e-f854463c5a50 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:41.949706 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23be5-8b5c-4b02-b81e-f854463c5a50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:41.961269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a23be5-8b5c-4b02-b81e-f854463c5a50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:41.964354 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a23be5-8b5c-4b02-b81e-f854463c5a50 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:41.990737 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 843/1681] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:33:42.033751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 839/1682] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:42.455461 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9ee0e-5f43-48ea-af3d-f863f60facf5 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:42.455830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9ee0e-5f43-48ea-af3d-f863f60facf5 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:42.459492 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9ee0e-5f43-48ea-af3d-f863f60facf5 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:42.464909 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 844/1683] 10.222.0.35 () {54 vars in 912 bytes} [Sat Feb 12 04:33:42 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Feb 12 04:33:42.476021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d3071-6e44-4f7f-916a-26f6b4e05ca6 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:42.477129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d3071-6e44-4f7f-916a-26f6b4e05ca6 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:42.477699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d3071-6e44-4f7f-916a-26f6b4e05ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:42.516243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-364d3071-6e44-4f7f-916a-26f6b4e05ca6 None None] MFA Rules not processed for user `d9c5541a29cf42f6ab394133baa05fae`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:42.520430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-364d3071-6e44-4f7f-916a-26f6b4e05ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:42.619516 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9ee0e-5f43-48ea-af3d-f863f60facf5 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:42.621285 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b7a9ee0e-5f43-48ea-af3d-f863f60facf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:42.637543 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 840/1684] 10.222.0.35 () {58 vars in 1009 bytes} [Sat Feb 12 04:33:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:42.653472 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9ee0e-5f43-48ea-af3d-f863f60facf5 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:42.664494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbca267-eded-4eaf-97b8-68762d206845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:42.665339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbca267-eded-4eaf-97b8-68762d206845 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:42.665842 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbca267-eded-4eaf-97b8-68762d206845 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:42.666468 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbca267-eded-4eaf-97b8-68762d206845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:42.687053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbca267-eded-4eaf-97b8-68762d206845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:42.693645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbca267-eded-4eaf-97b8-68762d206845 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:42.727777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 845/1685] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:33:46.034718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aca75-8e85-40b9-8961-170cde55690a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:46.035682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aca75-8e85-40b9-8961-170cde55690a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:46.036116 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613aca75-8e85-40b9-8961-170cde55690a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:46.099342 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-613aca75-8e85-40b9-8961-170cde55690a None None] MFA Rules not processed for user `46193f5323954ed6b3a5e52fa0b3f0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:46.111792 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-613aca75-8e85-40b9-8961-170cde55690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:46.161612 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 841/1686] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:46.790902 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0a338-fbaa-4d58-b889-af651547dd1c None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:46.796079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0a338-fbaa-4d58-b889-af651547dd1c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:46.796079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc0a338-fbaa-4d58-b889-af651547dd1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:46.840568 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-5cc0a338-fbaa-4d58-b889-af651547dd1c None None] MFA Rules not processed for user `b030acfe033d4d6d8cca6f79d02594a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:46.841788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-5cc0a338-fbaa-4d58-b889-af651547dd1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:46.853327 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 846/1687] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:47.100906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613aca75-8e85-40b9-8961-170cde55690a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:47.102462 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-613aca75-8e85-40b9-8961-170cde55690a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:47.124999 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613aca75-8e85-40b9-8961-170cde55690a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:47.135988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d682a-1d19-4b7e-a5ca-96e4bf7aa416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:47.137098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d682a-1d19-4b7e-a5ca-96e4bf7aa416 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:47.137600 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d682a-1d19-4b7e-a5ca-96e4bf7aa416 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:47.138165 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d682a-1d19-4b7e-a5ca-96e4bf7aa416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:47.160716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d682a-1d19-4b7e-a5ca-96e4bf7aa416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:47.163568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d682a-1d19-4b7e-a5ca-96e4bf7aa416 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:47.199513 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 842/1688] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:49.829682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842139-9876-4c30-8969-05906dce71be None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:49.830103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842139-9876-4c30-8969-05906dce71be None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:49.830226 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d842139-9876-4c30-8969-05906dce71be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:49.857753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-4d842139-9876-4c30-8969-05906dce71be None None] MFA Rules not processed for user `d9c5541a29cf42f6ab394133baa05fae`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:49.859108 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4d842139-9876-4c30-8969-05906dce71be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:49.866522 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 847/1689] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Feb 12 04:33:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:49.890080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d682a-1d19-4b7e-a5ca-96e4bf7aa416 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:49.891599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e97d682a-1d19-4b7e-a5ca-96e4bf7aa416 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:49.904050 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d682a-1d19-4b7e-a5ca-96e4bf7aa416 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:49.907731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8ef2c-56fe-49e7-9117-fb5ce428e877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:49.908363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8ef2c-56fe-49e7-9117-fb5ce428e877 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:49.908645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8ef2c-56fe-49e7-9117-fb5ce428e877 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:49.908919 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8ef2c-56fe-49e7-9117-fb5ce428e877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:49.917242 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8ef2c-56fe-49e7-9117-fb5ce428e877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:49.918744 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8ef2c-56fe-49e7-9117-fb5ce428e877 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:49.939584 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 843/1690] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:49.993724 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f402b7-5e72-4701-9a17-f2e6251d4284 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:49.994010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f402b7-5e72-4701-9a17-f2e6251d4284 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:49.994288 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f402b7-5e72-4701-9a17-f2e6251d4284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:50.021196 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-54f402b7-5e72-4701-9a17-f2e6251d4284 None None] MFA Rules not processed for user `560fd9efb8a04f449acaf2f3987ce81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:50.022795 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-54f402b7-5e72-4701-9a17-f2e6251d4284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:50.104684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 848/1691] 10.222.0.35 () {58 vars in 1009 bytes} [Sat Feb 12 04:33:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:50.587838 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8ef2c-56fe-49e7-9117-fb5ce428e877 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:50.589756 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a0b8ef2c-56fe-49e7-9117-fb5ce428e877 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:50.664530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8ef2c-56fe-49e7-9117-fb5ce428e877 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:50.670711 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c33af-4c06-44b8-9399-a35b480ef6f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b37a10e3b5e404db7aad72e1772a2de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:50.671699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c33af-4c06-44b8-9399-a35b480ef6f1 service swift] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:50.672024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c33af-4c06-44b8-9399-a35b480ef6f1 service swift] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:50.672555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c33af-4c06-44b8-9399-a35b480ef6f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:50.682156 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c33af-4c06-44b8-9399-a35b480ef6f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:50.683538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c33af-4c06-44b8-9399-a35b480ef6f1 service swift] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:50.693099 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 844/1692] 10.222.0.35 () {60 vars in 1384 bytes} [Sat Feb 12 04:33:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 04:33:51.074135 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065150f7-5c35-4e88-815c-cd3a4f7714d7 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:51.077940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065150f7-5c35-4e88-815c-cd3a4f7714d7 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:51.077940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065150f7-5c35-4e88-815c-cd3a4f7714d7 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:51.077940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 849/1693] 10.222.0.35 () {54 vars in 921 bytes} [Sat Feb 12 04:33:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:33:51.082978 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b856d1-5173-4045-b679-530a5f70b3b1 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:51.083726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b856d1-5173-4045-b679-530a5f70b3b1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:51.083726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b856d1-5173-4045-b679-530a5f70b3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:51.102755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-50b856d1-5173-4045-b679-530a5f70b3b1 None None] MFA Rules not processed for user `362ab4aeb88746d8b8a14a238c877a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:51.106680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-50b856d1-5173-4045-b679-530a5f70b3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:51.114324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 845/1694] 10.222.0.35 () {58 vars in 1018 bytes} [Sat Feb 12 04:33:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:51.126081 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065150f7-5c35-4e88-815c-cd3a4f7714d7 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:51.146209 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065150f7-5c35-4e88-815c-cd3a4f7714d7 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:51.152179 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1266a7f-5eb7-4641-88c2-4ef393f9ec1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:51.152852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1266a7f-5eb7-4641-88c2-4ef393f9ec1d service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:51.153129 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1266a7f-5eb7-4641-88c2-4ef393f9ec1d service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:51.153402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1266a7f-5eb7-4641-88c2-4ef393f9ec1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:51.162941 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1266a7f-5eb7-4641-88c2-4ef393f9ec1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:51.164609 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1266a7f-5eb7-4641-88c2-4ef393f9ec1d service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:51.176602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 850/1695] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:54.213140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b856d1-5173-4045-b679-530a5f70b3b1 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:54.214904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-50b856d1-5173-4045-b679-530a5f70b3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:54.319600 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b856d1-5173-4045-b679-530a5f70b3b1 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:54.324475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94439b-5a9a-45bf-a59d-51fe212eee5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:54.325403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94439b-5a9a-45bf-a59d-51fe212eee5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:54.325684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94439b-5a9a-45bf-a59d-51fe212eee5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:54.325952 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94439b-5a9a-45bf-a59d-51fe212eee5a admin admin] PATH_INFO: `/v3/users/0568be0798cd4fc388fe6338d3334c78` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:54.327213 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94439b-5a9a-45bf-a59d-51fe212eee5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0568be0798cd4fc388fe6338d3334c78)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:54.329303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94439b-5a9a-45bf-a59d-51fe212eee5a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:54.565864 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fd94439b-5a9a-45bf-a59d-51fe212eee5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0568be0798cd4fc388fe6338d3334c78'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:54.567122 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fd94439b-5a9a-45bf-a59d-51fe212eee5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0568be0798cd4fc388fe6338d3334c78'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:54.568046 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fd94439b-5a9a-45bf-a59d-51fe212eee5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0568be0798cd4fc388fe6338d3334c78'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:54.584963 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fd94439b-5a9a-45bf-a59d-51fe212eee5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0568be0798cd4fc388fe6338d3334c78'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:54.594861 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fd94439b-5a9a-45bf-a59d-51fe212eee5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0568be0798cd4fc388fe6338d3334c78'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:54.689057 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 846/1696] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:33:54 2022] DELETE /identity/v3/users/0568be0798cd4fc388fe6338d3334c78 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:54.690472 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21667e61-870a-4495-ac48-b7451966605a None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:54.691036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21667e61-870a-4495-ac48-b7451966605a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:54.691769 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21667e61-870a-4495-ac48-b7451966605a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:54.712435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-21667e61-870a-4495-ac48-b7451966605a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:54.714245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-21667e61-870a-4495-ac48-b7451966605a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:54.803352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 851/1697] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:54.817175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94439b-5a9a-45bf-a59d-51fe212eee5a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:54.817175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-fd94439b-5a9a-45bf-a59d-51fe212eee5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:54.910529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94439b-5a9a-45bf-a59d-51fe212eee5a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:54.914114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd84980-080a-49fd-a3c7-005df90b4eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:54.914987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd84980-080a-49fd-a3c7-005df90b4eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:54.915300 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd84980-080a-49fd-a3c7-005df90b4eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:54.915830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd84980-080a-49fd-a3c7-005df90b4eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:54.942066 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd84980-080a-49fd-a3c7-005df90b4eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:54.943747 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd84980-080a-49fd-a3c7-005df90b4eb8 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:54.957038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 847/1698] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:55.336339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21667e61-870a-4495-ac48-b7451966605a None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:55.337792 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-21667e61-870a-4495-ac48-b7451966605a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:55.352569 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21667e61-870a-4495-ac48-b7451966605a None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:55.363058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed2bb1-24b6-452e-81d8-1e8e251c2062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:55.364336 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed2bb1-24b6-452e-81d8-1e8e251c2062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:55.364802 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed2bb1-24b6-452e-81d8-1e8e251c2062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:55.365245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed2bb1-24b6-452e-81d8-1e8e251c2062 admin admin] PATH_INFO: `/v3/users/083f3be983df469bab10ba61a0fad062` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:55.366850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed2bb1-24b6-452e-81d8-1e8e251c2062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=083f3be983df469bab10ba61a0fad062)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:55.368814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed2bb1-24b6-452e-81d8-1e8e251c2062 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:55.516400 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd84980-080a-49fd-a3c7-005df90b4eb8 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:55.519243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-0dd84980-080a-49fd-a3c7-005df90b4eb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:55.532479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd84980-080a-49fd-a3c7-005df90b4eb8 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:55.538877 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d342b9-bcf8-471f-aa12-82b71deb070a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:55.540212 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d342b9-bcf8-471f-aa12-82b71deb070a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:55.547798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d342b9-bcf8-471f-aa12-82b71deb070a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:55.547798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d342b9-bcf8-471f-aa12-82b71deb070a admin admin] PATH_INFO: `/v3/projects/eb594a2ed9f94d8ca9cb7806609ad9f1` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:55.547798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d342b9-bcf8-471f-aa12-82b71deb070a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb594a2ed9f94d8ca9cb7806609ad9f1)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:55.547798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING py.warnings [None req-e0d342b9-bcf8-471f-aa12-82b71deb070a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Feb 12 04:33:55.547798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: warnings.warn(msg) Feb 12 04:33:55.547798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: Feb 12 04:33:55.547798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d342b9-bcf8-471f-aa12-82b71deb070a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:55.606654 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-06ed2bb1-24b6-452e-81d8-1e8e251c2062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083f3be983df469bab10ba61a0fad062'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:55.607598 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-06ed2bb1-24b6-452e-81d8-1e8e251c2062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083f3be983df469bab10ba61a0fad062'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:55.608688 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-06ed2bb1-24b6-452e-81d8-1e8e251c2062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083f3be983df469bab10ba61a0fad062'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:55.626914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-06ed2bb1-24b6-452e-81d8-1e8e251c2062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083f3be983df469bab10ba61a0fad062'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:55.641571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-06ed2bb1-24b6-452e-81d8-1e8e251c2062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083f3be983df469bab10ba61a0fad062'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:55.682967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e0d342b9-bcf8-471f-aa12-82b71deb070a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb594a2ed9f94d8ca9cb7806609ad9f1', 'request_id': 'req-e0d342b9-bcf8-471f-aa12-82b71deb070a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:55.741774 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 852/1699] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:33:55 2022] DELETE /identity/v3/users/083f3be983df469bab10ba61a0fad062 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:55.746863 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4525d5-223b-43c0-af48-eb483b251a5e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:55.747396 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4525d5-223b-43c0-af48-eb483b251a5e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:55.747808 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4525d5-223b-43c0-af48-eb483b251a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:55.780832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-8b4525d5-223b-43c0-af48-eb483b251a5e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:55.782249 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8b4525d5-223b-43c0-af48-eb483b251a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:55.803783 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e0d342b9-bcf8-471f-aa12-82b71deb070a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb594a2ed9f94d8ca9cb7806609ad9f1', 'request_id': 'req-e0d342b9-bcf8-471f-aa12-82b71deb070a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:55.812138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e0d342b9-bcf8-471f-aa12-82b71deb070a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb594a2ed9f94d8ca9cb7806609ad9f1', 'request_id': 'req-e0d342b9-bcf8-471f-aa12-82b71deb070a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:55.844393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e0d342b9-bcf8-471f-aa12-82b71deb070a admin admin] The token cache is being invalidate because project eb594a2ed9f94d8ca9cb7806609ad9f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:33:55.844928 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e0d342b9-bcf8-471f-aa12-82b71deb070a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:55.845967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e0d342b9-bcf8-471f-aa12-82b71deb070a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:55.849130 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 848/1700] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:33:55 2022] DELETE /identity/v3/projects/eb594a2ed9f94d8ca9cb7806609ad9f1 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:33:55.868371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511371e-eed4-4cdf-b86e-4942430ace95 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:55.869160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511371e-eed4-4cdf-b86e-4942430ace95 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:55.869650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511371e-eed4-4cdf-b86e-4942430ace95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:55.894990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-4511371e-eed4-4cdf-b86e-4942430ace95 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:55.896781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-4511371e-eed4-4cdf-b86e-4942430ace95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:55.906818 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 853/1701] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:55.908165 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 849/1702] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:55.916439 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f28d-0338-43b3-91f5-1a95f3e3b45e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:55.916947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f28d-0338-43b3-91f5-1a95f3e3b45e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:55.917224 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f28d-0338-43b3-91f5-1a95f3e3b45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:55.919822 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511371e-eed4-4cdf-b86e-4942430ace95 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:55.921802 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-4511371e-eed4-4cdf-b86e-4942430ace95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:55.946422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-8146f28d-0338-43b3-91f5-1a95f3e3b45e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:55.947771 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8146f28d-0338-43b3-91f5-1a95f3e3b45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:55.956336 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 854/1703] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:33:55.960759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146f28d-0338-43b3-91f5-1a95f3e3b45e None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:55.982854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146f28d-0338-43b3-91f5-1a95f3e3b45e None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:55.989359 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30b92b-2fd2-47e4-a6b5-cd255f3447b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:55.990222 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30b92b-2fd2-47e4-a6b5-cd255f3447b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:55.990667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30b92b-2fd2-47e4-a6b5-cd255f3447b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:55.991138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30b92b-2fd2-47e4-a6b5-cd255f3447b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:55.992041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30b92b-2fd2-47e4-a6b5-cd255f3447b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:33:55.992506 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30b92b-2fd2-47e4-a6b5-cd255f3447b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:55.995122 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff30b92b-2fd2-47e4-a6b5-cd255f3447b6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:55.998750 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511371e-eed4-4cdf-b86e-4942430ace95 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:56.003166 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b84510-ede4-47ef-a18b-b90bef72bc94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:56.004107 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84510-ede4-47ef-a18b-b90bef72bc94 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:56.004845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84510-ede4-47ef-a18b-b90bef72bc94 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:56.005517 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84510-ede4-47ef-a18b-b90bef72bc94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:56.016248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 855/1704] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:33:56.020667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30b92b-2fd2-47e4-a6b5-cd255f3447b6 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:56.028041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b84510-ede4-47ef-a18b-b90bef72bc94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:56.029685 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b84510-ede4-47ef-a18b-b90bef72bc94 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:56.042753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30b92b-2fd2-47e4-a6b5-cd255f3447b6 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:56.051449 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 850/1705] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:33:56.056417 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d68ee-a512-42e9-a1fd-9a5ba3ac7288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:56.057192 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d68ee-a512-42e9-a1fd-9a5ba3ac7288 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:56.057613 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d68ee-a512-42e9-a1fd-9a5ba3ac7288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:56.058009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d68ee-a512-42e9-a1fd-9a5ba3ac7288 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:56.058821 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d68ee-a512-42e9-a1fd-9a5ba3ac7288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:56.061858 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d68ee-a512-42e9-a1fd-9a5ba3ac7288 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:56.158038 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 856/1706] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:56 2022] POST /identity/v3/projects => generated 405 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:56.163307 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b84510-ede4-47ef-a18b-b90bef72bc94 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:56.185519 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b84510-ede4-47ef-a18b-b90bef72bc94 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:56.270727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25f7bd-7c25-4440-a087-5b442b9cbedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:56.271756 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25f7bd-7c25-4440-a087-5b442b9cbedd admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:56.275434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25f7bd-7c25-4440-a087-5b442b9cbedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:56.276132 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d25f7bd-7c25-4440-a087-5b442b9cbedd admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:56.277130 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25f7bd-7c25-4440-a087-5b442b9cbedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:56.282511 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d25f7bd-7c25-4440-a087-5b442b9cbedd admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:56.378809 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d68ee-a512-42e9-a1fd-9a5ba3ac7288 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:56.386881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 851/1707] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:56 2022] POST /identity/v3/users => generated 303 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:56.390439 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d68ee-a512-42e9-a1fd-9a5ba3ac7288 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:56.395602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f07cd-f442-46c3-8fa6-71f02b1cfece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:56.396419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f07cd-f442-46c3-8fa6-71f02b1cfece admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:56.396932 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f07cd-f442-46c3-8fa6-71f02b1cfece admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:56.397399 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f07cd-f442-46c3-8fa6-71f02b1cfece admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:56.398248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f07cd-f442-46c3-8fa6-71f02b1cfece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:56.400432 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f07cd-f442-46c3-8fa6-71f02b1cfece admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:56.411716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 857/1708] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:56.415750 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25f7bd-7c25-4440-a087-5b442b9cbedd admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:56.427580 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d25f7bd-7c25-4440-a087-5b442b9cbedd admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:56.432925 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28124c9-ae43-4301-9fa3-bc0acb6be53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:56.433076 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28124c9-ae43-4301-9fa3-bc0acb6be53e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:56.433340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28124c9-ae43-4301-9fa3-bc0acb6be53e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:56.433610 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28124c9-ae43-4301-9fa3-bc0acb6be53e admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:56.434610 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28124c9-ae43-4301-9fa3-bc0acb6be53e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:56.436302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28124c9-ae43-4301-9fa3-bc0acb6be53e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:56.460900 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 852/1709] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:33:56.461671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f07cd-f442-46c3-8fa6-71f02b1cfece admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:56.474997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f07cd-f442-46c3-8fa6-71f02b1cfece admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:56.479971 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0bd3c0-c640-474a-8aea-e5c7f326f60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:56.480904 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bd3c0-c640-474a-8aea-e5c7f326f60a admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:56.481187 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bd3c0-c640-474a-8aea-e5c7f326f60a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:56.481463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0bd3c0-c640-474a-8aea-e5c7f326f60a admin admin] PATH_INFO: `/v3/projects/7c007d40ae714173973fee2f9394309d/users/b1f89e4071a24137a894cc65fd5b2873/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:56.500114 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bd3c0-c640-474a-8aea-e5c7f326f60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c007d40ae714173973fee2f9394309d, user_id=b1f89e4071a24137a894cc65fd5b2873, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:56.503180 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0bd3c0-c640-474a-8aea-e5c7f326f60a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:56.536183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28124c9-ae43-4301-9fa3-bc0acb6be53e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:56.538260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b28124c9-ae43-4301-9fa3-bc0acb6be53e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:56.570870 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28124c9-ae43-4301-9fa3-bc0acb6be53e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:56.583582 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:56.584455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:56.586578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:56.586903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] PATH_INFO: `/v3/projects/6ca538d34a494414ae588c331a3bab1e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:56.588339 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ca538d34a494414ae588c331a3bab1e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:56.590631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:56.615191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 858/1710] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:56 2022] PUT /identity/v3/projects/7c007d40ae714173973fee2f9394309d/users/b1f89e4071a24137a894cc65fd5b2873/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:33:56.629648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888c0b8-1f06-4cbd-ae0e-948963185877 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:56.629867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888c0b8-1f06-4cbd-ae0e-948963185877 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:56.630139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4888c0b8-1f06-4cbd-ae0e-948963185877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:56.682691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-4888c0b8-1f06-4cbd-ae0e-948963185877 None None] MFA Rules not processed for user `b1f89e4071a24137a894cc65fd5b2873`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:56.683158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4888c0b8-1f06-4cbd-ae0e-948963185877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:56.724747 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ca538d34a494414ae588c331a3bab1e', 'request_id': 'req-366e7384-2f91-49f7-883a-13f03f11faa6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:56.758133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 859/1711] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:56.762262 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888c0b8-1f06-4cbd-ae0e-948963185877 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:56.805153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ca538d34a494414ae588c331a3bab1e', 'request_id': 'req-366e7384-2f91-49f7-883a-13f03f11faa6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:56.811018 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ca538d34a494414ae588c331a3bab1e', 'request_id': 'req-366e7384-2f91-49f7-883a-13f03f11faa6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:56.823782 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] The token cache is being invalidate because project 6ca538d34a494414ae588c331a3bab1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:33:56.824399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:56.825086 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:56.826903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 853/1712] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:33:56 2022] DELETE /identity/v3/projects/6ca538d34a494414ae588c331a3bab1e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:33:56.830697 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:56.832642 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:56.834438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4888c0b8-1f06-4cbd-ae0e-948963185877 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:56.899001 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a159e-07d7-43f7-aa95-47760d9fcb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:56.900141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a159e-07d7-43f7-aa95-47760d9fcb84 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:56.900527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a159e-07d7-43f7-aa95-47760d9fcb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:56.906208 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a159e-07d7-43f7-aa95-47760d9fcb84 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:56.906208 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a159e-07d7-43f7-aa95-47760d9fcb84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:56.906208 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a159e-07d7-43f7-aa95-47760d9fcb84 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:56.915216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e7384-2f91-49f7-883a-13f03f11faa6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:56.920188 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f31f9-fc85-494b-84bf-ab9aadc0bd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:56.921174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f31f9-fc85-494b-84bf-ab9aadc0bd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:56.921461 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f31f9-fc85-494b-84bf-ab9aadc0bd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:56.921734 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f31f9-fc85-494b-84bf-ab9aadc0bd8c admin admin] PATH_INFO: `/v3/users/19020356f13a400aaeeaabb5ab2692ae` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:56.923194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f31f9-fc85-494b-84bf-ab9aadc0bd8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=19020356f13a400aaeeaabb5ab2692ae)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:56.925142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1f31f9-fc85-494b-84bf-ab9aadc0bd8c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:57.020333 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 860/1713] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:56 2022] POST /identity/v3/projects => generated 403 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:33:57.024579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a159e-07d7-43f7-aa95-47760d9fcb84 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:57.027352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-187a159e-07d7-43f7-aa95-47760d9fcb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:57.109630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a159e-07d7-43f7-aa95-47760d9fcb84 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:57.115827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3250c-6c1a-463e-86d8-1900ab102093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:57.116622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3250c-6c1a-463e-86d8-1900ab102093 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:57.116926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3250c-6c1a-463e-86d8-1900ab102093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:57.117199 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3250c-6c1a-463e-86d8-1900ab102093 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:57.117913 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3250c-6c1a-463e-86d8-1900ab102093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:57.119847 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3250c-6c1a-463e-86d8-1900ab102093 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:57.136319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4c1f31f9-fc85-494b-84bf-ab9aadc0bd8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19020356f13a400aaeeaabb5ab2692ae'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:57.137136 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4c1f31f9-fc85-494b-84bf-ab9aadc0bd8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19020356f13a400aaeeaabb5ab2692ae'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:57.138209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4c1f31f9-fc85-494b-84bf-ab9aadc0bd8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19020356f13a400aaeeaabb5ab2692ae'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:57.159372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4c1f31f9-fc85-494b-84bf-ab9aadc0bd8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19020356f13a400aaeeaabb5ab2692ae'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:57.167306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4c1f31f9-fc85-494b-84bf-ab9aadc0bd8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19020356f13a400aaeeaabb5ab2692ae'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:57.187091 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 861/1714] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:57 2022] POST /identity/v3/users => generated 308 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:33:57.195030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3250c-6c1a-463e-86d8-1900ab102093 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:57.196972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0ed3250c-6c1a-463e-86d8-1900ab102093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:57.210421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3250c-6c1a-463e-86d8-1900ab102093 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:57.215351 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8329307-fcef-4f84-bbdb-0cdbb710e87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:57.216088 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8329307-fcef-4f84-bbdb-0cdbb710e87b admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:57.216456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8329307-fcef-4f84-bbdb-0cdbb710e87b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:57.216799 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8329307-fcef-4f84-bbdb-0cdbb710e87b admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:57.217668 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8329307-fcef-4f84-bbdb-0cdbb710e87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:57.219373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8329307-fcef-4f84-bbdb-0cdbb710e87b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:57.229923 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 862/1715] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:33:57.234776 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8329307-fcef-4f84-bbdb-0cdbb710e87b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:57.240059 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 854/1716] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:33:56 2022] DELETE /identity/v3/users/19020356f13a400aaeeaabb5ab2692ae => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:57.246675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8329307-fcef-4f84-bbdb-0cdbb710e87b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:57.335810 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb862b-aa9c-4ced-83c6-684c4beb4196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:57.336713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb862b-aa9c-4ced-83c6-684c4beb4196 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:57.336997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb862b-aa9c-4ced-83c6-684c4beb4196 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:57.337272 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb862b-aa9c-4ced-83c6-684c4beb4196 admin admin] PATH_INFO: `/v3/projects/aba5539588f246759389b6c5f7be53f8/users/e9ac955b4a1548368cbccff8632c9d4e/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:57.355576 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb862b-aa9c-4ced-83c6-684c4beb4196 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba5539588f246759389b6c5f7be53f8, user_id=e9ac955b4a1548368cbccff8632c9d4e, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:57.358824 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb862b-aa9c-4ced-83c6-684c4beb4196 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:57.458753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 863/1717] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:57 2022] PUT /identity/v3/projects/aba5539588f246759389b6c5f7be53f8/users/e9ac955b4a1548368cbccff8632c9d4e/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:33:57.462902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f31f9-fc85-494b-84bf-ab9aadc0bd8c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:57.486831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f31f9-fc85-494b-84bf-ab9aadc0bd8c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:57.575955 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59b509-f10e-4f2d-8cbb-bed806624a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:57.576689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59b509-f10e-4f2d-8cbb-bed806624a93 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:57.577059 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59b509-f10e-4f2d-8cbb-bed806624a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:57.577423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59b509-f10e-4f2d-8cbb-bed806624a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:57.578236 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59b509-f10e-4f2d-8cbb-bed806624a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:57.579932 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59b509-f10e-4f2d-8cbb-bed806624a93 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:57.596940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb862b-aa9c-4ced-83c6-684c4beb4196 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:57.603614 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 855/1718] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:33:57.610482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb862b-aa9c-4ced-83c6-684c4beb4196 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:57.618278 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c30143-8f05-4067-be72-1a98d7956208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:57.619366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c30143-8f05-4067-be72-1a98d7956208 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:57.619538 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c30143-8f05-4067-be72-1a98d7956208 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:57.619775 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c30143-8f05-4067-be72-1a98d7956208 admin admin] PATH_INFO: `/v3/projects/aba5539588f246759389b6c5f7be53f8/users/e9ac955b4a1548368cbccff8632c9d4e/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:57.622350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c30143-8f05-4067-be72-1a98d7956208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba5539588f246759389b6c5f7be53f8, user_id=e9ac955b4a1548368cbccff8632c9d4e, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:57.625281 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c30143-8f05-4067-be72-1a98d7956208 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:57.639267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 864/1719] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:57 2022] PUT /identity/v3/projects/aba5539588f246759389b6c5f7be53f8/users/e9ac955b4a1548368cbccff8632c9d4e/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:57.649939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b7411-95d2-41bf-a053-5d8d762133af None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:57.650227 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b7411-95d2-41bf-a053-5d8d762133af None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:57.650504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85b7411-95d2-41bf-a053-5d8d762133af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:57.713666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-a85b7411-95d2-41bf-a053-5d8d762133af None None] MFA Rules not processed for user `e9ac955b4a1548368cbccff8632c9d4e`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:57.714980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a85b7411-95d2-41bf-a053-5d8d762133af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:57.803571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c30143-8f05-4067-be72-1a98d7956208 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:57.803571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-26c30143-8f05-4067-be72-1a98d7956208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:57.819930 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 856/1720] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:57 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:57.829676 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b7411-95d2-41bf-a053-5d8d762133af None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:57.831070 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a85b7411-95d2-41bf-a053-5d8d762133af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:57.932558 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c30143-8f05-4067-be72-1a98d7956208 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:57.952713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8c6bd-e7b0-42ca-9805-018515b81a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:57.953753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8c6bd-e7b0-42ca-9805-018515b81a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:57.954103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8c6bd-e7b0-42ca-9805-018515b81a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:57.956730 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8c6bd-e7b0-42ca-9805-018515b81a10 admin admin] PATH_INFO: `/v3/projects/a81920da22d9449b87859d57a78e5331` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:57.956730 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8c6bd-e7b0-42ca-9805-018515b81a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a81920da22d9449b87859d57a78e5331)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:57.957845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8c6bd-e7b0-42ca-9805-018515b81a10 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:57.965151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85b7411-95d2-41bf-a053-5d8d762133af None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:57.976515 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bd0f54-68f4-4b1d-b0ff-622869d2f7b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:57.977249 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd0f54-68f4-4b1d-b0ff-622869d2f7b2 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:57.977603 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd0f54-68f4-4b1d-b0ff-622869d2f7b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:57.978077 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bd0f54-68f4-4b1d-b0ff-622869d2f7b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:58.007585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd0f54-68f4-4b1d-b0ff-622869d2f7b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:58.011367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bd0f54-68f4-4b1d-b0ff-622869d2f7b2 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:58.025224 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 857/1721] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:57 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:33:58.089608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f3b8c6bd-e7b0-42ca-9805-018515b81a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a81920da22d9449b87859d57a78e5331', 'request_id': 'req-f3b8c6bd-e7b0-42ca-9805-018515b81a10'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:58.106934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f3b8c6bd-e7b0-42ca-9805-018515b81a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a81920da22d9449b87859d57a78e5331', 'request_id': 'req-f3b8c6bd-e7b0-42ca-9805-018515b81a10'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:58.112670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f3b8c6bd-e7b0-42ca-9805-018515b81a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a81920da22d9449b87859d57a78e5331', 'request_id': 'req-f3b8c6bd-e7b0-42ca-9805-018515b81a10'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:58.193452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f3b8c6bd-e7b0-42ca-9805-018515b81a10 admin admin] The token cache is being invalidate because project a81920da22d9449b87859d57a78e5331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:33:58.193989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f3b8c6bd-e7b0-42ca-9805-018515b81a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:58.194842 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f3b8c6bd-e7b0-42ca-9805-018515b81a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:58.197287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 865/1722] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:33:57 2022] DELETE /identity/v3/projects/a81920da22d9449b87859d57a78e5331 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:33:58.202686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b469aaa-a0e6-43ed-baff-d0a4703eb3c5 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:58.203181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b469aaa-a0e6-43ed-baff-d0a4703eb3c5 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:58.235293 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b469aaa-a0e6-43ed-baff-d0a4703eb3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:58.235293 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-2b469aaa-a0e6-43ed-baff-d0a4703eb3c5 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:58.235293 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2b469aaa-a0e6-43ed-baff-d0a4703eb3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:58.355211 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 858/1723] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:58.355901 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6273d52-ea26-465c-a330-ad9810891381 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:58.356244 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6273d52-ea26-465c-a330-ad9810891381 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:58.356523 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6273d52-ea26-465c-a330-ad9810891381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:58.379801 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-f6273d52-ea26-465c-a330-ad9810891381 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:58.380981 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f6273d52-ea26-465c-a330-ad9810891381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:58.389118 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 866/1724] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:58.393668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b469aaa-a0e6-43ed-baff-d0a4703eb3c5 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:58.404484 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b469aaa-a0e6-43ed-baff-d0a4703eb3c5 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:58.412579 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836799a-cccc-42b1-a0ad-808b71574f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:58.413334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836799a-cccc-42b1-a0ad-808b71574f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:58.413630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836799a-cccc-42b1-a0ad-808b71574f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:58.413897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836799a-cccc-42b1-a0ad-808b71574f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:58.414646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836799a-cccc-42b1-a0ad-808b71574f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:33:58.414972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836799a-cccc-42b1-a0ad-808b71574f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:58.416645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f836799a-cccc-42b1-a0ad-808b71574f43 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:58.430346 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 859/1725] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:33:58.434881 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6273d52-ea26-465c-a330-ad9810891381 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:58.444438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6273d52-ea26-465c-a330-ad9810891381 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:58.455130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4458-651d-467d-b50a-f22b34d5e7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:58.455848 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4458-651d-467d-b50a-f22b34d5e7c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:58.456212 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4458-651d-467d-b50a-f22b34d5e7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:58.456405 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fd4458-651d-467d-b50a-f22b34d5e7c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:58.457898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd4458-651d-467d-b50a-f22b34d5e7c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:58.459869 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fd4458-651d-467d-b50a-f22b34d5e7c4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:59.127364 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 867/1726] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:58 2022] POST /identity/v3/projects => generated 371 bytes in 695 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:59.131989 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836799a-cccc-42b1-a0ad-808b71574f43 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:59.142769 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836799a-cccc-42b1-a0ad-808b71574f43 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:59.205951 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4eeff7-1738-418e-b39f-7159e2d5a3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:59.207419 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eeff7-1738-418e-b39f-7159e2d5a3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:59.207706 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eeff7-1738-418e-b39f-7159e2d5a3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:59.208117 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4eeff7-1738-418e-b39f-7159e2d5a3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:59.209079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4eeff7-1738-418e-b39f-7159e2d5a3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:59.211333 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4eeff7-1738-418e-b39f-7159e2d5a3b8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:59.337361 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 860/1727] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:59 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:33:59.338368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4458-651d-467d-b50a-f22b34d5e7c4 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:59.354165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fd4458-651d-467d-b50a-f22b34d5e7c4 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:59.359568 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2aa62-b332-4cff-8612-86c970a58215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:59.360309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2aa62-b332-4cff-8612-86c970a58215 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:59.360591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2aa62-b332-4cff-8612-86c970a58215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:59.361593 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2aa62-b332-4cff-8612-86c970a58215 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:59.362327 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2aa62-b332-4cff-8612-86c970a58215 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:59.364661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2aa62-b332-4cff-8612-86c970a58215 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:59.372294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4eeff7-1738-418e-b39f-7159e2d5a3b8 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:59.374157 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-7d4eeff7-1738-418e-b39f-7159e2d5a3b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:59.384148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 868/1728] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:33:59.388110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2aa62-b332-4cff-8612-86c970a58215 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:59.388666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4eeff7-1738-418e-b39f-7159e2d5a3b8 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:59.393688 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8fc7c7-97ef-4247-bf3b-59736355c43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:59.395164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fc7c7-97ef-4247-bf3b-59736355c43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:59.395466 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fc7c7-97ef-4247-bf3b-59736355c43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:59.395745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8fc7c7-97ef-4247-bf3b-59736355c43b admin admin] PATH_INFO: `/v3/users/b1f89e4071a24137a894cc65fd5b2873` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:59.396985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fc7c7-97ef-4247-bf3b-59736355c43b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1f89e4071a24137a894cc65fd5b2873)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:59.398947 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8fc7c7-97ef-4247-bf3b-59736355c43b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:59.399065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2aa62-b332-4cff-8612-86c970a58215 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:59.404051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dcc5e-4017-4824-9b13-5da7fd3c699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:59.404715 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dcc5e-4017-4824-9b13-5da7fd3c699e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:59.404996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dcc5e-4017-4824-9b13-5da7fd3c699e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:59.405269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260dcc5e-4017-4824-9b13-5da7fd3c699e admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:59.406012 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dcc5e-4017-4824-9b13-5da7fd3c699e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:59.407707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260dcc5e-4017-4824-9b13-5da7fd3c699e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:59.420496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 869/1729] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:33:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:33:59.424350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dcc5e-4017-4824-9b13-5da7fd3c699e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:59.440419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260dcc5e-4017-4824-9b13-5da7fd3c699e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:59.446134 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcdfbc-bad5-4d8d-b6cf-6aa7456754bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:59.447145 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcdfbc-bad5-4d8d-b6cf-6aa7456754bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:59.447559 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcdfbc-bad5-4d8d-b6cf-6aa7456754bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:59.447929 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcdfbc-bad5-4d8d-b6cf-6aa7456754bc admin admin] PATH_INFO: `/v3/projects/fe0648d6fcec43acb834f3d4afb6c566/users/41daede582814bd2a09020168b401da7/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:59.464454 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcdfbc-bad5-4d8d-b6cf-6aa7456754bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0648d6fcec43acb834f3d4afb6c566, user_id=41daede582814bd2a09020168b401da7, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:59.467282 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcdfbc-bad5-4d8d-b6cf-6aa7456754bc admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:59.601267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 870/1730] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:33:59 2022] PUT /identity/v3/projects/fe0648d6fcec43acb834f3d4afb6c566/users/41daede582814bd2a09020168b401da7/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:33:59.611623 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b105c-6d3d-450a-ac12-3588ac6e1418 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:59.612537 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b105c-6d3d-450a-ac12-3588ac6e1418 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:59.614304 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b105c-6d3d-450a-ac12-3588ac6e1418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:59.638155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-2c8fc7c7-97ef-4247-bf3b-59736355c43b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1f89e4071a24137a894cc65fd5b2873'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:59.639079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-2c8fc7c7-97ef-4247-bf3b-59736355c43b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1f89e4071a24137a894cc65fd5b2873'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:59.642116 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-2c8fc7c7-97ef-4247-bf3b-59736355c43b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1f89e4071a24137a894cc65fd5b2873'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:59.649221 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-121b105c-6d3d-450a-ac12-3588ac6e1418 None None] MFA Rules not processed for user `41daede582814bd2a09020168b401da7`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:59.650742 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-121b105c-6d3d-450a-ac12-3588ac6e1418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:59.655841 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-2c8fc7c7-97ef-4247-bf3b-59736355c43b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1f89e4071a24137a894cc65fd5b2873'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:59.663607 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-2c8fc7c7-97ef-4247-bf3b-59736355c43b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1f89e4071a24137a894cc65fd5b2873'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:33:59.718284 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 871/1731] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:33:59.724162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b105c-6d3d-450a-ac12-3588ac6e1418 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:59.725550 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-121b105c-6d3d-450a-ac12-3588ac6e1418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:59.772492 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 861/1732] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:33:59 2022] DELETE /identity/v3/users/b1f89e4071a24137a894cc65fd5b2873 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:33:59.787428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66209b00-24ec-4135-a21d-aebdba2413b4 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:59.787428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66209b00-24ec-4135-a21d-aebdba2413b4 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:59.787428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66209b00-24ec-4135-a21d-aebdba2413b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:59.809952 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b105c-6d3d-450a-ac12-3588ac6e1418 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:33:59.822779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-66209b00-24ec-4135-a21d-aebdba2413b4 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:33:59.825282 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-66209b00-24ec-4135-a21d-aebdba2413b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:59.883541 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb163dd1-48fe-45d8-9768-82fa6618e0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:33:59.884130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163dd1-48fe-45d8-9768-82fa6618e0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:33:59.884410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163dd1-48fe-45d8-9768-82fa6618e0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:33:59.884691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb163dd1-48fe-45d8-9768-82fa6618e0c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:33:59.885599 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb163dd1-48fe-45d8-9768-82fa6618e0c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:33:59.887651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb163dd1-48fe-45d8-9768-82fa6618e0c5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:33:59.903442 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 862/1733] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:33:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:33:59.913316 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66209b00-24ec-4135-a21d-aebdba2413b4 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:33:59.914958 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-66209b00-24ec-4135-a21d-aebdba2413b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:33:59.982438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 872/1734] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:33:59 2022] POST /identity/v3/projects => generated 373 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:33:59.992285 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb163dd1-48fe-45d8-9768-82fa6618e0c5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:00.016762 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66209b00-24ec-4135-a21d-aebdba2413b4 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:00.077515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb163dd1-48fe-45d8-9768-82fa6618e0c5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:00.086411 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d8118-37e7-4142-9ed9-d1d57b0bff56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:00.087092 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d8118-37e7-4142-9ed9-d1d57b0bff56 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:00.087407 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d8118-37e7-4142-9ed9-d1d57b0bff56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:00.087682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d8118-37e7-4142-9ed9-d1d57b0bff56 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:00.088475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d8118-37e7-4142-9ed9-d1d57b0bff56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:00.090399 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d8118-37e7-4142-9ed9-d1d57b0bff56 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:00.096857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3fa4c-33f8-4da9-9df1-49d015184b64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:00.098178 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3fa4c-33f8-4da9-9df1-49d015184b64 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:00.098550 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3fa4c-33f8-4da9-9df1-49d015184b64 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:00.098891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3fa4c-33f8-4da9-9df1-49d015184b64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:00.111073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3fa4c-33f8-4da9-9df1-49d015184b64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:00.112962 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3fa4c-33f8-4da9-9df1-49d015184b64 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:00.139637 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 863/1735] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:33:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:34:00.207630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 873/1736] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:33:59 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:00.211630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3fa4c-33f8-4da9-9df1-49d015184b64 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:00.222750 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3fa4c-33f8-4da9-9df1-49d015184b64 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:00.233233 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99042fb7-7ce4-4762-860f-1c50df19d3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:00.233699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99042fb7-7ce4-4762-860f-1c50df19d3cd admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:00.238515 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99042fb7-7ce4-4762-860f-1c50df19d3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:00.238515 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99042fb7-7ce4-4762-860f-1c50df19d3cd admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:00.238515 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99042fb7-7ce4-4762-860f-1c50df19d3cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:00.238515 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99042fb7-7ce4-4762-860f-1c50df19d3cd admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:00.250619 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 864/1737] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:00.257091 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d8118-37e7-4142-9ed9-d1d57b0bff56 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:00.268340 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d8118-37e7-4142-9ed9-d1d57b0bff56 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:00.303956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551b954-1d52-4b74-8b70-6aa63f0d5d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:00.306104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551b954-1d52-4b74-8b70-6aa63f0d5d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:00.306104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551b954-1d52-4b74-8b70-6aa63f0d5d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:00.306104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c551b954-1d52-4b74-8b70-6aa63f0d5d46 admin admin] PATH_INFO: `/v3/projects/488e513fab084b6fbb9a58506972b4b7/users/a5e6604e41fe49959d82121499d060ef/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:00.350286 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551b954-1d52-4b74-8b70-6aa63f0d5d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=488e513fab084b6fbb9a58506972b4b7, user_id=a5e6604e41fe49959d82121499d060ef, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:00.361586 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c551b954-1d52-4b74-8b70-6aa63f0d5d46 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:00.480526 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 874/1738] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:00 2022] PUT /identity/v3/projects/488e513fab084b6fbb9a58506972b4b7/users/a5e6604e41fe49959d82121499d060ef/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:00.485180 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99042fb7-7ce4-4762-860f-1c50df19d3cd admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:00.510288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99042fb7-7ce4-4762-860f-1c50df19d3cd admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:00.634800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b75ec-8e3a-4e37-96e9-11b4725b8303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:00.636486 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b75ec-8e3a-4e37-96e9-11b4725b8303 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:00.637010 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b75ec-8e3a-4e37-96e9-11b4725b8303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:00.637680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b75ec-8e3a-4e37-96e9-11b4725b8303 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:00.638560 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b75ec-8e3a-4e37-96e9-11b4725b8303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:00.640241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b75ec-8e3a-4e37-96e9-11b4725b8303 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:00.666211 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 865/1739] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:00 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:00.670459 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551b954-1d52-4b74-8b70-6aa63f0d5d46 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:00.682496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c551b954-1d52-4b74-8b70-6aa63f0d5d46 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:00.691693 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b4e2e-24ff-48c6-aaec-e56f16160b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:00.693296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b4e2e-24ff-48c6-aaec-e56f16160b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:00.693971 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b4e2e-24ff-48c6-aaec-e56f16160b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:00.694517 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b4e2e-24ff-48c6-aaec-e56f16160b2c admin admin] PATH_INFO: `/v3/projects/488e513fab084b6fbb9a58506972b4b7/users/a5e6604e41fe49959d82121499d060ef/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:00.697949 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b4e2e-24ff-48c6-aaec-e56f16160b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=488e513fab084b6fbb9a58506972b4b7, user_id=a5e6604e41fe49959d82121499d060ef, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:00.702763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b4e2e-24ff-48c6-aaec-e56f16160b2c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:00.716107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 875/1740] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:00 2022] PUT /identity/v3/projects/488e513fab084b6fbb9a58506972b4b7/users/a5e6604e41fe49959d82121499d060ef/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:00.726494 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7c87-b934-4bec-895f-c574281dfe2b None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:00.726783 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7c87-b934-4bec-895f-c574281dfe2b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:00.727124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae7c87-b934-4bec-895f-c574281dfe2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:00.757713 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-4aae7c87-b934-4bec-895f-c574281dfe2b None None] MFA Rules not processed for user `a5e6604e41fe49959d82121499d060ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:00.759177 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-4aae7c87-b934-4bec-895f-c574281dfe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:00.849930 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 866/1741] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:00 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:00.860559 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b4e2e-24ff-48c6-aaec-e56f16160b2c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:00.868185 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae7c87-b934-4bec-895f-c574281dfe2b None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:00.873130 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-4aae7c87-b934-4bec-895f-c574281dfe2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:00.877501 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-112b4e2e-24ff-48c6-aaec-e56f16160b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:00.966531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae7c87-b934-4bec-895f-c574281dfe2b None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:00.970466 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53aa7e-6300-455e-88b6-2055c4285581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:00.971069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53aa7e-6300-455e-88b6-2055c4285581 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:00.971415 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53aa7e-6300-455e-88b6-2055c4285581 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:00.971724 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac53aa7e-6300-455e-88b6-2055c4285581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:00.973790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b4e2e-24ff-48c6-aaec-e56f16160b2c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:00.982124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53aa7e-6300-455e-88b6-2055c4285581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:00.983609 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac53aa7e-6300-455e-88b6-2055c4285581 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:00.983956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:00.984903 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:00.985190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:00.985462 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] PATH_INFO: `/v3/projects/7c007d40ae714173973fee2f9394309d` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:00.986859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c007d40ae714173973fee2f9394309d)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:00.989822 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:00.994870 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 867/1742] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:00 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:01.339646 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c007d40ae714173973fee2f9394309d', 'request_id': 'req-b46c0295-693a-4d5b-9904-f71b82ce1a27'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:01.345981 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c007d40ae714173973fee2f9394309d', 'request_id': 'req-b46c0295-693a-4d5b-9904-f71b82ce1a27'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:01.352246 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c007d40ae714173973fee2f9394309d', 'request_id': 'req-b46c0295-693a-4d5b-9904-f71b82ce1a27'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:01.549238 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] The token cache is being invalidate because project 7c007d40ae714173973fee2f9394309d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:01.549545 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:01.550268 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:01.552014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 876/1743] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:00 2022] DELETE /identity/v3/projects/7c007d40ae714173973fee2f9394309d => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:01.556828 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53aa7e-6300-455e-88b6-2055c4285581 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:01.579082 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac53aa7e-6300-455e-88b6-2055c4285581 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:01.706777 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ba8d6-33af-44b4-9837-f12c2986f915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:01.707928 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ba8d6-33af-44b4-9837-f12c2986f915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:01.708181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ba8d6-33af-44b4-9837-f12c2986f915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:01.708446 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ba8d6-33af-44b4-9837-f12c2986f915 admin admin] PATH_INFO: `/v3/users/e9ac955b4a1548368cbccff8632c9d4e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:01.711874 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ba8d6-33af-44b4-9837-f12c2986f915 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9ac955b4a1548368cbccff8632c9d4e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:01.714693 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ba8d6-33af-44b4-9837-f12c2986f915 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:02.063486 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-443ba8d6-33af-44b4-9837-f12c2986f915 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9ac955b4a1548368cbccff8632c9d4e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.065976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-443ba8d6-33af-44b4-9837-f12c2986f915 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9ac955b4a1548368cbccff8632c9d4e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.068424 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-443ba8d6-33af-44b4-9837-f12c2986f915 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9ac955b4a1548368cbccff8632c9d4e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.094105 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-443ba8d6-33af-44b4-9837-f12c2986f915 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9ac955b4a1548368cbccff8632c9d4e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.124861 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-443ba8d6-33af-44b4-9837-f12c2986f915 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9ac955b4a1548368cbccff8632c9d4e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.259129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 868/1744] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:01 2022] DELETE /identity/v3/users/e9ac955b4a1548368cbccff8632c9d4e => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:02.607219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:02.607219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:02.623008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c0295-693a-4d5b-9904-f71b82ce1a27 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:02.686097 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf898fc-5227-4d03-8f73-131066d40042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:02.687020 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf898fc-5227-4d03-8f73-131066d40042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:02.687346 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf898fc-5227-4d03-8f73-131066d40042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:02.687651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf898fc-5227-4d03-8f73-131066d40042 admin admin] PATH_INFO: `/v3/users/41daede582814bd2a09020168b401da7` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:02.689005 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf898fc-5227-4d03-8f73-131066d40042 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41daede582814bd2a09020168b401da7)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:02.691839 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf898fc-5227-4d03-8f73-131066d40042 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:02.856700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ba8d6-33af-44b4-9837-f12c2986f915 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:02.858880 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-443ba8d6-33af-44b4-9837-f12c2986f915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:02.880131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ba8d6-33af-44b4-9837-f12c2986f915 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:02.881449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-bdf898fc-5227-4d03-8f73-131066d40042 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41daede582814bd2a09020168b401da7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.882293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-bdf898fc-5227-4d03-8f73-131066d40042 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41daede582814bd2a09020168b401da7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.883665 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-bdf898fc-5227-4d03-8f73-131066d40042 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41daede582814bd2a09020168b401da7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.892671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:02.893317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:02.893601 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:02.894410 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] PATH_INFO: `/v3/projects/aba5539588f246759389b6c5f7be53f8` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:02.896494 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba5539588f246759389b6c5f7be53f8)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:02.898433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:02.911974 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-bdf898fc-5227-4d03-8f73-131066d40042 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41daede582814bd2a09020168b401da7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:02.921581 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-bdf898fc-5227-4d03-8f73-131066d40042 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41daede582814bd2a09020168b401da7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.028579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 877/1745] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:02 2022] DELETE /identity/v3/users/41daede582814bd2a09020168b401da7 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:03.032919 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9390c-bb1d-4460-99dc-f286d45843be None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:03.040410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9390c-bb1d-4460-99dc-f286d45843be None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:03.040410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d9390c-bb1d-4460-99dc-f286d45843be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:03.051243 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-09d9390c-bb1d-4460-99dc-f286d45843be None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:03.052218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba5539588f246759389b6c5f7be53f8', 'request_id': 'req-fcaa4d17-0321-47a1-9236-1689f984cb55'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.052442 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-09d9390c-bb1d-4460-99dc-f286d45843be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:03.096406 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba5539588f246759389b6c5f7be53f8', 'request_id': 'req-fcaa4d17-0321-47a1-9236-1689f984cb55'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.103119 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba5539588f246759389b6c5f7be53f8', 'request_id': 'req-fcaa4d17-0321-47a1-9236-1689f984cb55'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.110247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 878/1746] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:03.114495 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] The token cache is being invalidate because project aba5539588f246759389b6c5f7be53f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:03.114881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.115587 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.117128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 869/1747] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:02 2022] DELETE /identity/v3/projects/aba5539588f246759389b6c5f7be53f8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:03.121848 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37163a15-5857-49b5-a90a-c007aa787987 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:03.122140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37163a15-5857-49b5-a90a-c007aa787987 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:03.122409 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37163a15-5857-49b5-a90a-c007aa787987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:03.123817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:03.125492 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:03.143678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-37163a15-5857-49b5-a90a-c007aa787987 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:03.145760 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-37163a15-5857-49b5-a90a-c007aa787987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:03.154252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 879/1748] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:03.165349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4177430-60ad-4027-96c4-3c7765d7f6e0 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:03.165908 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4177430-60ad-4027-96c4-3c7765d7f6e0 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:03.166183 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4177430-60ad-4027-96c4-3c7765d7f6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:03.189762 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaa4d17-0321-47a1-9236-1689f984cb55 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:03.189935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-d4177430-60ad-4027-96c4-3c7765d7f6e0 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:03.191757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d4177430-60ad-4027-96c4-3c7765d7f6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:03.194289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86edaac-0f29-4cbc-aadd-12246fd77dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:03.195062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86edaac-0f29-4cbc-aadd-12246fd77dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:03.195406 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86edaac-0f29-4cbc-aadd-12246fd77dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:03.195746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86edaac-0f29-4cbc-aadd-12246fd77dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:03.197602 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c86edaac-0f29-4cbc-aadd-12246fd77dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:03.200995 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 880/1749] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:03.205079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4177430-60ad-4027-96c4-3c7765d7f6e0 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:03.210932 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86edaac-0f29-4cbc-aadd-12246fd77dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:03.212448 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86edaac-0f29-4cbc-aadd-12246fd77dc1 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:03.214985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4177430-60ad-4027-96c4-3c7765d7f6e0 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:03.220047 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d55aee-fc78-4eb5-82b6-ac0c7e858107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:03.220689 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55aee-fc78-4eb5-82b6-ac0c7e858107 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:03.220966 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55aee-fc78-4eb5-82b6-ac0c7e858107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:03.221239 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d55aee-fc78-4eb5-82b6-ac0c7e858107 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:03.222527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d55aee-fc78-4eb5-82b6-ac0c7e858107 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:03.222992 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d55aee-fc78-4eb5-82b6-ac0c7e858107 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:03.223102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 870/1750] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:34:03.224480 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d55aee-fc78-4eb5-82b6-ac0c7e858107 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:03.238295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 881/1751] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:34:03.242591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86edaac-0f29-4cbc-aadd-12246fd77dc1 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:03.257760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86edaac-0f29-4cbc-aadd-12246fd77dc1 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:03.263068 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a955a-2673-4330-b09f-1ca1c6449dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:03.263758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a955a-2673-4330-b09f-1ca1c6449dfc admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:03.264135 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a955a-2673-4330-b09f-1ca1c6449dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:03.264378 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a955a-2673-4330-b09f-1ca1c6449dfc admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:03.265102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a955a-2673-4330-b09f-1ca1c6449dfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:03.267032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a955a-2673-4330-b09f-1ca1c6449dfc admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:03.402598 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 871/1752] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:03 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:03.406235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d55aee-fc78-4eb5-82b6-ac0c7e858107 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:03.417435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d55aee-fc78-4eb5-82b6-ac0c7e858107 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:03.476775 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64783a-85fd-45f0-9c12-ced82ad8ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:03.477443 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64783a-85fd-45f0-9c12-ced82ad8ab35 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:03.477728 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64783a-85fd-45f0-9c12-ced82ad8ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:03.478054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64783a-85fd-45f0-9c12-ced82ad8ab35 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:03.478769 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64783a-85fd-45f0-9c12-ced82ad8ab35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:03.480951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64783a-85fd-45f0-9c12-ced82ad8ab35 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:03.573959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 882/1753] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:03 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:03.578128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a955a-2673-4330-b09f-1ca1c6449dfc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:03.589094 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a955a-2673-4330-b09f-1ca1c6449dfc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:03.594809 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db98cfe-e7e1-402d-8fae-514720a67c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:03.595505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db98cfe-e7e1-402d-8fae-514720a67c58 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:03.595787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db98cfe-e7e1-402d-8fae-514720a67c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:03.596064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db98cfe-e7e1-402d-8fae-514720a67c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:03.597507 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db98cfe-e7e1-402d-8fae-514720a67c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:03.599120 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db98cfe-e7e1-402d-8fae-514720a67c58 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:03.610336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 872/1754] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:03.615165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64783a-85fd-45f0-9c12-ced82ad8ab35 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:03.625539 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64783a-85fd-45f0-9c12-ced82ad8ab35 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:03.630427 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6eec5a-2cb3-4023-9b47-d2e99c5965c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:03.631115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6eec5a-2cb3-4023-9b47-d2e99c5965c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:03.631430 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6eec5a-2cb3-4023-9b47-d2e99c5965c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:03.631707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6eec5a-2cb3-4023-9b47-d2e99c5965c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:03.632474 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6eec5a-2cb3-4023-9b47-d2e99c5965c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:03.634042 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6eec5a-2cb3-4023-9b47-d2e99c5965c7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:03.644671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 883/1755] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:03.648867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db98cfe-e7e1-402d-8fae-514720a67c58 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:03.659016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db98cfe-e7e1-402d-8fae-514720a67c58 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:03.667155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f96bde9-3749-4d65-a8a7-cb4d256027f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:03.668183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bde9-3749-4d65-a8a7-cb4d256027f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:03.668599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bde9-3749-4d65-a8a7-cb4d256027f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:03.669039 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f96bde9-3749-4d65-a8a7-cb4d256027f8 admin admin] PATH_INFO: `/v3/projects/3adcf8a1423446daaf9173f344e9e250/users/148f677a16c34874a50a88af92eb2c6b/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:03.670091 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6eec5a-2cb3-4023-9b47-d2e99c5965c7 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:03.672192 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9a6eec5a-2cb3-4023-9b47-d2e99c5965c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:03.687406 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96bde9-3749-4d65-a8a7-cb4d256027f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3adcf8a1423446daaf9173f344e9e250, user_id=148f677a16c34874a50a88af92eb2c6b, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:03.689707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6eec5a-2cb3-4023-9b47-d2e99c5965c7 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:03.690421 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f96bde9-3749-4d65-a8a7-cb4d256027f8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:03.696476 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:03.697742 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:03.698024 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:03.698296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] PATH_INFO: `/v3/projects/fe0648d6fcec43acb834f3d4afb6c566` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:03.702235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0648d6fcec43acb834f3d4afb6c566)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:03.702235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:03.772053 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 873/1756] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:03 2022] PUT /identity/v3/projects/3adcf8a1423446daaf9173f344e9e250/users/148f677a16c34874a50a88af92eb2c6b/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:03.786793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b127f25-ecc6-4e45-b6f1-c4ce1f6a499c None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:03.787088 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b127f25-ecc6-4e45-b6f1-c4ce1f6a499c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:03.787331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b127f25-ecc6-4e45-b6f1-c4ce1f6a499c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:03.810621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0648d6fcec43acb834f3d4afb6c566', 'request_id': 'req-caa08152-30f2-4609-ae7a-d37273bbf2dd'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.818524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0648d6fcec43acb834f3d4afb6c566', 'request_id': 'req-caa08152-30f2-4609-ae7a-d37273bbf2dd'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.822113 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-9b127f25-ecc6-4e45-b6f1-c4ce1f6a499c None None] MFA Rules not processed for user `148f677a16c34874a50a88af92eb2c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:03.823535 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9b127f25-ecc6-4e45-b6f1-c4ce1f6a499c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:03.825373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0648d6fcec43acb834f3d4afb6c566', 'request_id': 'req-caa08152-30f2-4609-ae7a-d37273bbf2dd'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.889750 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 874/1757] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:03.894928 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b127f25-ecc6-4e45-b6f1-c4ce1f6a499c None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:03.924607 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] The token cache is being invalidate because project fe0648d6fcec43acb834f3d4afb6c566 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:03.925136 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.925786 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:03.927496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 884/1758] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:03 2022] DELETE /identity/v3/projects/fe0648d6fcec43acb834f3d4afb6c566 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:03.931296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:03.932706 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:03.958315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b127f25-ecc6-4e45-b6f1-c4ce1f6a499c None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:03.964677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ea41-0ccc-42a3-a8c1-8cb9b6192dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:03.965337 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ea41-0ccc-42a3-a8c1-8cb9b6192dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:03.965615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ea41-0ccc-42a3-a8c1-8cb9b6192dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:03.965886 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88ea41-0ccc-42a3-a8c1-8cb9b6192dd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:03.966586 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88ea41-0ccc-42a3-a8c1-8cb9b6192dd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:03.968653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88ea41-0ccc-42a3-a8c1-8cb9b6192dd3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:03.999207 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa08152-30f2-4609-ae7a-d37273bbf2dd admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:04.004615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5f71a-fd75-47be-ad59-e4b3a6294563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:04.005544 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5f71a-fd75-47be-ad59-e4b3a6294563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:04.005867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5f71a-fd75-47be-ad59-e4b3a6294563 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:04.006139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5f71a-fd75-47be-ad59-e4b3a6294563 admin admin] PATH_INFO: `/v3/users/a5e6604e41fe49959d82121499d060ef` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:04.007448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5f71a-fd75-47be-ad59-e4b3a6294563 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5e6604e41fe49959d82121499d060ef)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:04.009392 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5f71a-fd75-47be-ad59-e4b3a6294563 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:04.053158 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 875/1759] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:03 2022] POST /identity/v3/projects => generated 365 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:04.057111 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ea41-0ccc-42a3-a8c1-8cb9b6192dd3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:04.058740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-fd88ea41-0ccc-42a3-a8c1-8cb9b6192dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:04.128530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88ea41-0ccc-42a3-a8c1-8cb9b6192dd3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:04.133362 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305ba12-94da-45df-accb-9731596fdce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:04.140139 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305ba12-94da-45df-accb-9731596fdce3 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:04.140139 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305ba12-94da-45df-accb-9731596fdce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:04.140139 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305ba12-94da-45df-accb-9731596fdce3 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:04.140139 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305ba12-94da-45df-accb-9731596fdce3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:04.140139 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305ba12-94da-45df-accb-9731596fdce3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:04.222686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 876/1760] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:04 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:04.226284 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305ba12-94da-45df-accb-9731596fdce3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:04.236062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305ba12-94da-45df-accb-9731596fdce3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:04.241454 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f18f2-acf0-4a8a-b1ab-d822df550b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:04.242116 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f18f2-acf0-4a8a-b1ab-d822df550b5f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:04.242391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f18f2-acf0-4a8a-b1ab-d822df550b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:04.242664 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896f18f2-acf0-4a8a-b1ab-d822df550b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:04.243582 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f18f2-acf0-4a8a-b1ab-d822df550b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:04.245107 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896f18f2-acf0-4a8a-b1ab-d822df550b5f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:04.255620 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 877/1761] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:04.259981 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f18f2-acf0-4a8a-b1ab-d822df550b5f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:04.269181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896f18f2-acf0-4a8a-b1ab-d822df550b5f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:04.273955 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152b801-c7a0-401b-8803-1432b55d03fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:04.275347 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152b801-c7a0-401b-8803-1432b55d03fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:04.275629 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152b801-c7a0-401b-8803-1432b55d03fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:04.275905 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152b801-c7a0-401b-8803-1432b55d03fa admin admin] PATH_INFO: `/v3/projects/21d6de18f9204106b60683d1a7ac44f3/users/081e25aa05da4109bec64ca81b3244be/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:04.283644 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2bb5f71a-fd75-47be-ad59-e4b3a6294563 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5e6604e41fe49959d82121499d060ef'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:04.284516 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2bb5f71a-fd75-47be-ad59-e4b3a6294563 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5e6604e41fe49959d82121499d060ef'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:04.285714 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2bb5f71a-fd75-47be-ad59-e4b3a6294563 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5e6604e41fe49959d82121499d060ef'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:04.291060 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152b801-c7a0-401b-8803-1432b55d03fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d6de18f9204106b60683d1a7ac44f3, user_id=081e25aa05da4109bec64ca81b3244be, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:04.293716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3152b801-c7a0-401b-8803-1432b55d03fa admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:04.297421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2bb5f71a-fd75-47be-ad59-e4b3a6294563 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5e6604e41fe49959d82121499d060ef'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:04.309144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2bb5f71a-fd75-47be-ad59-e4b3a6294563 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5e6604e41fe49959d82121499d060ef'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:04.359250 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 878/1762] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:04 2022] PUT /identity/v3/projects/21d6de18f9204106b60683d1a7ac44f3/users/081e25aa05da4109bec64ca81b3244be/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:04.363624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152b801-c7a0-401b-8803-1432b55d03fa admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:04.365313 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3152b801-c7a0-401b-8803-1432b55d03fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:04.376212 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 885/1763] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:03 2022] DELETE /identity/v3/users/a5e6604e41fe49959d82121499d060ef => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:04.429284 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152b801-c7a0-401b-8803-1432b55d03fa admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:04.484054 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdad696-4582-44e4-a411-20f77821991e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:04.484716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdad696-4582-44e4-a411-20f77821991e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:04.484998 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdad696-4582-44e4-a411-20f77821991e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:04.485272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdad696-4582-44e4-a411-20f77821991e admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:04.486007 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdad696-4582-44e4-a411-20f77821991e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:04.488305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdad696-4582-44e4-a411-20f77821991e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:04.497777 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 879/1764] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:04 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:04.501919 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5f71a-fd75-47be-ad59-e4b3a6294563 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:04.512919 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5f71a-fd75-47be-ad59-e4b3a6294563 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:04.517542 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d51207-9fa0-4f83-8541-d93df056869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:04.518405 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d51207-9fa0-4f83-8541-d93df056869f admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:04.518764 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d51207-9fa0-4f83-8541-d93df056869f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:04.519041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d51207-9fa0-4f83-8541-d93df056869f admin admin] PATH_INFO: `/v3/projects/21d6de18f9204106b60683d1a7ac44f3/users/081e25aa05da4109bec64ca81b3244be/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:04.521221 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d51207-9fa0-4f83-8541-d93df056869f admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d6de18f9204106b60683d1a7ac44f3, user_id=081e25aa05da4109bec64ca81b3244be, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:04.523974 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d51207-9fa0-4f83-8541-d93df056869f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:04.534135 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 886/1765] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:04 2022] PUT /identity/v3/projects/21d6de18f9204106b60683d1a7ac44f3/users/081e25aa05da4109bec64ca81b3244be/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:04.544508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6440-15dd-48a2-bcda-f05e010c99f3 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:04.544869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6440-15dd-48a2-bcda-f05e010c99f3 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:04.545256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6440-15dd-48a2-bcda-f05e010c99f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:04.573455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-384e6440-15dd-48a2-bcda-f05e010c99f3 None None] MFA Rules not processed for user `081e25aa05da4109bec64ca81b3244be`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:04.574606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-384e6440-15dd-48a2-bcda-f05e010c99f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:04.646722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 880/1766] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:04 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:04.658847 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d51207-9fa0-4f83-8541-d93df056869f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:04.662086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-89d51207-9fa0-4f83-8541-d93df056869f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:04.722769 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d51207-9fa0-4f83-8541-d93df056869f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:04.726489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2543b-0e1b-479d-8d65-a7ca056a4409 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:04.727133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2543b-0e1b-479d-8d65-a7ca056a4409 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:04.727450 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2543b-0e1b-479d-8d65-a7ca056a4409 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:04.727729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2543b-0e1b-479d-8d65-a7ca056a4409 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:04.736938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2543b-0e1b-479d-8d65-a7ca056a4409 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:04.738508 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2543b-0e1b-479d-8d65-a7ca056a4409 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:04.747718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 887/1767] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:04 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:04.852433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e6440-15dd-48a2-bcda-f05e010c99f3 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:04.853690 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-384e6440-15dd-48a2-bcda-f05e010c99f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:04.942501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e6440-15dd-48a2-bcda-f05e010c99f3 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:04.947251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118e3f95-ad21-4ff7-b18f-1abae57856a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:04.948108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e3f95-ad21-4ff7-b18f-1abae57856a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:04.948386 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e3f95-ad21-4ff7-b18f-1abae57856a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:04.948658 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118e3f95-ad21-4ff7-b18f-1abae57856a4 admin admin] PATH_INFO: `/v3/projects/488e513fab084b6fbb9a58506972b4b7` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:04.949989 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e3f95-ad21-4ff7-b18f-1abae57856a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488e513fab084b6fbb9a58506972b4b7)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:04.951775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118e3f95-ad21-4ff7-b18f-1abae57856a4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:05.063514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2543b-0e1b-479d-8d65-a7ca056a4409 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:05.075216 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2543b-0e1b-479d-8d65-a7ca056a4409 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:05.077259 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-118e3f95-ad21-4ff7-b18f-1abae57856a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488e513fab084b6fbb9a58506972b4b7', 'request_id': 'req-118e3f95-ad21-4ff7-b18f-1abae57856a4'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:05.166402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba5379-ca2d-4879-aefa-7aa98107a43a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:05.168142 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba5379-ca2d-4879-aefa-7aa98107a43a service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:05.168604 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba5379-ca2d-4879-aefa-7aa98107a43a service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:05.169268 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba5379-ca2d-4879-aefa-7aa98107a43a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:05.171532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-deba5379-ca2d-4879-aefa-7aa98107a43a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:05.194627 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-118e3f95-ad21-4ff7-b18f-1abae57856a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488e513fab084b6fbb9a58506972b4b7', 'request_id': 'req-118e3f95-ad21-4ff7-b18f-1abae57856a4'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:05.201231 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-118e3f95-ad21-4ff7-b18f-1abae57856a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488e513fab084b6fbb9a58506972b4b7', 'request_id': 'req-118e3f95-ad21-4ff7-b18f-1abae57856a4'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:05.236773 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-118e3f95-ad21-4ff7-b18f-1abae57856a4 admin admin] The token cache is being invalidate because project 488e513fab084b6fbb9a58506972b4b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:05.237052 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-118e3f95-ad21-4ff7-b18f-1abae57856a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:05.238607 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-118e3f95-ad21-4ff7-b18f-1abae57856a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:05.243070 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 881/1768] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:04 2022] DELETE /identity/v3/projects/488e513fab084b6fbb9a58506972b4b7 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:05.244567 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506479a-baf5-4f92-9a42-b043aec33e8b None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:05.244867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506479a-baf5-4f92-9a42-b043aec33e8b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:05.245171 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506479a-baf5-4f92-9a42-b043aec33e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:05.281689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-f506479a-baf5-4f92-9a42-b043aec33e8b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:05.282928 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f506479a-baf5-4f92-9a42-b043aec33e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:05.359589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba5379-ca2d-4879-aefa-7aa98107a43a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:05.361262 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba5379-ca2d-4879-aefa-7aa98107a43a service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:05.375444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 888/1769] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:34:05.406436 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 882/1770] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:05.410241 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000c0a-8ae3-4fe9-9461-aa1db07d8d74 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:05.410604 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000c0a-8ae3-4fe9-9461-aa1db07d8d74 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:05.411067 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb000c0a-8ae3-4fe9-9461-aa1db07d8d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:05.470019 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-bb000c0a-8ae3-4fe9-9461-aa1db07d8d74 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:05.474330 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-bb000c0a-8ae3-4fe9-9461-aa1db07d8d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:05.516709 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 889/1771] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:05.519886 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506479a-baf5-4f92-9a42-b043aec33e8b None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:05.540219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506479a-baf5-4f92-9a42-b043aec33e8b None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:05.559026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d7550-4e3d-4c44-b828-df8c0c78b236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:05.560209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d7550-4e3d-4c44-b828-df8c0c78b236 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:05.561249 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d7550-4e3d-4c44-b828-df8c0c78b236 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:05.561396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d7550-4e3d-4c44-b828-df8c0c78b236 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:05.563107 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d7550-4e3d-4c44-b828-df8c0c78b236 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:05.563444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d7550-4e3d-4c44-b828-df8c0c78b236 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:05.565080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d7550-4e3d-4c44-b828-df8c0c78b236 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:05.598766 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 883/1772] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:34:05.599952 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb000c0a-8ae3-4fe9-9461-aa1db07d8d74 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:05.621677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb000c0a-8ae3-4fe9-9461-aa1db07d8d74 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:05.631368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda064e-c231-43f1-8fb5-8e4fb50d84eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:05.632170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda064e-c231-43f1-8fb5-8e4fb50d84eb admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:05.632461 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda064e-c231-43f1-8fb5-8e4fb50d84eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:05.632734 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda064e-c231-43f1-8fb5-8e4fb50d84eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:05.635647 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda064e-c231-43f1-8fb5-8e4fb50d84eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:05.638527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda064e-c231-43f1-8fb5-8e4fb50d84eb admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:05.772379 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d7550-4e3d-4c44-b828-df8c0c78b236 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:05.778547 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 890/1773] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:05 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:05.789944 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d7550-4e3d-4c44-b828-df8c0c78b236 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:05.859663 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c21c36-ae10-4eac-93f3-a6d98ee85e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:05.860686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c21c36-ae10-4eac-93f3-a6d98ee85e94 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:05.861112 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c21c36-ae10-4eac-93f3-a6d98ee85e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:05.861519 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c21c36-ae10-4eac-93f3-a6d98ee85e94 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:05.862985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c21c36-ae10-4eac-93f3-a6d98ee85e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:05.867550 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c21c36-ae10-4eac-93f3-a6d98ee85e94 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:05.967687 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 884/1774] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:05 2022] POST /identity/v3/users => generated 284 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:05.976269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda064e-c231-43f1-8fb5-8e4fb50d84eb admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:05.994440 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda064e-c231-43f1-8fb5-8e4fb50d84eb admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:06.001522 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465315a-8123-4f88-8353-b0a4c691635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:06.001856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465315a-8123-4f88-8353-b0a4c691635e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:06.002168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465315a-8123-4f88-8353-b0a4c691635e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:06.002438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465315a-8123-4f88-8353-b0a4c691635e admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:06.004366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465315a-8123-4f88-8353-b0a4c691635e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:06.006362 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465315a-8123-4f88-8353-b0a4c691635e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:06.027473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 891/1775] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:06.031553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c21c36-ae10-4eac-93f3-a6d98ee85e94 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:06.044979 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c21c36-ae10-4eac-93f3-a6d98ee85e94 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:06.051805 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d75d391-1eae-45f3-bb63-f6ed21753967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:06.052722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75d391-1eae-45f3-bb63-f6ed21753967 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:06.053098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75d391-1eae-45f3-bb63-f6ed21753967 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:06.053462 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d75d391-1eae-45f3-bb63-f6ed21753967 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:06.054324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75d391-1eae-45f3-bb63-f6ed21753967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:06.058017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d75d391-1eae-45f3-bb63-f6ed21753967 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:06.075195 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 885/1776] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:06.076766 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465315a-8123-4f88-8353-b0a4c691635e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:06.105968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465315a-8123-4f88-8353-b0a4c691635e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:06.111398 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58bea9-b210-4998-bbd8-e93612950878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:06.112560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58bea9-b210-4998-bbd8-e93612950878 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:06.113338 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58bea9-b210-4998-bbd8-e93612950878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:06.113606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58bea9-b210-4998-bbd8-e93612950878 admin admin] PATH_INFO: `/v3/projects/a079280fd13b485c918ba517814b6331/users/cc48c82b6d1740a9b81c4da2de0f1501/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:06.145036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58bea9-b210-4998-bbd8-e93612950878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a079280fd13b485c918ba517814b6331, user_id=cc48c82b6d1740a9b81c4da2de0f1501, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:06.148124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58bea9-b210-4998-bbd8-e93612950878 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:06.297559 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 892/1777] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:06 2022] PUT /identity/v3/projects/a079280fd13b485c918ba517814b6331/users/cc48c82b6d1740a9b81c4da2de0f1501/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:06.308241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5629c1f-4bf5-49bb-ad0e-730eb4e01a73 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:06.309979 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5629c1f-4bf5-49bb-ad0e-730eb4e01a73 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:06.310519 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5629c1f-4bf5-49bb-ad0e-730eb4e01a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:06.363202 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c5629c1f-4bf5-49bb-ad0e-730eb4e01a73 None None] MFA Rules not processed for user `cc48c82b6d1740a9b81c4da2de0f1501`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:06.364652 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c5629c1f-4bf5-49bb-ad0e-730eb4e01a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:06.482318 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58bea9-b210-4998-bbd8-e93612950878 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:06.482938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 886/1778] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:06.546777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58bea9-b210-4998-bbd8-e93612950878 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:06.552144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65408dff-8eab-46a7-b16a-f7e15166216c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:06.552817 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65408dff-8eab-46a7-b16a-f7e15166216c admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:06.553161 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65408dff-8eab-46a7-b16a-f7e15166216c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:06.553437 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65408dff-8eab-46a7-b16a-f7e15166216c admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:06.554152 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65408dff-8eab-46a7-b16a-f7e15166216c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:06.556167 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65408dff-8eab-46a7-b16a-f7e15166216c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:06.676246 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 893/1779] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:06 2022] POST /identity/v3/projects => generated 369 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:06.680517 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5629c1f-4bf5-49bb-ad0e-730eb4e01a73 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:06.692625 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5629c1f-4bf5-49bb-ad0e-730eb4e01a73 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:06.752314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423f80e-ffdc-4c28-99e2-f402868caa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:06.753010 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423f80e-ffdc-4c28-99e2-f402868caa04 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:06.753488 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423f80e-ffdc-4c28-99e2-f402868caa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:06.753883 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423f80e-ffdc-4c28-99e2-f402868caa04 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:06.754595 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423f80e-ffdc-4c28-99e2-f402868caa04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:06.756549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423f80e-ffdc-4c28-99e2-f402868caa04 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:06.908717 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 887/1780] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:06 2022] POST /identity/v3/users => generated 291 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:06.916152 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65408dff-8eab-46a7-b16a-f7e15166216c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:06.931316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65408dff-8eab-46a7-b16a-f7e15166216c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:06.944595 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75f1ca-17dc-4433-a5c8-cdb5700cf286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:06.945372 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f1ca-17dc-4433-a5c8-cdb5700cf286 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:06.945722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f1ca-17dc-4433-a5c8-cdb5700cf286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:06.946084 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75f1ca-17dc-4433-a5c8-cdb5700cf286 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:06.946966 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75f1ca-17dc-4433-a5c8-cdb5700cf286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:06.948719 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75f1ca-17dc-4433-a5c8-cdb5700cf286 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:06.973651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423f80e-ffdc-4c28-99e2-f402868caa04 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:06.974792 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 894/1781] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:06.984431 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423f80e-ffdc-4c28-99e2-f402868caa04 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:06.989572 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998ad9b-6cea-4ad9-bebf-d959bb10881c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:06.990528 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998ad9b-6cea-4ad9-bebf-d959bb10881c admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:06.990945 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998ad9b-6cea-4ad9-bebf-d959bb10881c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:06.991246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8998ad9b-6cea-4ad9-bebf-d959bb10881c admin admin] PATH_INFO: `/v3/projects/fe818514e7c54f888ed52211dadc284f/users/07622ac6feb249e7adf8cb3b9bda2b66/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:07.040525 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998ad9b-6cea-4ad9-bebf-d959bb10881c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe818514e7c54f888ed52211dadc284f, user_id=07622ac6feb249e7adf8cb3b9bda2b66, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:07.050086 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8998ad9b-6cea-4ad9-bebf-d959bb10881c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:07.189096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 888/1782] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:06 2022] PUT /identity/v3/projects/fe818514e7c54f888ed52211dadc284f/users/07622ac6feb249e7adf8cb3b9bda2b66/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:07.193523 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75f1ca-17dc-4433-a5c8-cdb5700cf286 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:07.218825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75f1ca-17dc-4433-a5c8-cdb5700cf286 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:07.358449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f5c52-26a5-41cd-bc4d-4c824b6ce296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:07.359133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f5c52-26a5-41cd-bc4d-4c824b6ce296 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:07.360755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f5c52-26a5-41cd-bc4d-4c824b6ce296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:07.360755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f5c52-26a5-41cd-bc4d-4c824b6ce296 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:07.360755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f5c52-26a5-41cd-bc4d-4c824b6ce296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:07.371148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f5c52-26a5-41cd-bc4d-4c824b6ce296 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:07.402301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 895/1783] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:07.409159 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998ad9b-6cea-4ad9-bebf-d959bb10881c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:07.429897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8998ad9b-6cea-4ad9-bebf-d959bb10881c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:07.443510 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a32b78-5a67-46f4-b1ae-93487a47a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:07.445510 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a32b78-5a67-46f4-b1ae-93487a47a0cf admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:07.446091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a32b78-5a67-46f4-b1ae-93487a47a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:07.447751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a32b78-5a67-46f4-b1ae-93487a47a0cf admin admin] PATH_INFO: `/v3/projects/fe818514e7c54f888ed52211dadc284f/users/07622ac6feb249e7adf8cb3b9bda2b66/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:07.460151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a32b78-5a67-46f4-b1ae-93487a47a0cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe818514e7c54f888ed52211dadc284f, user_id=07622ac6feb249e7adf8cb3b9bda2b66, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:07.466033 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a32b78-5a67-46f4-b1ae-93487a47a0cf admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:07.486041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 889/1784] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:07 2022] PUT /identity/v3/projects/fe818514e7c54f888ed52211dadc284f/users/07622ac6feb249e7adf8cb3b9bda2b66/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:07.495712 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cf2e9-0f61-4ab3-9b85-1968243fc55b None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:07.496014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cf2e9-0f61-4ab3-9b85-1968243fc55b None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:07.496282 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037cf2e9-0f61-4ab3-9b85-1968243fc55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:07.526360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-037cf2e9-0f61-4ab3-9b85-1968243fc55b None None] MFA Rules not processed for user `07622ac6feb249e7adf8cb3b9bda2b66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:07.527630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-037cf2e9-0f61-4ab3-9b85-1968243fc55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:07.606598 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 896/1785] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:07 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:07.793794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a32b78-5a67-46f4-b1ae-93487a47a0cf admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:07.796503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-76a32b78-5a67-46f4-b1ae-93487a47a0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:07.882984 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a32b78-5a67-46f4-b1ae-93487a47a0cf admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:07.888842 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8097e6-ac0d-422e-a0c9-edcd9158fee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:07.891900 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8097e6-ac0d-422e-a0c9-edcd9158fee6 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:07.892614 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8097e6-ac0d-422e-a0c9-edcd9158fee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:07.892995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8097e6-ac0d-422e-a0c9-edcd9158fee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:07.904593 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8097e6-ac0d-422e-a0c9-edcd9158fee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:07.906089 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8097e6-ac0d-422e-a0c9-edcd9158fee6 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:07.918398 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 890/1786] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:07 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:09.855345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c81f60-3080-4d3e-8d76-045c1f6a78d2 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:09.855345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c81f60-3080-4d3e-8d76-045c1f6a78d2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:09.855345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c81f60-3080-4d3e-8d76-045c1f6a78d2 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:09.855345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 897/1787] 10.222.0.35 () {54 vars in 921 bytes} [Sat Feb 12 04:34:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:34:09.866521 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d2653-c5a3-45c6-887b-1bd36a760442 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:09.867069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d2653-c5a3-45c6-887b-1bd36a760442 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:09.867069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d2653-c5a3-45c6-887b-1bd36a760442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:09.902481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-597d2653-c5a3-45c6-887b-1bd36a760442 None None] MFA Rules not processed for user `362ab4aeb88746d8b8a14a238c877a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:09.903725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-597d2653-c5a3-45c6-887b-1bd36a760442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:09.986700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 891/1788] 10.222.0.35 () {58 vars in 1018 bytes} [Sat Feb 12 04:34:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:09.998917 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c81f60-3080-4d3e-8d76-045c1f6a78d2 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:10.000849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-03c81f60-3080-4d3e-8d76-045c1f6a78d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:10.020809 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c81f60-3080-4d3e-8d76-045c1f6a78d2 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:10.028832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829b197-f67d-4cc3-a582-8c84a5a11bc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:10.029074 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829b197-f67d-4cc3-a582-8c84a5a11bc2 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:10.029522 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829b197-f67d-4cc3-a582-8c84a5a11bc2 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:10.029793 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829b197-f67d-4cc3-a582-8c84a5a11bc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:10.040032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829b197-f67d-4cc3-a582-8c84a5a11bc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:10.041795 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829b197-f67d-4cc3-a582-8c84a5a11bc2 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:10.053146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 898/1789] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:10.459376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d2653-c5a3-45c6-887b-1bd36a760442 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:10.460824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-597d2653-c5a3-45c6-887b-1bd36a760442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:10.524845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d2653-c5a3-45c6-887b-1bd36a760442 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:10.529470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e6a4d-e599-4102-90e4-8c2b19c5c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:10.530270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e6a4d-e599-4102-90e4-8c2b19c5c98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:10.530548 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e6a4d-e599-4102-90e4-8c2b19c5c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:10.530831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e6a4d-e599-4102-90e4-8c2b19c5c98c admin admin] PATH_INFO: `/v3/users/148f677a16c34874a50a88af92eb2c6b` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:10.532052 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e6a4d-e599-4102-90e4-8c2b19c5c98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=148f677a16c34874a50a88af92eb2c6b)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:10.534021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e6a4d-e599-4102-90e4-8c2b19c5c98c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:10.728336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-d27e6a4d-e599-4102-90e4-8c2b19c5c98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148f677a16c34874a50a88af92eb2c6b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:10.730120 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-d27e6a4d-e599-4102-90e4-8c2b19c5c98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148f677a16c34874a50a88af92eb2c6b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:10.730819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-d27e6a4d-e599-4102-90e4-8c2b19c5c98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148f677a16c34874a50a88af92eb2c6b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:10.746505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-d27e6a4d-e599-4102-90e4-8c2b19c5c98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148f677a16c34874a50a88af92eb2c6b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:10.752579 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-d27e6a4d-e599-4102-90e4-8c2b19c5c98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148f677a16c34874a50a88af92eb2c6b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:10.832758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 892/1790] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:10 2022] DELETE /identity/v3/users/148f677a16c34874a50a88af92eb2c6b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:10.837196 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab078f-3877-4d86-b358-e74e6948d0e5 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:10.837490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab078f-3877-4d86-b358-e74e6948d0e5 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:10.837790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab078f-3877-4d86-b358-e74e6948d0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:10.856311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-51ab078f-3877-4d86-b358-e74e6948d0e5 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:10.857600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-51ab078f-3877-4d86-b358-e74e6948d0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:10.917570 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 899/1791] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:10.927401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e6a4d-e599-4102-90e4-8c2b19c5c98c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:10.928816 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d27e6a4d-e599-4102-90e4-8c2b19c5c98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:10.990912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e6a4d-e599-4102-90e4-8c2b19c5c98c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:10.999573 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20b8ee-c061-461b-b87c-a3e3636ecce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:10.999573 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20b8ee-c061-461b-b87c-a3e3636ecce6 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:10.999573 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20b8ee-c061-461b-b87c-a3e3636ecce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:10.999573 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20b8ee-c061-461b-b87c-a3e3636ecce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:11.007576 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20b8ee-c061-461b-b87c-a3e3636ecce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:11.008916 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20b8ee-c061-461b-b87c-a3e3636ecce6 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:11.020450 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 893/1792] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:11.641064 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab078f-3877-4d86-b358-e74e6948d0e5 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:11.642520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-51ab078f-3877-4d86-b358-e74e6948d0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:11.644011 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20b8ee-c061-461b-b87c-a3e3636ecce6 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:11.645658 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3b20b8ee-c061-461b-b87c-a3e3636ecce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:11.656624 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab078f-3877-4d86-b358-e74e6948d0e5 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:11.661330 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20b8ee-c061-461b-b87c-a3e3636ecce6 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:11.662710 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:11.665708 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:11.665708 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:11.665708 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] PATH_INFO: `/v3/projects/3adcf8a1423446daaf9173f344e9e250` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:11.666124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a9b062-23b5-42a3-8e6d-9032b10499d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:11.666257 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3adcf8a1423446daaf9173f344e9e250)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:11.666988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9b062-23b5-42a3-8e6d-9032b10499d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:11.667561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9b062-23b5-42a3-8e6d-9032b10499d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:11.667836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a9b062-23b5-42a3-8e6d-9032b10499d6 admin admin] PATH_INFO: `/v3/users/cc48c82b6d1740a9b81c4da2de0f1501` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:11.668117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:11.669297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9b062-23b5-42a3-8e6d-9032b10499d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc48c82b6d1740a9b81c4da2de0f1501)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:11.671406 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a9b062-23b5-42a3-8e6d-9032b10499d6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:11.788612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3adcf8a1423446daaf9173f344e9e250', 'request_id': 'req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:11.794822 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3adcf8a1423446daaf9173f344e9e250', 'request_id': 'req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:11.800242 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3adcf8a1423446daaf9173f344e9e250', 'request_id': 'req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:11.873475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] The token cache is being invalidate because project 3adcf8a1423446daaf9173f344e9e250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:11.874029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:11.874422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:11.876554 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 900/1793] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:11 2022] DELETE /identity/v3/projects/3adcf8a1423446daaf9173f344e9e250 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:11.881342 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:11.882896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:11.911324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-77a9b062-23b5-42a3-8e6d-9032b10499d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc48c82b6d1740a9b81c4da2de0f1501'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:11.911981 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-77a9b062-23b5-42a3-8e6d-9032b10499d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc48c82b6d1740a9b81c4da2de0f1501'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:11.912618 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-77a9b062-23b5-42a3-8e6d-9032b10499d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc48c82b6d1740a9b81c4da2de0f1501'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:11.925937 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-77a9b062-23b5-42a3-8e6d-9032b10499d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc48c82b6d1740a9b81c4da2de0f1501'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:11.933295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-77a9b062-23b5-42a3-8e6d-9032b10499d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc48c82b6d1740a9b81c4da2de0f1501'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:11.952903 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93700dfc-6e0f-4f7f-8fd3-4a72d822471e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:11.962038 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9759281-0161-4aa0-a17b-dee7d92a5c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:11.962934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9759281-0161-4aa0-a17b-dee7d92a5c0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:11.963507 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9759281-0161-4aa0-a17b-dee7d92a5c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:11.963929 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9759281-0161-4aa0-a17b-dee7d92a5c0b admin admin] PATH_INFO: `/v3/users/081e25aa05da4109bec64ca81b3244be` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:11.965834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9759281-0161-4aa0-a17b-dee7d92a5c0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=081e25aa05da4109bec64ca81b3244be)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:11.968130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9759281-0161-4aa0-a17b-dee7d92a5c0b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:12.016495 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 894/1794] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:11 2022] DELETE /identity/v3/users/cc48c82b6d1740a9b81c4da2de0f1501 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:12.022660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7423d1-57fa-47fe-896c-cfa77d0f73b2 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:12.023069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7423d1-57fa-47fe-896c-cfa77d0f73b2 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:12.023361 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7423d1-57fa-47fe-896c-cfa77d0f73b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:12.052203 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-5d7423d1-57fa-47fe-896c-cfa77d0f73b2 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:12.053788 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5d7423d1-57fa-47fe-896c-cfa77d0f73b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:12.168020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 895/1795] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:12.184736 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7423d1-57fa-47fe-896c-cfa77d0f73b2 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:12.186378 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5d7423d1-57fa-47fe-896c-cfa77d0f73b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:12.261821 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b9759281-0161-4aa0-a17b-dee7d92a5c0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '081e25aa05da4109bec64ca81b3244be'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:12.262630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b9759281-0161-4aa0-a17b-dee7d92a5c0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '081e25aa05da4109bec64ca81b3244be'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:12.263353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b9759281-0161-4aa0-a17b-dee7d92a5c0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '081e25aa05da4109bec64ca81b3244be'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:12.291522 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b9759281-0161-4aa0-a17b-dee7d92a5c0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '081e25aa05da4109bec64ca81b3244be'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:12.291720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7423d1-57fa-47fe-896c-cfa77d0f73b2 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:12.294526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa11a4-3c37-4718-8a73-926373ef4580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:12.295319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa11a4-3c37-4718-8a73-926373ef4580 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:12.295661 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa11a4-3c37-4718-8a73-926373ef4580 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:12.295946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa11a4-3c37-4718-8a73-926373ef4580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:12.298020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-40aa11a4-3c37-4718-8a73-926373ef4580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:12.298656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b9759281-0161-4aa0-a17b-dee7d92a5c0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '081e25aa05da4109bec64ca81b3244be'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:12.314042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa11a4-3c37-4718-8a73-926373ef4580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:12.316739 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa11a4-3c37-4718-8a73-926373ef4580 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:12.329187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 896/1796] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:34:12.391495 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 901/1797] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:11 2022] DELETE /identity/v3/users/081e25aa05da4109bec64ca81b3244be => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:13.233481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa11a4-3c37-4718-8a73-926373ef4580 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:13.235123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-40aa11a4-3c37-4718-8a73-926373ef4580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:13.251372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa11a4-3c37-4718-8a73-926373ef4580 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:13.331504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc051c4-d1f8-4609-93a1-18dd488071e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:13.335724 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc051c4-d1f8-4609-93a1-18dd488071e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:13.336050 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc051c4-d1f8-4609-93a1-18dd488071e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:13.336437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc051c4-d1f8-4609-93a1-18dd488071e5 admin admin] PATH_INFO: `/v3/projects/21d6de18f9204106b60683d1a7ac44f3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:13.342847 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc051c4-d1f8-4609-93a1-18dd488071e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d6de18f9204106b60683d1a7ac44f3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:13.345460 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc051c4-d1f8-4609-93a1-18dd488071e5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:13.514686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-adc051c4-d1f8-4609-93a1-18dd488071e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d6de18f9204106b60683d1a7ac44f3', 'request_id': 'req-adc051c4-d1f8-4609-93a1-18dd488071e5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:13.622039 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-adc051c4-d1f8-4609-93a1-18dd488071e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d6de18f9204106b60683d1a7ac44f3', 'request_id': 'req-adc051c4-d1f8-4609-93a1-18dd488071e5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:13.629317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-adc051c4-d1f8-4609-93a1-18dd488071e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d6de18f9204106b60683d1a7ac44f3', 'request_id': 'req-adc051c4-d1f8-4609-93a1-18dd488071e5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:13.639996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9759281-0161-4aa0-a17b-dee7d92a5c0b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:13.642180 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b9759281-0161-4aa0-a17b-dee7d92a5c0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:13.644387 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-adc051c4-d1f8-4609-93a1-18dd488071e5 admin admin] The token cache is being invalidate because project 21d6de18f9204106b60683d1a7ac44f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:13.644913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-adc051c4-d1f8-4609-93a1-18dd488071e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:13.645760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-adc051c4-d1f8-4609-93a1-18dd488071e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:13.647749 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 897/1798] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:13 2022] DELETE /identity/v3/projects/21d6de18f9204106b60683d1a7ac44f3 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:13.656468 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be994b05-c507-440b-b8e4-1d2d8ef28d9b None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:13.656988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be994b05-c507-440b-b8e4-1d2d8ef28d9b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:13.657149 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be994b05-c507-440b-b8e4-1d2d8ef28d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:13.659910 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9759281-0161-4aa0-a17b-dee7d92a5c0b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:13.693967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-be994b05-c507-440b-b8e4-1d2d8ef28d9b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:13.695174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-be994b05-c507-440b-b8e4-1d2d8ef28d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:13.745928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:13.746820 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:13.747106 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:13.747425 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] PATH_INFO: `/v3/projects/a079280fd13b485c918ba517814b6331` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:13.748642 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a079280fd13b485c918ba517814b6331)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:13.751681 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:13.765732 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 898/1799] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:13.775108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9427c5f-f30f-411c-9fda-2bec6376431f None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:13.775108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9427c5f-f30f-411c-9fda-2bec6376431f None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:13.775108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9427c5f-f30f-411c-9fda-2bec6376431f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:13.795639 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-e9427c5f-f30f-411c-9fda-2bec6376431f None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:13.797214 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e9427c5f-f30f-411c-9fda-2bec6376431f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:13.804976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 899/1800] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:13.809315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9427c5f-f30f-411c-9fda-2bec6376431f None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:13.820290 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9427c5f-f30f-411c-9fda-2bec6376431f None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:13.824950 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faa342-f378-41d4-8773-b050e4c976d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:13.825638 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faa342-f378-41d4-8773-b050e4c976d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:13.825956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faa342-f378-41d4-8773-b050e4c976d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:13.832735 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faa342-f378-41d4-8773-b050e4c976d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:13.832735 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faa342-f378-41d4-8773-b050e4c976d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:13.832735 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faa342-f378-41d4-8773-b050e4c976d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:13.832735 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faa342-f378-41d4-8773-b050e4c976d9 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:13.842593 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 900/1801] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:34:13.847053 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faa342-f378-41d4-8773-b050e4c976d9 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:13.857199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faa342-f378-41d4-8773-b050e4c976d9 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:13.870636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a079280fd13b485c918ba517814b6331', 'request_id': 'req-189e1f36-8f3c-412f-bdcf-22adf205b311'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:13.877094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a079280fd13b485c918ba517814b6331', 'request_id': 'req-189e1f36-8f3c-412f-bdcf-22adf205b311'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:13.883899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a079280fd13b485c918ba517814b6331', 'request_id': 'req-189e1f36-8f3c-412f-bdcf-22adf205b311'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:13.922975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0ca8d-3d9d-448a-b672-10831bf96d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:13.923467 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0ca8d-3d9d-448a-b672-10831bf96d34 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:13.923757 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0ca8d-3d9d-448a-b672-10831bf96d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:13.924056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0ca8d-3d9d-448a-b672-10831bf96d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:13.924787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0ca8d-3d9d-448a-b672-10831bf96d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:13.926701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0ca8d-3d9d-448a-b672-10831bf96d34 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:13.983752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] The token cache is being invalidate because project a079280fd13b485c918ba517814b6331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:13.984473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:13.985325 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:13.987837 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 902/1802] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:13 2022] DELETE /identity/v3/projects/a079280fd13b485c918ba517814b6331 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:13.992337 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:13.994188 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:14.007647 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e1f36-8f3c-412f-bdcf-22adf205b311 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:14.013252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690177b8-dde2-47f0-9fe8-c37300679aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:14.014744 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690177b8-dde2-47f0-9fe8-c37300679aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:14.015175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690177b8-dde2-47f0-9fe8-c37300679aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:14.015622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690177b8-dde2-47f0-9fe8-c37300679aa4 admin admin] PATH_INFO: `/v3/users/07622ac6feb249e7adf8cb3b9bda2b66` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:14.020165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690177b8-dde2-47f0-9fe8-c37300679aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07622ac6feb249e7adf8cb3b9bda2b66)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:14.022688 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690177b8-dde2-47f0-9fe8-c37300679aa4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:14.042127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 901/1803] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:13 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:14.043541 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0ca8d-3d9d-448a-b672-10831bf96d34 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:14.045337 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2ce0ca8d-3d9d-448a-b672-10831bf96d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:14.126406 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0ca8d-3d9d-448a-b672-10831bf96d34 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:14.132141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fabca-5c4c-4f15-a5f5-d019ad4f101e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:14.132828 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fabca-5c4c-4f15-a5f5-d019ad4f101e admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:14.133134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fabca-5c4c-4f15-a5f5-d019ad4f101e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:14.133486 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fabca-5c4c-4f15-a5f5-d019ad4f101e admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:14.134213 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fabca-5c4c-4f15-a5f5-d019ad4f101e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:14.136204 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fabca-5c4c-4f15-a5f5-d019ad4f101e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:14.268052 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-690177b8-dde2-47f0-9fe8-c37300679aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07622ac6feb249e7adf8cb3b9bda2b66'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:14.268930 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-690177b8-dde2-47f0-9fe8-c37300679aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07622ac6feb249e7adf8cb3b9bda2b66'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:14.269698 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-690177b8-dde2-47f0-9fe8-c37300679aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07622ac6feb249e7adf8cb3b9bda2b66'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:14.283455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-690177b8-dde2-47f0-9fe8-c37300679aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07622ac6feb249e7adf8cb3b9bda2b66'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:14.290808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 902/1804] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:14 2022] POST /identity/v3/users => generated 291 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:14.294463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-690177b8-dde2-47f0-9fe8-c37300679aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07622ac6feb249e7adf8cb3b9bda2b66'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:14.294585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fabca-5c4c-4f15-a5f5-d019ad4f101e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:14.296666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-688fabca-5c4c-4f15-a5f5-d019ad4f101e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:14.309173 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fabca-5c4c-4f15-a5f5-d019ad4f101e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:14.313879 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf26220-51f8-4b5e-8664-05c290d0f221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:14.314532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf26220-51f8-4b5e-8664-05c290d0f221 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:14.314815 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf26220-51f8-4b5e-8664-05c290d0f221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:14.315090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf26220-51f8-4b5e-8664-05c290d0f221 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:14.316489 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf26220-51f8-4b5e-8664-05c290d0f221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:14.318144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf26220-51f8-4b5e-8664-05c290d0f221 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:14.328016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 903/1805] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:14.332137 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf26220-51f8-4b5e-8664-05c290d0f221 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:14.342050 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf26220-51f8-4b5e-8664-05c290d0f221 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:14.347778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7b867-999b-4665-9f03-1cd1f68a72bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:14.348493 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7b867-999b-4665-9f03-1cd1f68a72bb admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:14.355402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7b867-999b-4665-9f03-1cd1f68a72bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:14.355402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7b867-999b-4665-9f03-1cd1f68a72bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:14.355402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7b867-999b-4665-9f03-1cd1f68a72bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:14.355402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a7b867-999b-4665-9f03-1cd1f68a72bb admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:14.365761 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 904/1806] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:14.366961 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7b867-999b-4665-9f03-1cd1f68a72bb admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:14.378452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a7b867-999b-4665-9f03-1cd1f68a72bb admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:14.384066 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba12945-1f7e-44ef-90c8-505d7b24a45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:14.385055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba12945-1f7e-44ef-90c8-505d7b24a45e admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:14.385428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba12945-1f7e-44ef-90c8-505d7b24a45e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:14.385800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba12945-1f7e-44ef-90c8-505d7b24a45e admin admin] PATH_INFO: `/v3/projects/d2811b59fd2b442ca48921d40395cfc0/users/941b9015e55848f082114aa959ce20b5/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:14.393517 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 903/1807] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:13 2022] DELETE /identity/v3/users/07622ac6feb249e7adf8cb3b9bda2b66 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:14.393517 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d19830-0e4d-40e8-9853-6d1e758152fe None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:14.393517 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d19830-0e4d-40e8-9853-6d1e758152fe None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:14.393517 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d19830-0e4d-40e8-9853-6d1e758152fe None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:14.395014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 904/1808] 10.222.0.35 () {54 vars in 921 bytes} [Sat Feb 12 04:34:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:34:14.411197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a64eb-29d4-46f0-8e6d-e340ef7ed882 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:14.411391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba12945-1f7e-44ef-90c8-505d7b24a45e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2811b59fd2b442ca48921d40395cfc0, user_id=941b9015e55848f082114aa959ce20b5, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:14.411805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a64eb-29d4-46f0-8e6d-e340ef7ed882 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:14.412250 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a64eb-29d4-46f0-8e6d-e340ef7ed882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:14.415684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba12945-1f7e-44ef-90c8-505d7b24a45e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:14.437794 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-bb3a64eb-29d4-46f0-8e6d-e340ef7ed882 None None] MFA Rules not processed for user `362ab4aeb88746d8b8a14a238c877a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:14.439070 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-bb3a64eb-29d4-46f0-8e6d-e340ef7ed882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:14.513311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 905/1809] 10.222.0.35 () {58 vars in 1018 bytes} [Sat Feb 12 04:34:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:14.520735 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 905/1810] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:14 2022] PUT /identity/v3/projects/d2811b59fd2b442ca48921d40395cfc0/users/941b9015e55848f082114aa959ce20b5/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:14.537298 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a5eeb-518a-4b62-a2f4-b93dfe941cfd None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:14.538427 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba12945-1f7e-44ef-90c8-505d7b24a45e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:14.539049 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a5eeb-518a-4b62-a2f4-b93dfe941cfd None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:14.539357 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a5eeb-518a-4b62-a2f4-b93dfe941cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:14.540478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-0ba12945-1f7e-44ef-90c8-505d7b24a45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:14.569971 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-bb1a5eeb-518a-4b62-a2f4-b93dfe941cfd None None] MFA Rules not processed for user `941b9015e55848f082114aa959ce20b5`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:14.571294 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-bb1a5eeb-518a-4b62-a2f4-b93dfe941cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:14.653346 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba12945-1f7e-44ef-90c8-505d7b24a45e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:14.668671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 906/1811] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:14.670451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a5eeb-518a-4b62-a2f4-b93dfe941cfd None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:14.673090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95d702-2965-4e59-b0e8-741b5f2982ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:14.673757 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95d702-2965-4e59-b0e8-741b5f2982ae service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:14.674038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95d702-2965-4e59-b0e8-741b5f2982ae service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:14.674313 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95d702-2965-4e59-b0e8-741b5f2982ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:14.696081 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95d702-2965-4e59-b0e8-741b5f2982ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:14.698467 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95d702-2965-4e59-b0e8-741b5f2982ae service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:14.716982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 906/1812] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:14.813923 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a5eeb-518a-4b62-a2f4-b93dfe941cfd None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:14.819461 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e7e11-aaab-4814-aff5-d31a6467bbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:14.820419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e7e11-aaab-4814-aff5-d31a6467bbe3 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:14.820419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e7e11-aaab-4814-aff5-d31a6467bbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:14.820956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759e7e11-aaab-4814-aff5-d31a6467bbe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:14.827301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e7e11-aaab-4814-aff5-d31a6467bbe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:14.827301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759e7e11-aaab-4814-aff5-d31a6467bbe3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:14.956295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 907/1813] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:14 2022] POST /identity/v3/projects => generated 379 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:14.961053 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95d702-2965-4e59-b0e8-741b5f2982ae service nova] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:14.976938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95d702-2965-4e59-b0e8-741b5f2982ae service nova] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:15.083656 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd87e1-9e10-4ab8-b96c-45c4b4f6591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:15.084346 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd87e1-9e10-4ab8-b96c-45c4b4f6591f admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:15.084640 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd87e1-9e10-4ab8-b96c-45c4b4f6591f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:15.084918 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd87e1-9e10-4ab8-b96c-45c4b4f6591f admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:15.085645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd87e1-9e10-4ab8-b96c-45c4b4f6591f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:15.087708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd87e1-9e10-4ab8-b96c-45c4b4f6591f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:15.170248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e7e11-aaab-4814-aff5-d31a6467bbe3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:15.172934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-759e7e11-aaab-4814-aff5-d31a6467bbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:15.193001 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759e7e11-aaab-4814-aff5-d31a6467bbe3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:15.197463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:15.205521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:15.214666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 907/1814] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:14 2022] POST /identity/v3/users => generated 296 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:15.214880 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:15.214880 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b admin admin] PATH_INFO: `/v3/projects/fe818514e7c54f888ed52211dadc284f` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:15.215882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd87e1-9e10-4ab8-b96c-45c4b4f6591f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:15.216721 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe818514e7c54f888ed52211dadc284f)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:15.218999 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:15.231252 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd87e1-9e10-4ab8-b96c-45c4b4f6591f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:15.236463 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1cfb7-6e69-4e4c-afff-d54b1e7215a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:15.238303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1cfb7-6e69-4e4c-afff-d54b1e7215a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:15.239336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1cfb7-6e69-4e4c-afff-d54b1e7215a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:15.239629 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1cfb7-6e69-4e4c-afff-d54b1e7215a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:15.240409 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1cfb7-6e69-4e4c-afff-d54b1e7215a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:15.242211 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1cfb7-6e69-4e4c-afff-d54b1e7215a7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:15.261686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 908/1815] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:15.264278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1cfb7-6e69-4e4c-afff-d54b1e7215a7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:15.291280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1cfb7-6e69-4e4c-afff-d54b1e7215a7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:15.301929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a17f1d-4556-4a43-8f28-221d0a094af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:15.304891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a17f1d-4556-4a43-8f28-221d0a094af2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:15.305697 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a17f1d-4556-4a43-8f28-221d0a094af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:15.311832 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a17f1d-4556-4a43-8f28-221d0a094af2 admin admin] PATH_INFO: `/v3/projects/bb5a04dee1414f0188cc5024d0617490/users/ba659229f16c41c295c5bd4ddbe44c6c/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:15.352227 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a17f1d-4556-4a43-8f28-221d0a094af2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5a04dee1414f0188cc5024d0617490, user_id=ba659229f16c41c295c5bd4ddbe44c6c, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:15.360156 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a17f1d-4556-4a43-8f28-221d0a094af2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:15.462733 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 909/1816] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:15 2022] PUT /identity/v3/projects/bb5a04dee1414f0188cc5024d0617490/users/ba659229f16c41c295c5bd4ddbe44c6c/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:15.467327 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a17f1d-4556-4a43-8f28-221d0a094af2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:15.478908 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe818514e7c54f888ed52211dadc284f', 'request_id': 'req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:15.490560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe818514e7c54f888ed52211dadc284f', 'request_id': 'req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:15.498028 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe818514e7c54f888ed52211dadc284f', 'request_id': 'req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:15.550549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a17f1d-4556-4a43-8f28-221d0a094af2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:15.586448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b admin admin] The token cache is being invalidate because project fe818514e7c54f888ed52211dadc284f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:15.586791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:15.587564 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4a5fa37a-f3f4-4a41-835d-7f15414d7e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:15.589921 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 908/1817] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:15 2022] DELETE /identity/v3/projects/fe818514e7c54f888ed52211dadc284f => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:15.595647 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af38c9-5a64-44b7-b914-082c585a7a0a None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:15.596061 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af38c9-5a64-44b7-b914-082c585a7a0a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:15.597068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69af38c9-5a64-44b7-b914-082c585a7a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:15.615525 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-69af38c9-5a64-44b7-b914-082c585a7a0a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:15.615754 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ce581-793b-4f04-a87f-8277df60ad17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:15.616224 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce581-793b-4f04-a87f-8277df60ad17 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:15.616506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce581-793b-4f04-a87f-8277df60ad17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:15.616776 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce581-793b-4f04-a87f-8277df60ad17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:15.616960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-69af38c9-5a64-44b7-b914-082c585a7a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:15.617862 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ce581-793b-4f04-a87f-8277df60ad17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:15.619218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ce581-793b-4f04-a87f-8277df60ad17 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:15.628841 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 909/1818] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:15.640171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072c768-58e0-4c01-bf20-844db582ea2a None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:15.640171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072c768-58e0-4c01-bf20-844db582ea2a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:15.640171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072c768-58e0-4c01-bf20-844db582ea2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:15.650266 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 910/1819] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:15.654367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ce581-793b-4f04-a87f-8277df60ad17 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:15.656324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9e1ce581-793b-4f04-a87f-8277df60ad17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:15.661878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-8072c768-58e0-4c01-bf20-844db582ea2a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:15.663335 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8072c768-58e0-4c01-bf20-844db582ea2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:15.671514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ce581-793b-4f04-a87f-8277df60ad17 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:15.672533 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 910/1820] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:15.676527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072c768-58e0-4c01-bf20-844db582ea2a None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:15.678801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d6197c-fae0-4fc3-8cde-1275e08fe3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:15.679801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6197c-fae0-4fc3-8cde-1275e08fe3c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:15.680085 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6197c-fae0-4fc3-8cde-1275e08fe3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:15.680360 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d6197c-fae0-4fc3-8cde-1275e08fe3c5 admin admin] PATH_INFO: `/v3/projects/bb5a04dee1414f0188cc5024d0617490/users/ba659229f16c41c295c5bd4ddbe44c6c/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:15.682342 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6197c-fae0-4fc3-8cde-1275e08fe3c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5a04dee1414f0188cc5024d0617490, user_id=ba659229f16c41c295c5bd4ddbe44c6c, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:15.685100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d6197c-fae0-4fc3-8cde-1275e08fe3c5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:15.692357 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072c768-58e0-4c01-bf20-844db582ea2a None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:15.692357 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4210e-b5da-4e49-8a2c-57c0be6a0415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:15.692357 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4210e-b5da-4e49-8a2c-57c0be6a0415 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:15.692357 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4210e-b5da-4e49-8a2c-57c0be6a0415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:15.692656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4210e-b5da-4e49-8a2c-57c0be6a0415 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:15.693177 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4210e-b5da-4e49-8a2c-57c0be6a0415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:15.693487 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4210e-b5da-4e49-8a2c-57c0be6a0415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:15.695074 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4210e-b5da-4e49-8a2c-57c0be6a0415 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:15.696238 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 911/1821] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:15 2022] PUT /identity/v3/projects/bb5a04dee1414f0188cc5024d0617490/users/ba659229f16c41c295c5bd4ddbe44c6c/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:15.706491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60065586-b351-4d83-b390-b058afcba3b8 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:15.706793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60065586-b351-4d83-b390-b058afcba3b8 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:15.707136 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60065586-b351-4d83-b390-b058afcba3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:15.711431 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 911/1822] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:34:15.712421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4210e-b5da-4e49-8a2c-57c0be6a0415 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:15.722626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4210e-b5da-4e49-8a2c-57c0be6a0415 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:15.734220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-60065586-b351-4d83-b390-b058afcba3b8 None None] MFA Rules not processed for user `ba659229f16c41c295c5bd4ddbe44c6c`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:15.735451 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-60065586-b351-4d83-b390-b058afcba3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:15.779445 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafca94b-4883-4ac7-b5c4-3c9011418cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:15.780098 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafca94b-4883-4ac7-b5c4-3c9011418cca admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:15.780382 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafca94b-4883-4ac7-b5c4-3c9011418cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:15.780658 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafca94b-4883-4ac7-b5c4-3c9011418cca admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:15.781405 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafca94b-4883-4ac7-b5c4-3c9011418cca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:15.783359 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafca94b-4883-4ac7-b5c4-3c9011418cca admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:15.802991 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 912/1823] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:15 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:15.813505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60065586-b351-4d83-b390-b058afcba3b8 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:15.814848 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-60065586-b351-4d83-b390-b058afcba3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:15.869719 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60065586-b351-4d83-b390-b058afcba3b8 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:15.873328 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe020f-8d57-487e-bd08-ae6da25af091 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:15.873961 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe020f-8d57-487e-bd08-ae6da25af091 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:15.874240 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe020f-8d57-487e-bd08-ae6da25af091 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:15.874514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe020f-8d57-487e-bd08-ae6da25af091 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:15.883366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe020f-8d57-487e-bd08-ae6da25af091 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:15.884783 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe020f-8d57-487e-bd08-ae6da25af091 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:15.893861 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 913/1824] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:34:15.912155 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 912/1825] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:15 2022] POST /identity/v3/projects => generated 407 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:15.913257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe020f-8d57-487e-bd08-ae6da25af091 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:15.930987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe020f-8d57-487e-bd08-ae6da25af091 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:15.981545 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb0cc2-eff3-4974-9d06-eae4d93f5af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:15.982226 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb0cc2-eff3-4974-9d06-eae4d93f5af1 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:15.982542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb0cc2-eff3-4974-9d06-eae4d93f5af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:15.982823 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcb0cc2-eff3-4974-9d06-eae4d93f5af1 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:15.983645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb0cc2-eff3-4974-9d06-eae4d93f5af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:15.985652 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcb0cc2-eff3-4974-9d06-eae4d93f5af1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:16.100587 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 914/1826] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:15 2022] POST /identity/v3/users => generated 304 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:16.103573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafca94b-4883-4ac7-b5c4-3c9011418cca admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:16.128209 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafca94b-4883-4ac7-b5c4-3c9011418cca admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:16.144525 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2a3a5-4cd6-4f1c-aad7-105c3459f0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:16.145539 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2a3a5-4cd6-4f1c-aad7-105c3459f0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:16.145678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2a3a5-4cd6-4f1c-aad7-105c3459f0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:16.145872 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2a3a5-4cd6-4f1c-aad7-105c3459f0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:16.146628 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2a3a5-4cd6-4f1c-aad7-105c3459f0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:16.150657 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2a3a5-4cd6-4f1c-aad7-105c3459f0e6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:16.170549 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 913/1827] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:16.174208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb0cc2-eff3-4974-9d06-eae4d93f5af1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:16.200538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcb0cc2-eff3-4974-9d06-eae4d93f5af1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:16.216487 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9258ce01-efe8-45a7-9b57-79d3480b2199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:16.217175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258ce01-efe8-45a7-9b57-79d3480b2199 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:16.217520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258ce01-efe8-45a7-9b57-79d3480b2199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:16.217787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258ce01-efe8-45a7-9b57-79d3480b2199 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:16.218603 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258ce01-efe8-45a7-9b57-79d3480b2199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:16.220349 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9258ce01-efe8-45a7-9b57-79d3480b2199 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:16.232989 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 915/1828] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:16.241079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2a3a5-4cd6-4f1c-aad7-105c3459f0e6 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:16.257961 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2a3a5-4cd6-4f1c-aad7-105c3459f0e6 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:16.264536 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bcf50-c42c-4de4-82e5-179b274d24c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:16.266007 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bcf50-c42c-4de4-82e5-179b274d24c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:16.266634 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bcf50-c42c-4de4-82e5-179b274d24c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:16.267339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89bcf50-c42c-4de4-82e5-179b274d24c7 admin admin] PATH_INFO: `/v3/projects/dc268319174b4f6f9a422511c658f9ab/users/563459240c72453f9ebb278eed036654/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:16.286539 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bcf50-c42c-4de4-82e5-179b274d24c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc268319174b4f6f9a422511c658f9ab, user_id=563459240c72453f9ebb278eed036654, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:16.289802 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89bcf50-c42c-4de4-82e5-179b274d24c7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:16.375956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 914/1829] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:16 2022] PUT /identity/v3/projects/dc268319174b4f6f9a422511c658f9ab/users/563459240c72453f9ebb278eed036654/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:16.386250 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159a6d2-b5de-45b8-aaeb-10ead8680269 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:16.386713 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159a6d2-b5de-45b8-aaeb-10ead8680269 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:16.386829 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7159a6d2-b5de-45b8-aaeb-10ead8680269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:16.415130 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-7159a6d2-b5de-45b8-aaeb-10ead8680269 None None] MFA Rules not processed for user `563459240c72453f9ebb278eed036654`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:16.416408 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-7159a6d2-b5de-45b8-aaeb-10ead8680269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:16.490415 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 916/1830] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:16.491690 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bcf50-c42c-4de4-82e5-179b274d24c7 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:16.560152 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89bcf50-c42c-4de4-82e5-179b274d24c7 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:16.566704 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b97264-4dcd-426d-8161-1514f768792c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:16.567556 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b97264-4dcd-426d-8161-1514f768792c admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:16.568025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b97264-4dcd-426d-8161-1514f768792c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:16.568309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b97264-4dcd-426d-8161-1514f768792c admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:16.569032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b97264-4dcd-426d-8161-1514f768792c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:16.581462 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b97264-4dcd-426d-8161-1514f768792c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:16.671369 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 915/1831] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:16 2022] POST /identity/v3/projects => generated 407 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:16.672286 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159a6d2-b5de-45b8-aaeb-10ead8680269 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:16.689273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7159a6d2-b5de-45b8-aaeb-10ead8680269 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:16.747516 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba5d15-8598-4a3b-8efe-955e38f5228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:16.748189 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5d15-8598-4a3b-8efe-955e38f5228b admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:16.748591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5d15-8598-4a3b-8efe-955e38f5228b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:16.748904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5d15-8598-4a3b-8efe-955e38f5228b admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:16.749571 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba5d15-8598-4a3b-8efe-955e38f5228b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:16.751621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba5d15-8598-4a3b-8efe-955e38f5228b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:16.864326 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 917/1832] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:16 2022] POST /identity/v3/users => generated 310 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:16.868096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b97264-4dcd-426d-8161-1514f768792c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:16.879016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b97264-4dcd-426d-8161-1514f768792c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:16.884697 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736469c7-58a5-4c42-a9e9-a3a71bcb8918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:16.885370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736469c7-58a5-4c42-a9e9-a3a71bcb8918 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:16.885652 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736469c7-58a5-4c42-a9e9-a3a71bcb8918 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:16.886126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736469c7-58a5-4c42-a9e9-a3a71bcb8918 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:16.887158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736469c7-58a5-4c42-a9e9-a3a71bcb8918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:16.889542 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736469c7-58a5-4c42-a9e9-a3a71bcb8918 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:16.908752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 916/1833] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:16.913123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba5d15-8598-4a3b-8efe-955e38f5228b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:16.923396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba5d15-8598-4a3b-8efe-955e38f5228b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:16.928384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebb389-3d9e-4df6-b8d7-18047c57a56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:16.929268 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebb389-3d9e-4df6-b8d7-18047c57a56a admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:16.929549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebb389-3d9e-4df6-b8d7-18047c57a56a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:16.929826 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aebb389-3d9e-4df6-b8d7-18047c57a56a admin admin] PATH_INFO: `/v3/projects/cd55206913654ed9b83c0065edc0e2c1/users/e2ba549e522549879cdb661880957767/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:16.950333 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebb389-3d9e-4df6-b8d7-18047c57a56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd55206913654ed9b83c0065edc0e2c1, user_id=e2ba549e522549879cdb661880957767, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:16.954125 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aebb389-3d9e-4df6-b8d7-18047c57a56a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:17.051513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736469c7-58a5-4c42-a9e9-a3a71bcb8918 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:17.069474 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 918/1834] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:16 2022] PUT /identity/v3/projects/cd55206913654ed9b83c0065edc0e2c1/users/e2ba549e522549879cdb661880957767/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:17.070533 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebb389-3d9e-4df6-b8d7-18047c57a56a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:17.134401 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736469c7-58a5-4c42-a9e9-a3a71bcb8918 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:17.197533 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aebb389-3d9e-4df6-b8d7-18047c57a56a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:17.204074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153cf34-be39-409c-a25a-0c0cd4eedbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:17.205240 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153cf34-be39-409c-a25a-0c0cd4eedbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:17.205503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153cf34-be39-409c-a25a-0c0cd4eedbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:17.206610 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153cf34-be39-409c-a25a-0c0cd4eedbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:17.207034 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ca991-95c9-4fc6-9112-bdc6a5649884 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba659229f16c41c295c5bd4ddbe44c6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5a04dee1414f0188cc5024d0617490', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:17.208038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153cf34-be39-409c-a25a-0c0cd4eedbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:17.208785 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ca991-95c9-4fc6-9112-bdc6a5649884 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:17.209270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ca991-95c9-4fc6-9112-bdc6a5649884 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:17.209561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153cf34-be39-409c-a25a-0c0cd4eedbf1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:17.210010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ca991-95c9-4fc6-9112-bdc6a5649884 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:17.210960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ca991-95c9-4fc6-9112-bdc6a5649884 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:17.211493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ca991-95c9-4fc6-9112-bdc6a5649884 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:17.213646 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ca991-95c9-4fc6-9112-bdc6a5649884 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:17.228396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 919/1835] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:17.228591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 917/1836] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:34:17.233161 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153cf34-be39-409c-a25a-0c0cd4eedbf1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:17.233678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ca991-95c9-4fc6-9112-bdc6a5649884 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:17.262360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ca991-95c9-4fc6-9112-bdc6a5649884 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:17.263963 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153cf34-be39-409c-a25a-0c0cd4eedbf1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:17.285475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815a7f89-e9eb-4da1-9a6d-614e5400ca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:17.286855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb907433-440b-4d8f-b170-3dbfea30509b tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba659229f16c41c295c5bd4ddbe44c6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5a04dee1414f0188cc5024d0617490', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:17.289239 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb907433-440b-4d8f-b170-3dbfea30509b tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:17.289693 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a7f89-e9eb-4da1-9a6d-614e5400ca39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:17.293436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a7f89-e9eb-4da1-9a6d-614e5400ca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:17.293436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815a7f89-e9eb-4da1-9a6d-614e5400ca39 admin admin] PATH_INFO: `/v3/projects/cd55206913654ed9b83c0065edc0e2c1/users/e2ba549e522549879cdb661880957767/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:17.293606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb907433-440b-4d8f-b170-3dbfea30509b tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:17.293606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb907433-440b-4d8f-b170-3dbfea30509b tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:17.293606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb907433-440b-4d8f-b170-3dbfea30509b tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:17.295690 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a7f89-e9eb-4da1-9a6d-614e5400ca39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd55206913654ed9b83c0065edc0e2c1, user_id=e2ba549e522549879cdb661880957767, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:17.297093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb907433-440b-4d8f-b170-3dbfea30509b tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:17.301946 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815a7f89-e9eb-4da1-9a6d-614e5400ca39 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:17.329622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 918/1837] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:17 2022] PUT /identity/v3/projects/cd55206913654ed9b83c0065edc0e2c1/users/e2ba549e522549879cdb661880957767/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:17.342964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2000b4-a90a-4bfc-ae1c-5bff84e19318 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:17.343348 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2000b4-a90a-4bfc-ae1c-5bff84e19318 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:17.343631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2000b4-a90a-4bfc-ae1c-5bff84e19318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:17.413019 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-9f2000b4-a90a-4bfc-ae1c-5bff84e19318 None None] MFA Rules not processed for user `e2ba549e522549879cdb661880957767`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:17.415137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9f2000b4-a90a-4bfc-ae1c-5bff84e19318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:17.429758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 920/1838] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:17 2022] POST /identity/v3/projects => generated 352 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:17.431494 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb907433-440b-4d8f-b170-3dbfea30509b tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:17.506423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb907433-440b-4d8f-b170-3dbfea30509b tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:17.512463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 919/1839] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:17 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:17.512733 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4e23d-9b9b-49fe-84d6-c604b9724e44 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba659229f16c41c295c5bd4ddbe44c6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5a04dee1414f0188cc5024d0617490', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:17.512733 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e23d-9b9b-49fe-84d6-c604b9724e44 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:17.513071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e23d-9b9b-49fe-84d6-c604b9724e44 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:17.513398 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4e23d-9b9b-49fe-84d6-c604b9724e44 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:17.514253 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4e23d-9b9b-49fe-84d6-c604b9724e44 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:17.514612 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4e23d-9b9b-49fe-84d6-c604b9724e44 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:17.516522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e4e23d-9b9b-49fe-84d6-c604b9724e44 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:17.530338 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 921/1840] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:34:17.532660 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2000b4-a90a-4bfc-ae1c-5bff84e19318 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:17.595102 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2000b4-a90a-4bfc-ae1c-5bff84e19318 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:17.647191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091b9a8-885d-468c-89a0-d0676706727b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:17.647873 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091b9a8-885d-468c-89a0-d0676706727b service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:17.648281 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091b9a8-885d-468c-89a0-d0676706727b service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:17.648562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5091b9a8-885d-468c-89a0-d0676706727b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:17.713738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091b9a8-885d-468c-89a0-d0676706727b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:17.715162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5091b9a8-885d-468c-89a0-d0676706727b service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:17.725435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 920/1841] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:17 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:17.776128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4e23d-9b9b-49fe-84d6-c604b9724e44 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:17.788738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e4e23d-9b9b-49fe-84d6-c604b9724e44 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:17.794687 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba659229f16c41c295c5bd4ddbe44c6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bb5a04dee1414f0188cc5024d0617490', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:17.795752 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:17.796103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:17.796383 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] PATH_INFO: `/v3/projects/cbe89b31c3644aa19aa38ae61bd421ee` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:17.797708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cbe89b31c3644aa19aa38ae61bd421ee)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:17.799885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:17.920886 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091b9a8-885d-468c-89a0-d0676706727b service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:17.922328 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-5091b9a8-885d-468c-89a0-d0676706727b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:17.931362 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe89b31c3644aa19aa38ae61bd421ee', 'request_id': 'req-6f88424a-5f30-4ca1-8203-6af86808cc07'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:17.986344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5091b9a8-885d-468c-89a0-d0676706727b service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:18.038797 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe89b31c3644aa19aa38ae61bd421ee', 'request_id': 'req-6f88424a-5f30-4ca1-8203-6af86808cc07'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:18.041105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de42c5-0cec-493f-b3f5-0d5c76f7e756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:18.041969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de42c5-0cec-493f-b3f5-0d5c76f7e756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:18.042255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de42c5-0cec-493f-b3f5-0d5c76f7e756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:18.042522 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26de42c5-0cec-493f-b3f5-0d5c76f7e756 admin admin] PATH_INFO: `/v3/users/1c295fed94bf41858dd0c8f41304462a` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:18.043744 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de42c5-0cec-493f-b3f5-0d5c76f7e756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c295fed94bf41858dd0c8f41304462a)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:18.044934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe89b31c3644aa19aa38ae61bd421ee', 'request_id': 'req-6f88424a-5f30-4ca1-8203-6af86808cc07'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:18.045647 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26de42c5-0cec-493f-b3f5-0d5c76f7e756 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:18.060472 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] The token cache is being invalidate because project cbe89b31c3644aa19aa38ae61bd421ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:18.060763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:18.061422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:18.062969 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 922/1842] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:17 2022] DELETE /identity/v3/projects/cbe89b31c3644aa19aa38ae61bd421ee => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:18.122262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:18.123769 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:18.182420 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88424a-5f30-4ca1-8203-6af86808cc07 tempest-VolumeQuotaClassesTest-203428667 tempest-VolumeQuotaClassesTest-203428667-project-admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:18.186315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0260e-2980-486b-98ea-3ba7339f1c10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:18.186961 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0260e-2980-486b-98ea-3ba7339f1c10 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:18.187257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0260e-2980-486b-98ea-3ba7339f1c10 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:18.187542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0260e-2980-486b-98ea-3ba7339f1c10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:18.189333 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-89a0260e-2980-486b-98ea-3ba7339f1c10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:18.245714 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-26de42c5-0cec-493f-b3f5-0d5c76f7e756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c295fed94bf41858dd0c8f41304462a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:18.246486 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-26de42c5-0cec-493f-b3f5-0d5c76f7e756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c295fed94bf41858dd0c8f41304462a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:18.247088 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-26de42c5-0cec-493f-b3f5-0d5c76f7e756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c295fed94bf41858dd0c8f41304462a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:18.251909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0260e-2980-486b-98ea-3ba7339f1c10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:18.253865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0260e-2980-486b-98ea-3ba7339f1c10 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:18.258814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-26de42c5-0cec-493f-b3f5-0d5c76f7e756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c295fed94bf41858dd0c8f41304462a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:18.262831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 923/1843] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:18 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:34:18.265816 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-26de42c5-0cec-493f-b3f5-0d5c76f7e756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c295fed94bf41858dd0c8f41304462a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:18.357915 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 921/1844] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:17 2022] DELETE /identity/v3/users/1c295fed94bf41858dd0c8f41304462a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:18.363547 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6877e9f-b0ab-4a41-a6b5-4739ad99b6e7 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:18.363835 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6877e9f-b0ab-4a41-a6b5-4739ad99b6e7 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:18.364108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6877e9f-b0ab-4a41-a6b5-4739ad99b6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:18.380648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-e6877e9f-b0ab-4a41-a6b5-4739ad99b6e7 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:18.381833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e6877e9f-b0ab-4a41-a6b5-4739ad99b6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:18.439184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 924/1845] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:18.448885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de42c5-0cec-493f-b3f5-0d5c76f7e756 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:18.450280 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-26de42c5-0cec-493f-b3f5-0d5c76f7e756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:18.505713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26de42c5-0cec-493f-b3f5-0d5c76f7e756 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:18.509379 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175f82e-7746-4f41-9fc8-091ec816bd54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:18.510014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175f82e-7746-4f41-9fc8-091ec816bd54 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:18.510294 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175f82e-7746-4f41-9fc8-091ec816bd54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:18.510569 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175f82e-7746-4f41-9fc8-091ec816bd54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:18.520240 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175f82e-7746-4f41-9fc8-091ec816bd54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:18.523004 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5175f82e-7746-4f41-9fc8-091ec816bd54 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:18.531963 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 922/1846] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:18.713895 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6877e9f-b0ab-4a41-a6b5-4739ad99b6e7 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:18.715335 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e6877e9f-b0ab-4a41-a6b5-4739ad99b6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:18.727601 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6877e9f-b0ab-4a41-a6b5-4739ad99b6e7 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:18.732664 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ed06d-6c6a-4997-9118-26ead6af87a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:18.733576 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed06d-6c6a-4997-9118-26ead6af87a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:18.733870 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed06d-6c6a-4997-9118-26ead6af87a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:18.734140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed06d-6c6a-4997-9118-26ead6af87a2 admin admin] PATH_INFO: `/v3/users/941b9015e55848f082114aa959ce20b5` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:18.737282 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ed06d-6c6a-4997-9118-26ead6af87a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=941b9015e55848f082114aa959ce20b5)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:18.739290 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ed06d-6c6a-4997-9118-26ead6af87a2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:18.935459 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c94ed06d-6c6a-4997-9118-26ead6af87a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '941b9015e55848f082114aa959ce20b5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:18.936235 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c94ed06d-6c6a-4997-9118-26ead6af87a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '941b9015e55848f082114aa959ce20b5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:18.936924 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c94ed06d-6c6a-4997-9118-26ead6af87a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '941b9015e55848f082114aa959ce20b5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:18.956364 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c94ed06d-6c6a-4997-9118-26ead6af87a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '941b9015e55848f082114aa959ce20b5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:18.962490 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c94ed06d-6c6a-4997-9118-26ead6af87a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '941b9015e55848f082114aa959ce20b5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.042749 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 925/1847] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:18 2022] DELETE /identity/v3/users/941b9015e55848f082114aa959ce20b5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:19.050207 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f7484-63b4-436d-80e4-49d1d39eed82 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:19.050686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f7484-63b4-436d-80e4-49d1d39eed82 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:19.050856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9f7484-63b4-436d-80e4-49d1d39eed82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:19.069327 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-4c9f7484-63b4-436d-80e4-49d1d39eed82 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:19.070745 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4c9f7484-63b4-436d-80e4-49d1d39eed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:19.079366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ed06d-6c6a-4997-9118-26ead6af87a2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:19.081578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c94ed06d-6c6a-4997-9118-26ead6af87a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:19.161007 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ed06d-6c6a-4997-9118-26ead6af87a2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:19.165775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:19.166795 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 923/1848] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:19.170114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:19.170114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:19.170114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] PATH_INFO: `/v3/projects/9435281bcf7f4d2b9054c9dbff2039a3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:19.170114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9435281bcf7f4d2b9054c9dbff2039a3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:19.170651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:19.176746 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f7484-63b4-436d-80e4-49d1d39eed82 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:19.178138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4c9f7484-63b4-436d-80e4-49d1d39eed82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:19.233968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9f7484-63b4-436d-80e4-49d1d39eed82 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:19.239473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679db00-62f8-44ef-905c-c2d259b76ff7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:19.240184 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679db00-62f8-44ef-905c-c2d259b76ff7 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:19.241698 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679db00-62f8-44ef-905c-c2d259b76ff7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:19.241698 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7679db00-62f8-44ef-905c-c2d259b76ff7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:19.250561 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679db00-62f8-44ef-905c-c2d259b76ff7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:19.252000 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7679db00-62f8-44ef-905c-c2d259b76ff7 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:19.261932 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 924/1849] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:34:19.280124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9435281bcf7f4d2b9054c9dbff2039a3', 'request_id': 'req-266fd1b6-9b7b-44ea-be42-d7cda0553deb'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.375909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9435281bcf7f4d2b9054c9dbff2039a3', 'request_id': 'req-266fd1b6-9b7b-44ea-be42-d7cda0553deb'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.382531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9435281bcf7f4d2b9054c9dbff2039a3', 'request_id': 'req-266fd1b6-9b7b-44ea-be42-d7cda0553deb'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.393754 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] The token cache is being invalidate because project 9435281bcf7f4d2b9054c9dbff2039a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:19.394048 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.394695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.396286 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 926/1850] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:19 2022] DELETE /identity/v3/projects/9435281bcf7f4d2b9054c9dbff2039a3 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:19.400533 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679db00-62f8-44ef-905c-c2d259b76ff7 service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:19.410144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7679db00-62f8-44ef-905c-c2d259b76ff7 service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:19.465029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d120eee-cd57-4ffe-9641-ecb9347a27f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:19.465961 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d120eee-cd57-4ffe-9641-ecb9347a27f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:19.466208 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d120eee-cd57-4ffe-9641-ecb9347a27f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:19.466474 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d120eee-cd57-4ffe-9641-ecb9347a27f3 admin admin] PATH_INFO: `/v3/users/392d998116de480892dea5cae8fec72e` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:19.467715 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d120eee-cd57-4ffe-9641-ecb9347a27f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=392d998116de480892dea5cae8fec72e)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:19.469734 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d120eee-cd57-4ffe-9641-ecb9347a27f3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:19.641120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2d120eee-cd57-4ffe-9641-ecb9347a27f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '392d998116de480892dea5cae8fec72e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.641777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2d120eee-cd57-4ffe-9641-ecb9347a27f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '392d998116de480892dea5cae8fec72e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.642378 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2d120eee-cd57-4ffe-9641-ecb9347a27f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '392d998116de480892dea5cae8fec72e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.654545 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2d120eee-cd57-4ffe-9641-ecb9347a27f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '392d998116de480892dea5cae8fec72e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.661617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:19.662832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2d120eee-cd57-4ffe-9641-ecb9347a27f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '392d998116de480892dea5cae8fec72e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.663906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:19.683063 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fd1b6-9b7b-44ea-be42-d7cda0553deb admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:19.687886 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:19.688949 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:19.689372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:19.689703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] PATH_INFO: `/v3/projects/d2811b59fd2b442ca48921d40395cfc0` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:19.691118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2811b59fd2b442ca48921d40395cfc0)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:19.693096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:19.763247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 925/1851] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:19 2022] DELETE /identity/v3/users/392d998116de480892dea5cae8fec72e => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:19.798114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2811b59fd2b442ca48921d40395cfc0', 'request_id': 'req-31238628-1105-4645-84ee-42d8bf5b08fa'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.890764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2811b59fd2b442ca48921d40395cfc0', 'request_id': 'req-31238628-1105-4645-84ee-42d8bf5b08fa'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.898683 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2811b59fd2b442ca48921d40395cfc0', 'request_id': 'req-31238628-1105-4645-84ee-42d8bf5b08fa'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.911345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] The token cache is being invalidate because project d2811b59fd2b442ca48921d40395cfc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:19.911604 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.912248 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:19.916802 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 927/1852] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:19 2022] DELETE /identity/v3/projects/d2811b59fd2b442ca48921d40395cfc0 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:19.917924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d120eee-cd57-4ffe-9641-ecb9347a27f3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:19.919636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2d120eee-cd57-4ffe-9641-ecb9347a27f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:20.015906 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d120eee-cd57-4ffe-9641-ecb9347a27f3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:20.103862 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcd1c1-cda5-4e44-bcae-6eb8fbba22df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:20.104729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcd1c1-cda5-4e44-bcae-6eb8fbba22df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:20.105134 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcd1c1-cda5-4e44-bcae-6eb8fbba22df admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:20.105427 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcd1c1-cda5-4e44-bcae-6eb8fbba22df admin admin] PATH_INFO: `/v3/users/ba659229f16c41c295c5bd4ddbe44c6c` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:20.106694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcd1c1-cda5-4e44-bcae-6eb8fbba22df admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba659229f16c41c295c5bd4ddbe44c6c)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:20.108674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcd1c1-cda5-4e44-bcae-6eb8fbba22df admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:20.155326 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:20.157338 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:20.174288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31238628-1105-4645-84ee-42d8bf5b08fa admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:20.181910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac584559-d67f-4b2e-931d-b69defe65138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:20.188296 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac584559-d67f-4b2e-931d-b69defe65138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:20.188296 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac584559-d67f-4b2e-931d-b69defe65138 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:20.188296 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac584559-d67f-4b2e-931d-b69defe65138 admin admin] PATH_INFO: `/v3/projects/ecf87b205be642f7a121d5f7de51749e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:20.188296 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac584559-d67f-4b2e-931d-b69defe65138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf87b205be642f7a121d5f7de51749e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:20.188296 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac584559-d67f-4b2e-931d-b69defe65138 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:20.272676 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-62dcd1c1-cda5-4e44-bcae-6eb8fbba22df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba659229f16c41c295c5bd4ddbe44c6c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:20.273417 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-62dcd1c1-cda5-4e44-bcae-6eb8fbba22df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba659229f16c41c295c5bd4ddbe44c6c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:20.274358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-62dcd1c1-cda5-4e44-bcae-6eb8fbba22df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba659229f16c41c295c5bd4ddbe44c6c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:20.295594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-62dcd1c1-cda5-4e44-bcae-6eb8fbba22df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba659229f16c41c295c5bd4ddbe44c6c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:20.302578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-62dcd1c1-cda5-4e44-bcae-6eb8fbba22df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba659229f16c41c295c5bd4ddbe44c6c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:20.305433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ac584559-d67f-4b2e-931d-b69defe65138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf87b205be642f7a121d5f7de51749e', 'request_id': 'req-ac584559-d67f-4b2e-931d-b69defe65138'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:20.375102 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 926/1853] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:19 2022] DELETE /identity/v3/users/ba659229f16c41c295c5bd4ddbe44c6c => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:20.450522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ac584559-d67f-4b2e-931d-b69defe65138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf87b205be642f7a121d5f7de51749e', 'request_id': 'req-ac584559-d67f-4b2e-931d-b69defe65138'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:20.457296 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ac584559-d67f-4b2e-931d-b69defe65138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf87b205be642f7a121d5f7de51749e', 'request_id': 'req-ac584559-d67f-4b2e-931d-b69defe65138'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:20.468288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ac584559-d67f-4b2e-931d-b69defe65138 admin admin] The token cache is being invalidate because project ecf87b205be642f7a121d5f7de51749e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:20.468580 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ac584559-d67f-4b2e-931d-b69defe65138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:20.469220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ac584559-d67f-4b2e-931d-b69defe65138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:20.470754 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 928/1854] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:20 2022] DELETE /identity/v3/projects/ecf87b205be642f7a121d5f7de51749e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:20.475707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006b7ca-e78a-4bc4-b65b-38e170c60227 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:20.475998 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006b7ca-e78a-4bc4-b65b-38e170c60227 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:20.476281 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006b7ca-e78a-4bc4-b65b-38e170c60227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:20.493994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-6006b7ca-e78a-4bc4-b65b-38e170c60227 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:20.495182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-6006b7ca-e78a-4bc4-b65b-38e170c60227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:20.554617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 927/1855] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:20.562374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755b331-83fe-494f-b698-d86a1850114b None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:20.562656 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755b331-83fe-494f-b698-d86a1850114b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:20.562993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755b331-83fe-494f-b698-d86a1850114b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:20.583005 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-7755b331-83fe-494f-b698-d86a1850114b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:20.584563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-7755b331-83fe-494f-b698-d86a1850114b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:20.594050 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 929/1856] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:20.598037 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006b7ca-e78a-4bc4-b65b-38e170c60227 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:20.608091 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006b7ca-e78a-4bc4-b65b-38e170c60227 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:20.612689 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee268c60-38f6-48d1-9ae1-456ec23d63d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:20.613331 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee268c60-38f6-48d1-9ae1-456ec23d63d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:20.613607 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee268c60-38f6-48d1-9ae1-456ec23d63d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:20.613872 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee268c60-38f6-48d1-9ae1-456ec23d63d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:20.614629 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee268c60-38f6-48d1-9ae1-456ec23d63d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:20.614930 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee268c60-38f6-48d1-9ae1-456ec23d63d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:20.616547 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee268c60-38f6-48d1-9ae1-456ec23d63d9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:20.628804 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 928/1857] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:34:20.633471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755b331-83fe-494f-b698-d86a1850114b None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:20.646673 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755b331-83fe-494f-b698-d86a1850114b None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:20.652843 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07085db-104b-4948-a097-b37e378790e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:20.653503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07085db-104b-4948-a097-b37e378790e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:20.653784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07085db-104b-4948-a097-b37e378790e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:20.654064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07085db-104b-4948-a097-b37e378790e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:20.654784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07085db-104b-4948-a097-b37e378790e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:20.656732 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07085db-104b-4948-a097-b37e378790e7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:20.748152 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 930/1858] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:20 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:20.753182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee268c60-38f6-48d1-9ae1-456ec23d63d9 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:20.763030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee268c60-38f6-48d1-9ae1-456ec23d63d9 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:20.811061 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07085db-104b-4948-a097-b37e378790e7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:20.812908 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b07085db-104b-4948-a097-b37e378790e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:20.822686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894eb97-1bde-41eb-9b97-2628cb04959a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:20.823585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894eb97-1bde-41eb-9b97-2628cb04959a admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:20.834372 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894eb97-1bde-41eb-9b97-2628cb04959a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:20.834794 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894eb97-1bde-41eb-9b97-2628cb04959a admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:20.835654 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894eb97-1bde-41eb-9b97-2628cb04959a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:20.838016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894eb97-1bde-41eb-9b97-2628cb04959a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:20.878976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07085db-104b-4948-a097-b37e378790e7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:20.883753 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:20.884630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:20.884918 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:20.885495 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a admin admin] PATH_INFO: `/v3/projects/bb5a04dee1414f0188cc5024d0617490` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:20.886720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5a04dee1414f0188cc5024d0617490)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:20.889155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:20.948642 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 929/1859] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:20 2022] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:20.952499 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894eb97-1bde-41eb-9b97-2628cb04959a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:20.963074 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894eb97-1bde-41eb-9b97-2628cb04959a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:20.967834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282d419-48c1-4a26-ab68-b679f3e8549b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:20.968482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282d419-48c1-4a26-ab68-b679f3e8549b admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:20.968766 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282d419-48c1-4a26-ab68-b679f3e8549b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:20.969131 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282d419-48c1-4a26-ab68-b679f3e8549b admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:20.969868 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282d419-48c1-4a26-ab68-b679f3e8549b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:20.971525 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282d419-48c1-4a26-ab68-b679f3e8549b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:20.981670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 930/1860] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:20.985808 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282d419-48c1-4a26-ab68-b679f3e8549b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:20.995958 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282d419-48c1-4a26-ab68-b679f3e8549b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:21.000683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b40b2b-2837-4b62-9902-501c225cb43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:21.001306 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b40b2b-2837-4b62-9902-501c225cb43a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.001587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b40b2b-2837-4b62-9902-501c225cb43a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.001863 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b40b2b-2837-4b62-9902-501c225cb43a admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.003185 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b40b2b-2837-4b62-9902-501c225cb43a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:21.004771 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b40b2b-2837-4b62-9902-501c225cb43a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:21.014830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 931/1861] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:21.019503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b40b2b-2837-4b62-9902-501c225cb43a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:21.031389 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b40b2b-2837-4b62-9902-501c225cb43a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:21.034537 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e991a439-02c2-48b0-a3d3-92e916b2801e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:21.035431 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991a439-02c2-48b0-a3d3-92e916b2801e admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.035716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991a439-02c2-48b0-a3d3-92e916b2801e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.036028 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e991a439-02c2-48b0-a3d3-92e916b2801e admin admin] PATH_INFO: `/v3/projects/19785ab346f04ed9a0a742c82341c082/users/f005343039444a4cb661b87a80eee51a/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.051525 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991a439-02c2-48b0-a3d3-92e916b2801e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19785ab346f04ed9a0a742c82341c082, user_id=f005343039444a4cb661b87a80eee51a, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:21.054350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e991a439-02c2-48b0-a3d3-92e916b2801e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:21.068098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5a04dee1414f0188cc5024d0617490', 'request_id': 'req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:21.142569 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 932/1862] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:21 2022] PUT /identity/v3/projects/19785ab346f04ed9a0a742c82341c082/users/f005343039444a4cb661b87a80eee51a/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:21.146227 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef569b-0919-4897-b867-5b9defa78ecc None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.146622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef569b-0919-4897-b867-5b9defa78ecc None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.147012 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef569b-0919-4897-b867-5b9defa78ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.175084 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-6aef569b-0919-4897-b867-5b9defa78ecc None None] MFA Rules not processed for user `f005343039444a4cb661b87a80eee51a`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:21.176340 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-6aef569b-0919-4897-b867-5b9defa78ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:21.198874 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5a04dee1414f0188cc5024d0617490', 'request_id': 'req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:21.205777 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5a04dee1414f0188cc5024d0617490', 'request_id': 'req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:21.219534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a admin admin] The token cache is being invalidate because project bb5a04dee1414f0188cc5024d0617490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:21.219934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:21.220692 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1aa64daf-6517-43fb-8c40-ca6929dd3e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:21.233834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 931/1863] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:20 2022] DELETE /identity/v3/projects/bb5a04dee1414f0188cc5024d0617490 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:21.233834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4894f-ed06-4613-9f7e-2f2cdaa781cc None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.233834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4894f-ed06-4613-9f7e-2f2cdaa781cc None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.233834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4894f-ed06-4613-9f7e-2f2cdaa781cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.254687 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1db4894f-ed06-4613-9f7e-2f2cdaa781cc None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:21.255985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1db4894f-ed06-4613-9f7e-2f2cdaa781cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:21.270428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 933/1864] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:21.272188 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef569b-0919-4897-b867-5b9defa78ecc None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:21.273702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-6aef569b-0919-4897-b867-5b9defa78ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:21.335269 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 932/1865] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:21.336721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6719-08bb-4077-91c4-85055c5509ec None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.337012 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6719-08bb-4077-91c4-85055c5509ec None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.337288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f6719-08bb-4077-91c4-85055c5509ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.356969 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-5e3f6719-08bb-4077-91c4-85055c5509ec None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:21.358294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5e3f6719-08bb-4077-91c4-85055c5509ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:21.375188 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef569b-0919-4897-b867-5b9defa78ecc None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:21.376333 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 933/1866] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:21.380166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa22db4-7b84-46c3-b048-f5da3a350132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:21.380166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa22db4-7b84-46c3-b048-f5da3a350132 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.380166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa22db4-7b84-46c3-b048-f5da3a350132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.380166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa22db4-7b84-46c3-b048-f5da3a350132 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.381196 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa22db4-7b84-46c3-b048-f5da3a350132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:21.381368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f6719-08bb-4077-91c4-85055c5509ec None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:21.383335 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa22db4-7b84-46c3-b048-f5da3a350132 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:21.394645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f6719-08bb-4077-91c4-85055c5509ec None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:21.400244 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f8c21-da9e-4b18-bf0c-bc77e5b4cc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:21.400902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f8c21-da9e-4b18-bf0c-bc77e5b4cc8e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.401181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f8c21-da9e-4b18-bf0c-bc77e5b4cc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.401453 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f8c21-da9e-4b18-bf0c-bc77e5b4cc8e admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.409718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f8c21-da9e-4b18-bf0c-bc77e5b4cc8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:21.409718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f8c21-da9e-4b18-bf0c-bc77e5b4cc8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:21.409718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f8c21-da9e-4b18-bf0c-bc77e5b4cc8e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:21.420498 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 934/1867] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:34:21.421721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f8c21-da9e-4b18-bf0c-bc77e5b4cc8e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:21.431930 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f8c21-da9e-4b18-bf0c-bc77e5b4cc8e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:21.436557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353ce05-d3a0-4c7b-9e8e-213f3d81af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:21.437271 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353ce05-d3a0-4c7b-9e8e-213f3d81af09 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.437551 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353ce05-d3a0-4c7b-9e8e-213f3d81af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.437826 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7353ce05-d3a0-4c7b-9e8e-213f3d81af09 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.438620 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353ce05-d3a0-4c7b-9e8e-213f3d81af09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:21.441391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7353ce05-d3a0-4c7b-9e8e-213f3d81af09 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:21.480939 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 934/1868] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:21 2022] POST /identity/v3/projects => generated 369 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:21.485166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa22db4-7b84-46c3-b048-f5da3a350132 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:21.546520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa22db4-7b84-46c3-b048-f5da3a350132 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:21.552231 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0fee8-764f-45c9-86b6-2fc1c24f48a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:21.553052 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0fee8-764f-45c9-86b6-2fc1c24f48a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.553427 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0fee8-764f-45c9-86b6-2fc1c24f48a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.553808 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0fee8-764f-45c9-86b6-2fc1c24f48a8 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.554772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0fee8-764f-45c9-86b6-2fc1c24f48a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:21.558695 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0fee8-764f-45c9-86b6-2fc1c24f48a8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:21.563451 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 935/1869] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:21 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:21.569772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353ce05-d3a0-4c7b-9e8e-213f3d81af09 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:21.636164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7353ce05-d3a0-4c7b-9e8e-213f3d81af09 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:21.640879 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0916d22-9241-438b-a482-e1269747f28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:21.641537 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0916d22-9241-438b-a482-e1269747f28b admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.641819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0916d22-9241-438b-a482-e1269747f28b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.642096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0916d22-9241-438b-a482-e1269747f28b admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.642791 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0916d22-9241-438b-a482-e1269747f28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:21.645531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0916d22-9241-438b-a482-e1269747f28b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:21.656978 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 935/1870] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:21 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:21.661520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0fee8-764f-45c9-86b6-2fc1c24f48a8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:21.671044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0fee8-764f-45c9-86b6-2fc1c24f48a8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:21.675864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83963d2-a11e-4761-b896-501b61103ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:21.676497 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83963d2-a11e-4761-b896-501b61103ba3 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.676778 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83963d2-a11e-4761-b896-501b61103ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.677051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83963d2-a11e-4761-b896-501b61103ba3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.677874 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83963d2-a11e-4761-b896-501b61103ba3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:21.679493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83963d2-a11e-4761-b896-501b61103ba3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:21.689705 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 936/1871] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:21.693890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83963d2-a11e-4761-b896-501b61103ba3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:21.703382 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83963d2-a11e-4761-b896-501b61103ba3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:21.709373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca02be5-9c8b-4d81-aa4d-89f8999d92e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:21.710223 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca02be5-9c8b-4d81-aa4d-89f8999d92e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.710502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca02be5-9c8b-4d81-aa4d-89f8999d92e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.710807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca02be5-9c8b-4d81-aa4d-89f8999d92e4 admin admin] PATH_INFO: `/v3/projects/2c346bd4952647d2b26392048a5488d7/users/4ace61fff8cb4445b166d9a59734c4d3/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.726667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca02be5-9c8b-4d81-aa4d-89f8999d92e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c346bd4952647d2b26392048a5488d7, user_id=4ace61fff8cb4445b166d9a59734c4d3, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:21.729365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca02be5-9c8b-4d81-aa4d-89f8999d92e4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:21.732255 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 936/1872] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:21 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:21.733876 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0916d22-9241-438b-a482-e1269747f28b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:21.743419 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0916d22-9241-438b-a482-e1269747f28b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:21.748032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75eb568-73ba-449c-b965-b732e3c4c7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:21.748671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eb568-73ba-449c-b965-b732e3c4c7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.749226 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eb568-73ba-449c-b965-b732e3c4c7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.749226 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75eb568-73ba-449c-b965-b732e3c4c7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.749930 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75eb568-73ba-449c-b965-b732e3c4c7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:21.751551 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75eb568-73ba-449c-b965-b732e3c4c7d8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:21.761306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 937/1873] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:21.765108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75eb568-73ba-449c-b965-b732e3c4c7d8 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:21.775056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75eb568-73ba-449c-b965-b732e3c4c7d8 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:21.779688 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ed00c-fc4b-40b4-a675-8ffef07ea8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:21.780293 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ed00c-fc4b-40b4-a675-8ffef07ea8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.780574 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ed00c-fc4b-40b4-a675-8ffef07ea8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.784942 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ed00c-fc4b-40b4-a675-8ffef07ea8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.784942 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ed00c-fc4b-40b4-a675-8ffef07ea8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:21.784942 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ed00c-fc4b-40b4-a675-8ffef07ea8e2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:21.792953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 938/1874] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:21.796772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ed00c-fc4b-40b4-a675-8ffef07ea8e2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:21.806068 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ed00c-fc4b-40b4-a675-8ffef07ea8e2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:21.810390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 937/1875] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:21 2022] PUT /identity/v3/projects/2c346bd4952647d2b26392048a5488d7/users/4ace61fff8cb4445b166d9a59734c4d3/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:21.819262 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca02be5-9c8b-4d81-aa4d-89f8999d92e4 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:21.870038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033952a-702d-4f55-9cb2-43a75a417679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:21.870925 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033952a-702d-4f55-9cb2-43a75a417679 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.871202 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033952a-702d-4f55-9cb2-43a75a417679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.871508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033952a-702d-4f55-9cb2-43a75a417679 admin admin] PATH_INFO: `/v3/projects/46bb093a4dfb464090145596c694475c/users/8ee4d2f7b35d418098f815db301fd1aa/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.880183 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca02be5-9c8b-4d81-aa4d-89f8999d92e4 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:21.885011 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7f37e-31a5-4d7b-bd7b-e9d7a1b45839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:21.885668 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7f37e-31a5-4d7b-bd7b-e9d7a1b45839 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.885954 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7f37e-31a5-4d7b-bd7b-e9d7a1b45839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.886228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7f37e-31a5-4d7b-bd7b-e9d7a1b45839 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.886960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7f37e-31a5-4d7b-bd7b-e9d7a1b45839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:21.887497 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033952a-702d-4f55-9cb2-43a75a417679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bb093a4dfb464090145596c694475c, user_id=8ee4d2f7b35d418098f815db301fd1aa, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:21.888584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f7f37e-31a5-4d7b-bd7b-e9d7a1b45839 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:21.890122 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033952a-702d-4f55-9cb2-43a75a417679 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:21.899638 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 938/1876] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:21.903783 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7f37e-31a5-4d7b-bd7b-e9d7a1b45839 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:21.913527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f7f37e-31a5-4d7b-bd7b-e9d7a1b45839 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:21.918496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab4404e-6007-407e-b2c1-7ae78d9c4f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:21.919435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4404e-6007-407e-b2c1-7ae78d9c4f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.919716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4404e-6007-407e-b2c1-7ae78d9c4f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.919981 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4404e-6007-407e-b2c1-7ae78d9c4f50 admin admin] PATH_INFO: `/v3/projects/2c346bd4952647d2b26392048a5488d7/users/4ace61fff8cb4445b166d9a59734c4d3/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.921959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4404e-6007-407e-b2c1-7ae78d9c4f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c346bd4952647d2b26392048a5488d7, user_id=4ace61fff8cb4445b166d9a59734c4d3, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:21.924703 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab4404e-6007-407e-b2c1-7ae78d9c4f50 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:21.935424 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 939/1877] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:21 2022] PUT /identity/v3/projects/2c346bd4952647d2b26392048a5488d7/users/4ace61fff8cb4445b166d9a59734c4d3/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:21.946441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f032e30-c7c1-41c0-be0c-d5070c90e612 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.946730 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f032e30-c7c1-41c0-be0c-d5070c90e612 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.947008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f032e30-c7c1-41c0-be0c-d5070c90e612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:21.959594 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 939/1878] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:21 2022] PUT /identity/v3/projects/46bb093a4dfb464090145596c694475c/users/8ee4d2f7b35d418098f815db301fd1aa/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:21.977656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-1f032e30-c7c1-41c0-be0c-d5070c90e612 None None] MFA Rules not processed for user `4ace61fff8cb4445b166d9a59734c4d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:21.978459 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3450a2d-3702-42e7-9430-b129113c3e74 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:21.978751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3450a2d-3702-42e7-9430-b129113c3e74 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:21.978857 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-1f032e30-c7c1-41c0-be0c-d5070c90e612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:21.979079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3450a2d-3702-42e7-9430-b129113c3e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:22.009364 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-d3450a2d-3702-42e7-9430-b129113c3e74 None None] MFA Rules not processed for user `8ee4d2f7b35d418098f815db301fd1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:22.012485 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d3450a2d-3702-42e7-9430-b129113c3e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:22.050540 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 940/1879] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:21 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:22.061853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f032e30-c7c1-41c0-be0c-d5070c90e612 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:22.063382 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-1f032e30-c7c1-41c0-be0c-d5070c90e612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:22.085344 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 940/1880] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:22.092127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3450a2d-3702-42e7-9430-b129113c3e74 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:22.123375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f032e30-c7c1-41c0-be0c-d5070c90e612 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:22.126968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae625d-21f2-4696-865a-70ec3bf136ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:22.128351 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae625d-21f2-4696-865a-70ec3bf136ad service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:22.128656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae625d-21f2-4696-865a-70ec3bf136ad service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:22.128957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae625d-21f2-4696-865a-70ec3bf136ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:22.138115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae625d-21f2-4696-865a-70ec3bf136ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:22.139569 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae625d-21f2-4696-865a-70ec3bf136ad service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:22.150685 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 941/1881] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:22 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:34:22.153667 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3450a2d-3702-42e7-9430-b129113c3e74 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:22.158311 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c2a48-2e26-47d7-a288-0b46d9cf4685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:22.159020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c2a48-2e26-47d7-a288-0b46d9cf4685 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:22.159407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c2a48-2e26-47d7-a288-0b46d9cf4685 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:22.159677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c2a48-2e26-47d7-a288-0b46d9cf4685 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:22.160381 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c2a48-2e26-47d7-a288-0b46d9cf4685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:22.162273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c2a48-2e26-47d7-a288-0b46d9cf4685 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:22.261360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae625d-21f2-4696-865a-70ec3bf136ad service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:22.263405 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-11ae625d-21f2-4696-865a-70ec3bf136ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:22.279408 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 941/1882] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:22 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:22.281907 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae625d-21f2-4696-865a-70ec3bf136ad service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:22.283318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c2a48-2e26-47d7-a288-0b46d9cf4685 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:22.354623 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642594-9ef9-4d04-bc5c-d5242c08e5ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:22.356057 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642594-9ef9-4d04-bc5c-d5242c08e5ea service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:22.356343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642594-9ef9-4d04-bc5c-d5242c08e5ea service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:22.356835 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1642594-9ef9-4d04-bc5c-d5242c08e5ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:22.380010 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c2a48-2e26-47d7-a288-0b46d9cf4685 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:22.385640 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa236fc-19dc-49f9-b15e-65bdd5bf3ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:22.386376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa236fc-19dc-49f9-b15e-65bdd5bf3ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:22.386617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa236fc-19dc-49f9-b15e-65bdd5bf3ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:22.386897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa236fc-19dc-49f9-b15e-65bdd5bf3ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:22.387650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa236fc-19dc-49f9-b15e-65bdd5bf3ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:22.389869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa236fc-19dc-49f9-b15e-65bdd5bf3ea4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:22.461533 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1642594-9ef9-4d04-bc5c-d5242c08e5ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:22.461533 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1642594-9ef9-4d04-bc5c-d5242c08e5ea service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:22.470269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 942/1883] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:34:22.485262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 942/1884] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:22 2022] POST /identity/v3/users => generated 289 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:22.489694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642594-9ef9-4d04-bc5c-d5242c08e5ea service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:22.501861 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1642594-9ef9-4d04-bc5c-d5242c08e5ea service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:22.509196 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabf33c-5250-46d3-936f-1a38574172e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:22.509938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabf33c-5250-46d3-936f-1a38574172e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:22.511133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabf33c-5250-46d3-936f-1a38574172e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:22.511133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabf33c-5250-46d3-936f-1a38574172e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:22.511665 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabf33c-5250-46d3-936f-1a38574172e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:22.514718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabf33c-5250-46d3-936f-1a38574172e2 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:22.529511 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 943/1885] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:22.538548 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa236fc-19dc-49f9-b15e-65bdd5bf3ea4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:22.546072 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa236fc-19dc-49f9-b15e-65bdd5bf3ea4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:22.551162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9b78d-fe96-4f4f-a8ad-a299f6989caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:22.551850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9b78d-fe96-4f4f-a8ad-a299f6989caf admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:22.552134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9b78d-fe96-4f4f-a8ad-a299f6989caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:22.552406 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9b78d-fe96-4f4f-a8ad-a299f6989caf admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:22.553170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9b78d-fe96-4f4f-a8ad-a299f6989caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:22.554743 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9b78d-fe96-4f4f-a8ad-a299f6989caf admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:22.568613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 943/1886] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:22.571845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabf33c-5250-46d3-936f-1a38574172e2 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:22.589446 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabf33c-5250-46d3-936f-1a38574172e2 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:22.594982 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59df6-948b-4dc3-bfd7-4e17035640ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:22.595909 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59df6-948b-4dc3-bfd7-4e17035640ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:22.598622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59df6-948b-4dc3-bfd7-4e17035640ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:22.598917 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59df6-948b-4dc3-bfd7-4e17035640ce admin admin] PATH_INFO: `/v3/projects/41303678602e430e9ecf06fe4626b7f2/users/1c3fcf55840c4d7ca061fe2f39b714cd/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:22.630854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b59df6-948b-4dc3-bfd7-4e17035640ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=41303678602e430e9ecf06fe4626b7f2, user_id=1c3fcf55840c4d7ca061fe2f39b714cd, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:22.636667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b59df6-948b-4dc3-bfd7-4e17035640ce admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:22.730718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 944/1887] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:22 2022] PUT /identity/v3/projects/41303678602e430e9ecf06fe4626b7f2/users/1c3fcf55840c4d7ca061fe2f39b714cd/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:22.741138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906f220-8671-410a-b64b-39430cc0bda5 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:22.741417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906f220-8671-410a-b64b-39430cc0bda5 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:22.741700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906f220-8671-410a-b64b-39430cc0bda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:22.770748 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-5906f220-8671-410a-b64b-39430cc0bda5 None None] MFA Rules not processed for user `1c3fcf55840c4d7ca061fe2f39b714cd`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:22.772006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5906f220-8671-410a-b64b-39430cc0bda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:22.851011 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 944/1888] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:22.855163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59df6-948b-4dc3-bfd7-4e17035640ce admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:22.918001 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59df6-948b-4dc3-bfd7-4e17035640ce admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:22.922720 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8deaa0d-8ef3-4b80-a0b8-cae2d2acd807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:22.923403 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deaa0d-8ef3-4b80-a0b8-cae2d2acd807 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:22.923687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deaa0d-8ef3-4b80-a0b8-cae2d2acd807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:22.923986 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8deaa0d-8ef3-4b80-a0b8-cae2d2acd807 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:22.924950 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8deaa0d-8ef3-4b80-a0b8-cae2d2acd807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:22.926889 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8deaa0d-8ef3-4b80-a0b8-cae2d2acd807 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:23.028816 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 945/1889] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:22 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:23.032990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906f220-8671-410a-b64b-39430cc0bda5 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:23.043647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906f220-8671-410a-b64b-39430cc0bda5 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:23.098357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f5d9e-8197-44f7-aeed-cf667a0106a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:23.098966 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f5d9e-8197-44f7-aeed-cf667a0106a5 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:23.099276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f5d9e-8197-44f7-aeed-cf667a0106a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:23.099561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f5d9e-8197-44f7-aeed-cf667a0106a5 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:23.100270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f5d9e-8197-44f7-aeed-cf667a0106a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:23.102190 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f5d9e-8197-44f7-aeed-cf667a0106a5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:23.183958 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 945/1890] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:23 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:23.186670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8deaa0d-8ef3-4b80-a0b8-cae2d2acd807 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:23.197700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8deaa0d-8ef3-4b80-a0b8-cae2d2acd807 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:23.202408 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e49fbd-d40f-4c18-aa34-9d05cfe5ce94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:23.203068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e49fbd-d40f-4c18-aa34-9d05cfe5ce94 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:23.203390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e49fbd-d40f-4c18-aa34-9d05cfe5ce94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:23.203669 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e49fbd-d40f-4c18-aa34-9d05cfe5ce94 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:23.204410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e49fbd-d40f-4c18-aa34-9d05cfe5ce94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:23.206043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e49fbd-d40f-4c18-aa34-9d05cfe5ce94 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:23.216670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 946/1891] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:23.227015 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f5d9e-8197-44f7-aeed-cf667a0106a5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:23.237950 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f5d9e-8197-44f7-aeed-cf667a0106a5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:23.242682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ab596-4448-4176-ae65-7ea95a613402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:23.243602 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ab596-4448-4176-ae65-7ea95a613402 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:23.243885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ab596-4448-4176-ae65-7ea95a613402 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:23.244163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ab596-4448-4176-ae65-7ea95a613402 admin admin] PATH_INFO: `/v3/projects/468046f8a5e449efabb72d3b3ebf1303/users/a0502fec581e42aca5ac2e801fb43810/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:23.261740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ab596-4448-4176-ae65-7ea95a613402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=468046f8a5e449efabb72d3b3ebf1303, user_id=a0502fec581e42aca5ac2e801fb43810, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:23.264519 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ab596-4448-4176-ae65-7ea95a613402 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:23.347650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 946/1892] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:23 2022] PUT /identity/v3/projects/468046f8a5e449efabb72d3b3ebf1303/users/a0502fec581e42aca5ac2e801fb43810/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:23.351928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e49fbd-d40f-4c18-aa34-9d05cfe5ce94 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:23.362379 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e49fbd-d40f-4c18-aa34-9d05cfe5ce94 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:23.416903 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d0c53-736e-482f-8ba9-08726678405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:23.417565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d0c53-736e-482f-8ba9-08726678405a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:23.417844 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d0c53-736e-482f-8ba9-08726678405a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:23.418117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d0c53-736e-482f-8ba9-08726678405a admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:23.418842 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d0c53-736e-482f-8ba9-08726678405a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:23.420485 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d0c53-736e-482f-8ba9-08726678405a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:23.430285 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 947/1893] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:23.434396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ab596-4448-4176-ae65-7ea95a613402 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:23.444770 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ab596-4448-4176-ae65-7ea95a613402 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:23.449382 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b481e-fe2f-45a5-8f83-d2b2ad3031fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:23.450251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b481e-fe2f-45a5-8f83-d2b2ad3031fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:23.450532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b481e-fe2f-45a5-8f83-d2b2ad3031fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:23.450806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55b481e-fe2f-45a5-8f83-d2b2ad3031fa admin admin] PATH_INFO: `/v3/projects/468046f8a5e449efabb72d3b3ebf1303/users/a0502fec581e42aca5ac2e801fb43810/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:23.452828 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b481e-fe2f-45a5-8f83-d2b2ad3031fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=468046f8a5e449efabb72d3b3ebf1303, user_id=a0502fec581e42aca5ac2e801fb43810, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:23.455494 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55b481e-fe2f-45a5-8f83-d2b2ad3031fa admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:23.466130 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 947/1894] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:23 2022] PUT /identity/v3/projects/468046f8a5e449efabb72d3b3ebf1303/users/a0502fec581e42aca5ac2e801fb43810/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:23.478064 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da113e34-9351-4466-92ee-d30fb26c4160 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:23.478382 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da113e34-9351-4466-92ee-d30fb26c4160 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:23.478663 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da113e34-9351-4466-92ee-d30fb26c4160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:23.507644 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-da113e34-9351-4466-92ee-d30fb26c4160 None None] MFA Rules not processed for user `a0502fec581e42aca5ac2e801fb43810`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:23.508905 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-da113e34-9351-4466-92ee-d30fb26c4160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:23.578919 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 948/1895] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:23.589241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b481e-fe2f-45a5-8f83-d2b2ad3031fa admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:23.657104 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55b481e-fe2f-45a5-8f83-d2b2ad3031fa admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:23.665278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1af263-d1ad-4f7a-8c2b-410ae4d5969d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:23.665278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1af263-d1ad-4f7a-8c2b-410ae4d5969d service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:23.665278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1af263-d1ad-4f7a-8c2b-410ae4d5969d service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:23.665278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1af263-d1ad-4f7a-8c2b-410ae4d5969d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:23.719219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1af263-d1ad-4f7a-8c2b-410ae4d5969d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:23.720673 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1af263-d1ad-4f7a-8c2b-410ae4d5969d service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:23.730134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 948/1896] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:27.451391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da113e34-9351-4466-92ee-d30fb26c4160 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:27.521567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da113e34-9351-4466-92ee-d30fb26c4160 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:27.527154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759d1f1-3562-4558-aa3e-c30e3699b795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:27.528165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d1f1-3562-4558-aa3e-c30e3699b795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:27.528684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d1f1-3562-4558-aa3e-c30e3699b795 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:27.529224 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759d1f1-3562-4558-aa3e-c30e3699b795 admin admin] PATH_INFO: `/v3/users/f005343039444a4cb661b87a80eee51a` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:27.530618 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759d1f1-3562-4558-aa3e-c30e3699b795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f005343039444a4cb661b87a80eee51a)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:27.533076 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759d1f1-3562-4558-aa3e-c30e3699b795 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:27.725490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9759d1f1-3562-4558-aa3e-c30e3699b795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f005343039444a4cb661b87a80eee51a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:27.726174 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9759d1f1-3562-4558-aa3e-c30e3699b795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f005343039444a4cb661b87a80eee51a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:27.726791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9759d1f1-3562-4558-aa3e-c30e3699b795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f005343039444a4cb661b87a80eee51a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:27.739776 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9759d1f1-3562-4558-aa3e-c30e3699b795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f005343039444a4cb661b87a80eee51a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:27.746580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9759d1f1-3562-4558-aa3e-c30e3699b795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f005343039444a4cb661b87a80eee51a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:27.827416 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 949/1897] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:27 2022] DELETE /identity/v3/users/f005343039444a4cb661b87a80eee51a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:27.832492 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa6c02-c502-409b-a712-a7fbf0397a29 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:27.833035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa6c02-c502-409b-a712-a7fbf0397a29 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:27.833211 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afa6c02-c502-409b-a712-a7fbf0397a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:27.851553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-8afa6c02-c502-409b-a712-a7fbf0397a29 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:27.852793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-8afa6c02-c502-409b-a712-a7fbf0397a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:27.924553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 949/1898] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:27.935453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759d1f1-3562-4558-aa3e-c30e3699b795 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:27.937131 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9759d1f1-3562-4558-aa3e-c30e3699b795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:28.033601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759d1f1-3562-4558-aa3e-c30e3699b795 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:28.037206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa6c02-c502-409b-a712-a7fbf0397a29 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:28.047807 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-8afa6c02-c502-409b-a712-a7fbf0397a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:28.048069 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa9cfa-8d32-4436-9cfc-2f78562c90be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:28.048069 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa9cfa-8d32-4436-9cfc-2f78562c90be service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:28.048226 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa9cfa-8d32-4436-9cfc-2f78562c90be service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:28.048464 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa9cfa-8d32-4436-9cfc-2f78562c90be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:28.059621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa9cfa-8d32-4436-9cfc-2f78562c90be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:28.061344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa9cfa-8d32-4436-9cfc-2f78562c90be service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:28.079014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 950/1899] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:28.129098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afa6c02-c502-409b-a712-a7fbf0397a29 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:28.156577 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bac724-0423-4336-9d64-98b6c13a4f9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:28.160280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac724-0423-4336-9d64-98b6c13a4f9f service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:28.161609 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac724-0423-4336-9d64-98b6c13a4f9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:28.161937 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac724-0423-4336-9d64-98b6c13a4f9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:28.166854 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b3bac724-0423-4336-9d64-98b6c13a4f9f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:28.266806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bac724-0423-4336-9d64-98b6c13a4f9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:28.268437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bac724-0423-4336-9d64-98b6c13a4f9f service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:28.280303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 950/1900] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:28.906165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa9cfa-8d32-4436-9cfc-2f78562c90be service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:28.908488 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b4aa9cfa-8d32-4436-9cfc-2f78562c90be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:28.924852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa9cfa-8d32-4436-9cfc-2f78562c90be service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:28.941416 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:28.941416 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:28.941416 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:28.941416 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] PATH_INFO: `/v3/projects/19785ab346f04ed9a0a742c82341c082` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:28.941786 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19785ab346f04ed9a0a742c82341c082)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:28.943854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:29.224454 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19785ab346f04ed9a0a742c82341c082', 'request_id': 'req-776e8e65-16b7-4567-8cda-b36f892c5770'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:29.236685 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19785ab346f04ed9a0a742c82341c082', 'request_id': 'req-776e8e65-16b7-4567-8cda-b36f892c5770'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:29.243412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19785ab346f04ed9a0a742c82341c082', 'request_id': 'req-776e8e65-16b7-4567-8cda-b36f892c5770'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:29.546611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] The token cache is being invalidate because project 19785ab346f04ed9a0a742c82341c082 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:29.561850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:29.561850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:29.561850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 951/1901] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:28 2022] DELETE /identity/v3/projects/19785ab346f04ed9a0a742c82341c082 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:29.565098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bac724-0423-4336-9d64-98b6c13a4f9f service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:29.600103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bac724-0423-4336-9d64-98b6c13a4f9f service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:29.677045 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d1b7a-73a8-4070-9247-c69d175ee519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:29.678260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d1b7a-73a8-4070-9247-c69d175ee519 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:29.678544 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d1b7a-73a8-4070-9247-c69d175ee519 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:29.678816 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90d1b7a-73a8-4070-9247-c69d175ee519 admin admin] PATH_INFO: `/v3/users/4ace61fff8cb4445b166d9a59734c4d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:29.680077 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d1b7a-73a8-4070-9247-c69d175ee519 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ace61fff8cb4445b166d9a59734c4d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:29.682044 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90d1b7a-73a8-4070-9247-c69d175ee519 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:29.953191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c90d1b7a-73a8-4070-9247-c69d175ee519 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ace61fff8cb4445b166d9a59734c4d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:29.957867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c90d1b7a-73a8-4070-9247-c69d175ee519 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ace61fff8cb4445b166d9a59734c4d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:29.957867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c90d1b7a-73a8-4070-9247-c69d175ee519 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ace61fff8cb4445b166d9a59734c4d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:29.990626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c90d1b7a-73a8-4070-9247-c69d175ee519 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ace61fff8cb4445b166d9a59734c4d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:30.006131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c90d1b7a-73a8-4070-9247-c69d175ee519 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ace61fff8cb4445b166d9a59734c4d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:30.090652 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 951/1902] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:29 2022] DELETE /identity/v3/users/4ace61fff8cb4445b166d9a59734c4d3 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:30.826933 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:30.829257 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:30.890982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d1b7a-73a8-4070-9247-c69d175ee519 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:30.892794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c90d1b7a-73a8-4070-9247-c69d175ee519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:30.989183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90d1b7a-73a8-4070-9247-c69d175ee519 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:30.993714 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776e8e65-16b7-4567-8cda-b36f892c5770 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:30.998643 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be643b3-4d67-48ea-a84d-2da7c2dcb004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:31.001432 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be643b3-4d67-48ea-a84d-2da7c2dcb004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:31.001893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be643b3-4d67-48ea-a84d-2da7c2dcb004 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:31.003033 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be643b3-4d67-48ea-a84d-2da7c2dcb004 admin admin] PATH_INFO: `/v3/projects/2c346bd4952647d2b26392048a5488d7` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:31.006899 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be643b3-4d67-48ea-a84d-2da7c2dcb004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c346bd4952647d2b26392048a5488d7)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:31.009062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be643b3-4d67-48ea-a84d-2da7c2dcb004 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:31.063463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bcf5d-43f1-4874-85da-d664a7e13a47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:31.064119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bcf5d-43f1-4874-85da-d664a7e13a47 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:31.064397 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bcf5d-43f1-4874-85da-d664a7e13a47 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:31.064672 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bcf5d-43f1-4874-85da-d664a7e13a47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:31.067047 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b98bcf5d-43f1-4874-85da-d664a7e13a47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:31.152756 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bcf5d-43f1-4874-85da-d664a7e13a47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:31.154945 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bcf5d-43f1-4874-85da-d664a7e13a47 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:31.166722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 952/1903] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:31.178069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4be643b3-4d67-48ea-a84d-2da7c2dcb004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c346bd4952647d2b26392048a5488d7', 'request_id': 'req-4be643b3-4d67-48ea-a84d-2da7c2dcb004'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:31.290363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4be643b3-4d67-48ea-a84d-2da7c2dcb004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c346bd4952647d2b26392048a5488d7', 'request_id': 'req-4be643b3-4d67-48ea-a84d-2da7c2dcb004'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:31.297464 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4be643b3-4d67-48ea-a84d-2da7c2dcb004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c346bd4952647d2b26392048a5488d7', 'request_id': 'req-4be643b3-4d67-48ea-a84d-2da7c2dcb004'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:31.310459 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4be643b3-4d67-48ea-a84d-2da7c2dcb004 admin admin] The token cache is being invalidate because project 2c346bd4952647d2b26392048a5488d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:31.310709 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4be643b3-4d67-48ea-a84d-2da7c2dcb004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:31.311452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4be643b3-4d67-48ea-a84d-2da7c2dcb004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:31.313299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 952/1904] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:30 2022] DELETE /identity/v3/projects/2c346bd4952647d2b26392048a5488d7 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:31.322870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a06c-d605-40c2-bb08-f339d6ced670 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:31.322870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a06c-d605-40c2-bb08-f339d6ced670 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:31.322870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a06c-d605-40c2-bb08-f339d6ced670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:31.344314 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-b791a06c-d605-40c2-bb08-f339d6ced670 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:31.345531 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b791a06c-d605-40c2-bb08-f339d6ced670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:31.435280 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 953/1905] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:31.444738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1678a2-6b7a-41ff-8f79-f78da79ddfc0 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:31.444738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1678a2-6b7a-41ff-8f79-f78da79ddfc0 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:31.445671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1678a2-6b7a-41ff-8f79-f78da79ddfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:31.476119 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-da1678a2-6b7a-41ff-8f79-f78da79ddfc0 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:31.478476 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-da1678a2-6b7a-41ff-8f79-f78da79ddfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:31.488256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 953/1906] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:31.495456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791a06c-d605-40c2-bb08-f339d6ced670 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:31.509392 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791a06c-d605-40c2-bb08-f339d6ced670 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:31.514678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac42423-0473-4fa0-a8dd-254f6cebd3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:31.515514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac42423-0473-4fa0-a8dd-254f6cebd3fb admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:31.515912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac42423-0473-4fa0-a8dd-254f6cebd3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:31.516358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac42423-0473-4fa0-a8dd-254f6cebd3fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:31.517112 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac42423-0473-4fa0-a8dd-254f6cebd3fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:31.518438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac42423-0473-4fa0-a8dd-254f6cebd3fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:31.521379 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac42423-0473-4fa0-a8dd-254f6cebd3fb admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:31.539467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 954/1907] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:34:31.540604 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1678a2-6b7a-41ff-8f79-f78da79ddfc0 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:31.563321 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1678a2-6b7a-41ff-8f79-f78da79ddfc0 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:31.568753 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2e866-26e7-4bb5-9ea0-ab5b66b1d7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:31.569517 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2e866-26e7-4bb5-9ea0-ab5b66b1d7fb admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:31.570006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2e866-26e7-4bb5-9ea0-ab5b66b1d7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:31.570350 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e2e866-26e7-4bb5-9ea0-ab5b66b1d7fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:31.571202 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2e866-26e7-4bb5-9ea0-ab5b66b1d7fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:31.573448 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e2e866-26e7-4bb5-9ea0-ab5b66b1d7fb admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:31.668966 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 954/1908] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:31 2022] POST /identity/v3/projects => generated 393 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:31.673406 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac42423-0473-4fa0-a8dd-254f6cebd3fb admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:31.689959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac42423-0473-4fa0-a8dd-254f6cebd3fb admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:31.752799 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3ee37-720f-4403-9cfb-bf44de254c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:31.754471 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3ee37-720f-4403-9cfb-bf44de254c8d admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:31.754471 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3ee37-720f-4403-9cfb-bf44de254c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:31.754471 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3ee37-720f-4403-9cfb-bf44de254c8d admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:31.755181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3ee37-720f-4403-9cfb-bf44de254c8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:31.757119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3ee37-720f-4403-9cfb-bf44de254c8d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:31.838921 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 955/1909] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:31 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:31.844562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2e866-26e7-4bb5-9ea0-ab5b66b1d7fb admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:31.853852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e2e866-26e7-4bb5-9ea0-ab5b66b1d7fb admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:31.858426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b385ac-ad19-4223-b9c1-a6400b270c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:31.859071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b385ac-ad19-4223-b9c1-a6400b270c89 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:31.859395 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b385ac-ad19-4223-b9c1-a6400b270c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:31.859675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b385ac-ad19-4223-b9c1-a6400b270c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:31.860446 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b385ac-ad19-4223-b9c1-a6400b270c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:31.862023 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b385ac-ad19-4223-b9c1-a6400b270c89 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:31.873315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 955/1910] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:31.877295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3ee37-720f-4403-9cfb-bf44de254c8d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:31.887422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3ee37-720f-4403-9cfb-bf44de254c8d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:31.892180 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02201d1-3a74-4166-97e8-89cd0a0b6d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:31.896630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02201d1-3a74-4166-97e8-89cd0a0b6d66 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:31.896630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02201d1-3a74-4166-97e8-89cd0a0b6d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:31.896630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02201d1-3a74-4166-97e8-89cd0a0b6d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:31.896630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02201d1-3a74-4166-97e8-89cd0a0b6d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:31.896630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02201d1-3a74-4166-97e8-89cd0a0b6d66 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:31.906973 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 956/1911] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:31.912041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b385ac-ad19-4223-b9c1-a6400b270c89 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:31.927322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b385ac-ad19-4223-b9c1-a6400b270c89 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:31.933108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bffd11-c344-4b06-a7eb-7cd8ef10fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:31.933998 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bffd11-c344-4b06-a7eb-7cd8ef10fc7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:31.934276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bffd11-c344-4b06-a7eb-7cd8ef10fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:31.934814 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bffd11-c344-4b06-a7eb-7cd8ef10fc7f admin admin] PATH_INFO: `/v3/projects/7529886c7b6f481b94bfccd9a191e20a/users/a3f955b7078f4b328a7d2d02517cce88/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:31.973455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bffd11-c344-4b06-a7eb-7cd8ef10fc7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7529886c7b6f481b94bfccd9a191e20a, user_id=a3f955b7078f4b328a7d2d02517cce88, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:31.978103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bffd11-c344-4b06-a7eb-7cd8ef10fc7f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:32.109585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 956/1912] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:31 2022] PUT /identity/v3/projects/7529886c7b6f481b94bfccd9a191e20a/users/a3f955b7078f4b328a7d2d02517cce88/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:32.121112 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13bb17-708c-4a14-ab5b-ccca56fbe62d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:32.121520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13bb17-708c-4a14-ab5b-ccca56fbe62d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:32.121806 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13bb17-708c-4a14-ab5b-ccca56fbe62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:32.149216 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-af13bb17-708c-4a14-ab5b-ccca56fbe62d None None] MFA Rules not processed for user `a3f955b7078f4b328a7d2d02517cce88`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:32.150434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-af13bb17-708c-4a14-ab5b-ccca56fbe62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:32.243059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 957/1913] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:32.249014 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bffd11-c344-4b06-a7eb-7cd8ef10fc7f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:32.388766 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bffd11-c344-4b06-a7eb-7cd8ef10fc7f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:32.393197 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa161a-39a3-4f9d-859a-6b7ac42e71aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:32.393994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa161a-39a3-4f9d-859a-6b7ac42e71aa admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:32.394277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa161a-39a3-4f9d-859a-6b7ac42e71aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:32.394611 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aa161a-39a3-4f9d-859a-6b7ac42e71aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:32.395374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa161a-39a3-4f9d-859a-6b7ac42e71aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:32.402790 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aa161a-39a3-4f9d-859a-6b7ac42e71aa admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:32.421719 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13bb17-708c-4a14-ab5b-ccca56fbe62d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:32.423216 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-af13bb17-708c-4a14-ab5b-ccca56fbe62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:32.456838 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13bb17-708c-4a14-ab5b-ccca56fbe62d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:32.468614 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f29f8-6e4a-4094-a20c-2abad349eea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:32.469963 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f29f8-6e4a-4094-a20c-2abad349eea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:32.470560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f29f8-6e4a-4094-a20c-2abad349eea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:32.471029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f29f8-6e4a-4094-a20c-2abad349eea7 admin admin] PATH_INFO: `/v3/users/563459240c72453f9ebb278eed036654` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:32.473839 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f29f8-6e4a-4094-a20c-2abad349eea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=563459240c72453f9ebb278eed036654)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:32.479041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460f29f8-6e4a-4094-a20c-2abad349eea7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:32.495423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 957/1914] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:32 2022] POST /identity/v3/projects => generated 393 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:32.499308 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa161a-39a3-4f9d-859a-6b7ac42e71aa admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:32.632033 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aa161a-39a3-4f9d-859a-6b7ac42e71aa admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:32.641964 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ac42-1afb-419a-ac0a-66f4d719fc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:32.644914 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ac42-1afb-419a-ac0a-66f4d719fc50 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:32.645536 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ac42-1afb-419a-ac0a-66f4d719fc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:32.645917 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0320ac42-1afb-419a-ac0a-66f4d719fc50 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:32.646751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ac42-1afb-419a-ac0a-66f4d719fc50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:32.649289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0320ac42-1afb-419a-ac0a-66f4d719fc50 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:32.770310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-460f29f8-6e4a-4094-a20c-2abad349eea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '563459240c72453f9ebb278eed036654'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:32.771842 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-460f29f8-6e4a-4094-a20c-2abad349eea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '563459240c72453f9ebb278eed036654'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:32.774857 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-460f29f8-6e4a-4094-a20c-2abad349eea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '563459240c72453f9ebb278eed036654'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:32.782150 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 958/1915] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:32 2022] POST /identity/v3/users => generated 303 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:32.786572 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ac42-1afb-419a-ac0a-66f4d719fc50 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:32.788753 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-0320ac42-1afb-419a-ac0a-66f4d719fc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:32.796772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-460f29f8-6e4a-4094-a20c-2abad349eea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '563459240c72453f9ebb278eed036654'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:32.806274 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-460f29f8-6e4a-4094-a20c-2abad349eea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '563459240c72453f9ebb278eed036654'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:32.812488 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0320ac42-1afb-419a-ac0a-66f4d719fc50 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:32.819165 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38205b67-5b66-454e-b4c2-61c7f60b8640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:32.820092 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205b67-5b66-454e-b4c2-61c7f60b8640 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:32.820594 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205b67-5b66-454e-b4c2-61c7f60b8640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:32.821012 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205b67-5b66-454e-b4c2-61c7f60b8640 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:32.821916 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38205b67-5b66-454e-b4c2-61c7f60b8640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:32.823882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38205b67-5b66-454e-b4c2-61c7f60b8640 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:32.839678 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 959/1916] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:32.841162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38205b67-5b66-454e-b4c2-61c7f60b8640 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:32.859147 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38205b67-5b66-454e-b4c2-61c7f60b8640 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:32.867151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a0a56-c7be-4615-b40b-ea87ce2eb85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:32.868353 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a0a56-c7be-4615-b40b-ea87ce2eb85a admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:32.868787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a0a56-c7be-4615-b40b-ea87ce2eb85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:32.869221 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a0a56-c7be-4615-b40b-ea87ce2eb85a admin admin] PATH_INFO: `/v3/projects/76719c1d23d64b998b51d544fc48a51c/users/dd44311b852c4852a13ecb529fe986f8/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:32.887800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a0a56-c7be-4615-b40b-ea87ce2eb85a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76719c1d23d64b998b51d544fc48a51c, user_id=dd44311b852c4852a13ecb529fe986f8, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:32.893039 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a0a56-c7be-4615-b40b-ea87ce2eb85a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:32.913446 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 958/1917] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:32 2022] DELETE /identity/v3/users/563459240c72453f9ebb278eed036654 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:32.918233 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464ceec-8f4e-4d72-8e45-68615d9bc07a None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:32.918531 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464ceec-8f4e-4d72-8e45-68615d9bc07a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:32.918815 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8464ceec-8f4e-4d72-8e45-68615d9bc07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:32.938902 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-8464ceec-8f4e-4d72-8e45-68615d9bc07a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:32.952831 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8464ceec-8f4e-4d72-8e45-68615d9bc07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:33.015810 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 960/1918] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:32 2022] PUT /identity/v3/projects/76719c1d23d64b998b51d544fc48a51c/users/dd44311b852c4852a13ecb529fe986f8/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:33.020432 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a0a56-c7be-4615-b40b-ea87ce2eb85a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:33.023870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 959/1919] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:33.031791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464ceec-8f4e-4d72-8e45-68615d9bc07a None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:33.033957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8464ceec-8f4e-4d72-8e45-68615d9bc07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:33.100484 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a0a56-c7be-4615-b40b-ea87ce2eb85a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:33.107510 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d2b1e-d457-4c99-88d7-fd6e7e339a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:33.108529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d2b1e-d457-4c99-88d7-fd6e7e339a33 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:33.108985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d2b1e-d457-4c99-88d7-fd6e7e339a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:33.109481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d2b1e-d457-4c99-88d7-fd6e7e339a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:33.110466 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d2b1e-d457-4c99-88d7-fd6e7e339a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:33.112156 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d2b1e-d457-4c99-88d7-fd6e7e339a33 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:33.128039 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8464ceec-8f4e-4d72-8e45-68615d9bc07a None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:33.128791 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 961/1920] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:33.130263 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d2b1e-d457-4c99-88d7-fd6e7e339a33 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:33.149038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d2b1e-d457-4c99-88d7-fd6e7e339a33 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:33.154319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15f4f2-8c08-4a20-add0-77467d699dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:33.155198 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15f4f2-8c08-4a20-add0-77467d699dca admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:33.155529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15f4f2-8c08-4a20-add0-77467d699dca admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:33.156280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15f4f2-8c08-4a20-add0-77467d699dca admin admin] PATH_INFO: `/v3/projects/76719c1d23d64b998b51d544fc48a51c/users/dd44311b852c4852a13ecb529fe986f8/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:33.157899 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15f4f2-8c08-4a20-add0-77467d699dca admin admin] RBAC: Authorizing `identity:create_grant(project_id=76719c1d23d64b998b51d544fc48a51c, user_id=dd44311b852c4852a13ecb529fe986f8, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:33.161123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15f4f2-8c08-4a20-add0-77467d699dca admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:33.172065 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 962/1921] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:33 2022] PUT /identity/v3/projects/76719c1d23d64b998b51d544fc48a51c/users/dd44311b852c4852a13ecb529fe986f8/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:33.182820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fab8c9-9e7c-45b9-829b-1d8be8e1bb6a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:33.183109 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fab8c9-9e7c-45b9-829b-1d8be8e1bb6a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:33.183410 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fab8c9-9e7c-45b9-829b-1d8be8e1bb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:33.186465 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f178c-b3ee-477a-986c-e47de2d752ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:33.187197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f178c-b3ee-477a-986c-e47de2d752ce service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:33.187581 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f178c-b3ee-477a-986c-e47de2d752ce service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:33.187928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f178c-b3ee-477a-986c-e47de2d752ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:33.199644 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f178c-b3ee-477a-986c-e47de2d752ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:33.207837 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f178c-b3ee-477a-986c-e47de2d752ce service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:33.212080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-58fab8c9-9e7c-45b9-829b-1d8be8e1bb6a None None] MFA Rules not processed for user `dd44311b852c4852a13ecb529fe986f8`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:33.213289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-58fab8c9-9e7c-45b9-829b-1d8be8e1bb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:33.213413 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 960/1922] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:33.326877 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 963/1923] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:33 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:33.341631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f178c-b3ee-477a-986c-e47de2d752ce service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:33.343020 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-052f178c-b3ee-477a-986c-e47de2d752ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:33.417008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f178c-b3ee-477a-986c-e47de2d752ce service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:33.484449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68654b3-1c8e-409c-81bd-29e45f0072b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:33.485111 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68654b3-1c8e-409c-81bd-29e45f0072b7 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:33.485406 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68654b3-1c8e-409c-81bd-29e45f0072b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:33.485683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68654b3-1c8e-409c-81bd-29e45f0072b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:33.500889 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68654b3-1c8e-409c-81bd-29e45f0072b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:33.500889 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68654b3-1c8e-409c-81bd-29e45f0072b7 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:33.520735 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 961/1924] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:33.631624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fab8c9-9e7c-45b9-829b-1d8be8e1bb6a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:33.641809 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fab8c9-9e7c-45b9-829b-1d8be8e1bb6a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:33.645540 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e19606-0124-4fc4-90c0-173a97d7b72c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:33.646256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e19606-0124-4fc4-90c0-173a97d7b72c service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:33.646532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e19606-0124-4fc4-90c0-173a97d7b72c service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:33.646803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e19606-0124-4fc4-90c0-173a97d7b72c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:33.648932 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c0e19606-0124-4fc4-90c0-173a97d7b72c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:33.709200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68654b3-1c8e-409c-81bd-29e45f0072b7 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:33.709359 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e19606-0124-4fc4-90c0-173a97d7b72c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:33.710717 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b68654b3-1c8e-409c-81bd-29e45f0072b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:33.710846 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e19606-0124-4fc4-90c0-173a97d7b72c service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:33.723875 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 964/1925] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:33.803407 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68654b3-1c8e-409c-81bd-29e45f0072b7 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:33.808259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:33.809189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:33.809540 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:33.809882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] PATH_INFO: `/v3/projects/dc268319174b4f6f9a422511c658f9ab` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:33.811197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc268319174b4f6f9a422511c658f9ab)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:33.813197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:33.919893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc268319174b4f6f9a422511c658f9ab', 'request_id': 'req-146d3cd7-f830-49b8-8d49-d73601de895d'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:33.926841 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc268319174b4f6f9a422511c658f9ab', 'request_id': 'req-146d3cd7-f830-49b8-8d49-d73601de895d'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:33.932286 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc268319174b4f6f9a422511c658f9ab', 'request_id': 'req-146d3cd7-f830-49b8-8d49-d73601de895d'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:33.999968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] The token cache is being invalidate because project dc268319174b4f6f9a422511c658f9ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:34.000368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:34.001197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:34.002814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 962/1926] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:33 2022] DELETE /identity/v3/projects/dc268319174b4f6f9a422511c658f9ab => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:34.006748 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e19606-0124-4fc4-90c0-173a97d7b72c service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:34.017495 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e19606-0124-4fc4-90c0-173a97d7b72c service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:34.074073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc46267-ad0d-4116-b62f-a5cc029775ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:34.075079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc46267-ad0d-4116-b62f-a5cc029775ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:34.075393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc46267-ad0d-4116-b62f-a5cc029775ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:34.075666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc46267-ad0d-4116-b62f-a5cc029775ee admin admin] PATH_INFO: `/v3/users/e2ba549e522549879cdb661880957767` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:34.076928 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc46267-ad0d-4116-b62f-a5cc029775ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ba549e522549879cdb661880957767)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:34.079530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc46267-ad0d-4116-b62f-a5cc029775ee admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:34.256707 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6cc46267-ad0d-4116-b62f-a5cc029775ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ba549e522549879cdb661880957767'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:34.257360 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6cc46267-ad0d-4116-b62f-a5cc029775ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ba549e522549879cdb661880957767'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:34.257950 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6cc46267-ad0d-4116-b62f-a5cc029775ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ba549e522549879cdb661880957767'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:34.269704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6cc46267-ad0d-4116-b62f-a5cc029775ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ba549e522549879cdb661880957767'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:34.277187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6cc46267-ad0d-4116-b62f-a5cc029775ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ba549e522549879cdb661880957767'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:34.352099 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 965/1927] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:34 2022] DELETE /identity/v3/users/e2ba549e522549879cdb661880957767 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:34.800205 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:34.801914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:34.815248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146d3cd7-f830-49b8-8d49-d73601de895d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:34.879383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:34.880235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:34.880541 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:34.880783 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501 admin admin] PATH_INFO: `/v3/projects/cd55206913654ed9b83c0065edc0e2c1` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:34.881998 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd55206913654ed9b83c0065edc0e2c1)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:34.884055 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:34.992742 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd55206913654ed9b83c0065edc0e2c1', 'request_id': 'req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:34.998792 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd55206913654ed9b83c0065edc0e2c1', 'request_id': 'req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:35.004833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd55206913654ed9b83c0065edc0e2c1', 'request_id': 'req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:35.106567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501 admin admin] The token cache is being invalidate because project cd55206913654ed9b83c0065edc0e2c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:35.106855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:35.107519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6841c8a8-c3b1-45de-a2f3-1fa3a01b4501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:35.109451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 963/1928] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:34 2022] DELETE /identity/v3/projects/cd55206913654ed9b83c0065edc0e2c1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:35.114186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f63c7-a250-470a-9160-0f674511c689 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:35.114694 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f63c7-a250-470a-9160-0f674511c689 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:35.114796 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f63c7-a250-470a-9160-0f674511c689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:35.132784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-b92f63c7-a250-470a-9160-0f674511c689 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:35.134000 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b92f63c7-a250-470a-9160-0f674511c689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:35.203613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 966/1929] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:35.211876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7519826-8aa2-46ee-97ad-bee67666842b None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:35.212195 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7519826-8aa2-46ee-97ad-bee67666842b None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:35.212479 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7519826-8aa2-46ee-97ad-bee67666842b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:35.232260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-a7519826-8aa2-46ee-97ad-bee67666842b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:35.233520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a7519826-8aa2-46ee-97ad-bee67666842b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:35.242844 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 964/1930] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:35.247297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f63c7-a250-470a-9160-0f674511c689 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:35.257388 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f63c7-a250-470a-9160-0f674511c689 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:35.262171 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b584f2-8ee5-4409-ae82-4273b86c3f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:35.262815 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b584f2-8ee5-4409-ae82-4273b86c3f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:35.263095 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b584f2-8ee5-4409-ae82-4273b86c3f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:35.263397 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b584f2-8ee5-4409-ae82-4273b86c3f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:35.264124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b584f2-8ee5-4409-ae82-4273b86c3f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:35.264427 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b584f2-8ee5-4409-ae82-4273b86c3f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:35.266015 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b584f2-8ee5-4409-ae82-4273b86c3f31 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:35.285270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 967/1931] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:34:35.289880 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7519826-8aa2-46ee-97ad-bee67666842b None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:35.299072 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7519826-8aa2-46ee-97ad-bee67666842b None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:35.304699 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865c51a-cfaa-46de-870e-ff430de1fb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:35.305599 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865c51a-cfaa-46de-870e-ff430de1fb17 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:35.305878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865c51a-cfaa-46de-870e-ff430de1fb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:35.306156 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865c51a-cfaa-46de-870e-ff430de1fb17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:35.306878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865c51a-cfaa-46de-870e-ff430de1fb17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:35.308805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865c51a-cfaa-46de-870e-ff430de1fb17 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:35.403506 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 965/1932] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:35 2022] POST /identity/v3/projects => generated 361 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:35.404526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b584f2-8ee5-4409-ae82-4273b86c3f31 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:35.416368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b584f2-8ee5-4409-ae82-4273b86c3f31 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:35.471025 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45514941-d89b-4c56-b121-66905d5b7c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:35.471734 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45514941-d89b-4c56-b121-66905d5b7c00 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:35.472012 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45514941-d89b-4c56-b121-66905d5b7c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:35.472295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45514941-d89b-4c56-b121-66905d5b7c00 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:35.473480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45514941-d89b-4c56-b121-66905d5b7c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:35.475393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45514941-d89b-4c56-b121-66905d5b7c00 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:35.564123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 968/1933] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:35 2022] POST /identity/v3/users => generated 281 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:35.568463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865c51a-cfaa-46de-870e-ff430de1fb17 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:35.578614 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865c51a-cfaa-46de-870e-ff430de1fb17 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:35.583582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7044e-2c8d-49dc-823f-82684b26b7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:35.584255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7044e-2c8d-49dc-823f-82684b26b7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:35.584629 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7044e-2c8d-49dc-823f-82684b26b7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:35.584908 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7044e-2c8d-49dc-823f-82684b26b7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:35.585650 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7044e-2c8d-49dc-823f-82684b26b7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:35.587265 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7044e-2c8d-49dc-823f-82684b26b7e0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:35.597686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 966/1934] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:35.602333 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45514941-d89b-4c56-b121-66905d5b7c00 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:35.612230 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45514941-d89b-4c56-b121-66905d5b7c00 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:35.616944 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31448b80-cd13-4558-b2b0-0bb143463122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:35.617654 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31448b80-cd13-4558-b2b0-0bb143463122 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:35.617853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31448b80-cd13-4558-b2b0-0bb143463122 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:35.618124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31448b80-cd13-4558-b2b0-0bb143463122 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:35.618882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31448b80-cd13-4558-b2b0-0bb143463122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:35.620475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31448b80-cd13-4558-b2b0-0bb143463122 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:35.630764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 969/1935] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:35.636659 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7044e-2c8d-49dc-823f-82684b26b7e0 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:35.647361 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7044e-2c8d-49dc-823f-82684b26b7e0 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:35.652301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2e06f-4187-4d5f-bb5b-0f7f977e9154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:35.653176 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2e06f-4187-4d5f-bb5b-0f7f977e9154 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:35.653450 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2e06f-4187-4d5f-bb5b-0f7f977e9154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:35.653749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e2e06f-4187-4d5f-bb5b-0f7f977e9154 admin admin] PATH_INFO: `/v3/projects/3cb814b750e54a4587a5180d9f72548a/users/9507ee3332054f0990c054bfc1a1f909/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:35.668065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2e06f-4187-4d5f-bb5b-0f7f977e9154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb814b750e54a4587a5180d9f72548a, user_id=9507ee3332054f0990c054bfc1a1f909, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:35.670722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e2e06f-4187-4d5f-bb5b-0f7f977e9154 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:35.747878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 967/1936] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:35 2022] PUT /identity/v3/projects/3cb814b750e54a4587a5180d9f72548a/users/9507ee3332054f0990c054bfc1a1f909/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:35.760618 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34654cc-04fa-45f0-942b-013c4054a81d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:35.760618 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34654cc-04fa-45f0-942b-013c4054a81d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:35.760888 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34654cc-04fa-45f0-942b-013c4054a81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:35.796611 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-f34654cc-04fa-45f0-942b-013c4054a81d None None] MFA Rules not processed for user `9507ee3332054f0990c054bfc1a1f909`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:35.797929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f34654cc-04fa-45f0-942b-013c4054a81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:35.864008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 970/1937] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:35.897936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2e06f-4187-4d5f-bb5b-0f7f977e9154 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:35.900057 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c4e2e06f-4187-4d5f-bb5b-0f7f977e9154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:35.955433 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e2e06f-4187-4d5f-bb5b-0f7f977e9154 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:35.959350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d0677-86b1-4434-92a0-51d04ec44e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:35.959990 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d0677-86b1-4434-92a0-51d04ec44e27 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:35.960317 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d0677-86b1-4434-92a0-51d04ec44e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:35.960594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60d0677-86b1-4434-92a0-51d04ec44e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:35.969260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d0677-86b1-4434-92a0-51d04ec44e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:35.970674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60d0677-86b1-4434-92a0-51d04ec44e27 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:35.979612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 968/1938] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:35.994201 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34654cc-04fa-45f0-942b-013c4054a81d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:36.056207 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34654cc-04fa-45f0-942b-013c4054a81d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:36.060976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd1052-e765-40b5-86d8-a7e8fe6c26ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:36.061831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd1052-e765-40b5-86d8-a7e8fe6c26ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:36.062114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd1052-e765-40b5-86d8-a7e8fe6c26ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:36.062391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd1052-e765-40b5-86d8-a7e8fe6c26ce admin admin] PATH_INFO: `/v3/users/9507ee3332054f0990c054bfc1a1f909` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:36.063636 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd1052-e765-40b5-86d8-a7e8fe6c26ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=9507ee3332054f0990c054bfc1a1f909)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:36.065570 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd1052-e765-40b5-86d8-a7e8fe6c26ce admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:36.287983 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d0677-86b1-4434-92a0-51d04ec44e27 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:36.287983 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f60d0677-86b1-4434-92a0-51d04ec44e27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:36.294527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-aafd1052-e765-40b5-86d8-a7e8fe6c26ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9507ee3332054f0990c054bfc1a1f909'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:36.295797 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-aafd1052-e765-40b5-86d8-a7e8fe6c26ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9507ee3332054f0990c054bfc1a1f909'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:36.296863 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-aafd1052-e765-40b5-86d8-a7e8fe6c26ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9507ee3332054f0990c054bfc1a1f909'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:36.300516 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60d0677-86b1-4434-92a0-51d04ec44e27 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:36.306856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cb44f-f861-40b0-8d8b-962fbfe5cd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:36.307761 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cb44f-f861-40b0-8d8b-962fbfe5cd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:36.308266 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cb44f-f861-40b0-8d8b-962fbfe5cd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:36.308546 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cb44f-f861-40b0-8d8b-962fbfe5cd55 admin admin] PATH_INFO: `/v3/users/8ee4d2f7b35d418098f815db301fd1aa` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:36.309971 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cb44f-f861-40b0-8d8b-962fbfe5cd55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ee4d2f7b35d418098f815db301fd1aa)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:36.312795 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818cb44f-f861-40b0-8d8b-962fbfe5cd55 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:36.313844 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-aafd1052-e765-40b5-86d8-a7e8fe6c26ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9507ee3332054f0990c054bfc1a1f909'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:36.324111 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-aafd1052-e765-40b5-86d8-a7e8fe6c26ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9507ee3332054f0990c054bfc1a1f909'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:36.399034 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 971/1939] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:35 2022] DELETE /identity/v3/users/9507ee3332054f0990c054bfc1a1f909 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:36.405148 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade4bfe-33a9-46c7-9ddb-0004e9322f18 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:36.405433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade4bfe-33a9-46c7-9ddb-0004e9322f18 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:36.405708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade4bfe-33a9-46c7-9ddb-0004e9322f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:36.425422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-cade4bfe-33a9-46c7-9ddb-0004e9322f18 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:36.427341 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-cade4bfe-33a9-46c7-9ddb-0004e9322f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:36.484354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 972/1940] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:36.493909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade4bfe-33a9-46c7-9ddb-0004e9322f18 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:36.495549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-cade4bfe-33a9-46c7-9ddb-0004e9322f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:36.524478 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-818cb44f-f861-40b0-8d8b-962fbfe5cd55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ee4d2f7b35d418098f815db301fd1aa'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:36.525141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-818cb44f-f861-40b0-8d8b-962fbfe5cd55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ee4d2f7b35d418098f815db301fd1aa'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:36.525751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-818cb44f-f861-40b0-8d8b-962fbfe5cd55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ee4d2f7b35d418098f815db301fd1aa'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:36.539289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-818cb44f-f861-40b0-8d8b-962fbfe5cd55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ee4d2f7b35d418098f815db301fd1aa'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:36.546389 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-818cb44f-f861-40b0-8d8b-962fbfe5cd55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ee4d2f7b35d418098f815db301fd1aa'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:36.555042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade4bfe-33a9-46c7-9ddb-0004e9322f18 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:36.558792 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e0c81-ff38-4440-91cb-f1c1a5849986 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:36.559495 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e0c81-ff38-4440-91cb-f1c1a5849986 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:36.559987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e0c81-ff38-4440-91cb-f1c1a5849986 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:36.560221 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e0c81-ff38-4440-91cb-f1c1a5849986 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:36.562020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-349e0c81-ff38-4440-91cb-f1c1a5849986 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:36.574258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e0c81-ff38-4440-91cb-f1c1a5849986 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:36.575687 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e0c81-ff38-4440-91cb-f1c1a5849986 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:36.585746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 973/1941] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:34:36.592191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 969/1942] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:36 2022] DELETE /identity/v3/users/8ee4d2f7b35d418098f815db301fd1aa => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:36.600018 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2b957-ca57-4ef9-91fd-c8caf7c7cc81 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:36.600018 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2b957-ca57-4ef9-91fd-c8caf7c7cc81 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:36.600018 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2b957-ca57-4ef9-91fd-c8caf7c7cc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:36.616474 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-a8d2b957-ca57-4ef9-91fd-c8caf7c7cc81 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:36.617695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a8d2b957-ca57-4ef9-91fd-c8caf7c7cc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:36.680500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 974/1943] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:36.689819 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cb44f-f861-40b0-8d8b-962fbfe5cd55 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:36.691410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-818cb44f-f861-40b0-8d8b-962fbfe5cd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:36.749934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cb44f-f861-40b0-8d8b-962fbfe5cd55 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:36.753672 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be5f85-3246-4453-9521-ac4d89a93519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:36.754311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be5f85-3246-4453-9521-ac4d89a93519 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:36.754629 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be5f85-3246-4453-9521-ac4d89a93519 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:36.755020 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be5f85-3246-4453-9521-ac4d89a93519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:36.764606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be5f85-3246-4453-9521-ac4d89a93519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:36.766031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9be5f85-3246-4453-9521-ac4d89a93519 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:36.776556 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 970/1944] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:37.038920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2b957-ca57-4ef9-91fd-c8caf7c7cc81 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:37.040419 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a8d2b957-ca57-4ef9-91fd-c8caf7c7cc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:37.064486 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2b957-ca57-4ef9-91fd-c8caf7c7cc81 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:37.069653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17166dca-7542-4ff2-913b-2c57aa86e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:37.070576 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17166dca-7542-4ff2-913b-2c57aa86e430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:37.070920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17166dca-7542-4ff2-913b-2c57aa86e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:37.071295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17166dca-7542-4ff2-913b-2c57aa86e430 admin admin] PATH_INFO: `/v3/projects/3cb814b750e54a4587a5180d9f72548a` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:37.072574 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17166dca-7542-4ff2-913b-2c57aa86e430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb814b750e54a4587a5180d9f72548a)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:37.074557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17166dca-7542-4ff2-913b-2c57aa86e430 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:37.210668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-17166dca-7542-4ff2-913b-2c57aa86e430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb814b750e54a4587a5180d9f72548a', 'request_id': 'req-17166dca-7542-4ff2-913b-2c57aa86e430'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.211686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be5f85-3246-4453-9521-ac4d89a93519 service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:37.213777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f9be5f85-3246-4453-9521-ac4d89a93519 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:37.227382 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be5f85-3246-4453-9521-ac4d89a93519 service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:37.282777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:37.283681 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:37.283964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:37.284239 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] PATH_INFO: `/v3/projects/46bb093a4dfb464090145596c694475c` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:37.285501 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46bb093a4dfb464090145596c694475c)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:37.287442 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:37.306665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-17166dca-7542-4ff2-913b-2c57aa86e430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb814b750e54a4587a5180d9f72548a', 'request_id': 'req-17166dca-7542-4ff2-913b-2c57aa86e430'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.312758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-17166dca-7542-4ff2-913b-2c57aa86e430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb814b750e54a4587a5180d9f72548a', 'request_id': 'req-17166dca-7542-4ff2-913b-2c57aa86e430'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.324204 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-17166dca-7542-4ff2-913b-2c57aa86e430 admin admin] The token cache is being invalidate because project 3cb814b750e54a4587a5180d9f72548a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:37.326083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-17166dca-7542-4ff2-913b-2c57aa86e430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.326083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-17166dca-7542-4ff2-913b-2c57aa86e430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.326602 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 975/1945] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:37 2022] DELETE /identity/v3/projects/3cb814b750e54a4587a5180d9f72548a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:37.331368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7f2f7-3294-433d-b6e7-153888501ac5 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:37.331653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7f2f7-3294-433d-b6e7-153888501ac5 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:37.331933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7f2f7-3294-433d-b6e7-153888501ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:37.349524 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-0cf7f2f7-3294-433d-b6e7-153888501ac5 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:37.350698 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-0cf7f2f7-3294-433d-b6e7-153888501ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:37.358685 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 976/1946] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:37.366800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3313fe-224e-4b41-90cd-08d241459ac7 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:37.367086 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3313fe-224e-4b41-90cd-08d241459ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:37.367390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3313fe-224e-4b41-90cd-08d241459ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:37.370611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46bb093a4dfb464090145596c694475c', 'request_id': 'req-992f41bf-e313-47a3-9e90-fdc387d3f0f5'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.376987 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46bb093a4dfb464090145596c694475c', 'request_id': 'req-992f41bf-e313-47a3-9e90-fdc387d3f0f5'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.383572 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46bb093a4dfb464090145596c694475c', 'request_id': 'req-992f41bf-e313-47a3-9e90-fdc387d3f0f5'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.385414 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-2d3313fe-224e-4b41-90cd-08d241459ac7 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:37.386617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2d3313fe-224e-4b41-90cd-08d241459ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:37.446461 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 977/1947] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:37.450716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3313fe-224e-4b41-90cd-08d241459ac7 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:37.459770 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3313fe-224e-4b41-90cd-08d241459ac7 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:37.460343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] The token cache is being invalidate because project 46bb093a4dfb464090145596c694475c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:37.460721 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.461611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.466122 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 971/1948] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:37 2022] DELETE /identity/v3/projects/46bb093a4dfb464090145596c694475c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:37.467050 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:37.467388 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10666ee7-fba5-4bc2-96ee-bc622ea68da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:37.468016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10666ee7-fba5-4bc2-96ee-bc622ea68da2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:37.468305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10666ee7-fba5-4bc2-96ee-bc622ea68da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:37.468411 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:37.468706 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10666ee7-fba5-4bc2-96ee-bc622ea68da2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:37.469634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10666ee7-fba5-4bc2-96ee-bc622ea68da2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:37.469942 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10666ee7-fba5-4bc2-96ee-bc622ea68da2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:37.471925 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10666ee7-fba5-4bc2-96ee-bc622ea68da2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:37.480998 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f41bf-e313-47a3-9e90-fdc387d3f0f5 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:37.487920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 978/1949] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:34:37.489441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10666ee7-fba5-4bc2-96ee-bc622ea68da2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:37.490390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c797cf-0c78-4dfe-b1c1-c920ccddb43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:37.491297 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c797cf-0c78-4dfe-b1c1-c920ccddb43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:37.491582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c797cf-0c78-4dfe-b1c1-c920ccddb43e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:37.491851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c797cf-0c78-4dfe-b1c1-c920ccddb43e admin admin] PATH_INFO: `/v3/users/1c3fcf55840c4d7ca061fe2f39b714cd` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:37.492633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-10666ee7-fba5-4bc2-96ee-bc622ea68da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:37.493238 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c797cf-0c78-4dfe-b1c1-c920ccddb43e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3fcf55840c4d7ca061fe2f39b714cd)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:37.495483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c797cf-0c78-4dfe-b1c1-c920ccddb43e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:37.506363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10666ee7-fba5-4bc2-96ee-bc622ea68da2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:37.511336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13232137-1a7d-455b-8d0e-612ea3d3a09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:37.511998 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13232137-1a7d-455b-8d0e-612ea3d3a09e admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:37.512424 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13232137-1a7d-455b-8d0e-612ea3d3a09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:37.512713 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13232137-1a7d-455b-8d0e-612ea3d3a09e admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:37.513427 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13232137-1a7d-455b-8d0e-612ea3d3a09e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:37.515355 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13232137-1a7d-455b-8d0e-612ea3d3a09e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:37.628102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 979/1950] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:37 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:37.632201 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13232137-1a7d-455b-8d0e-612ea3d3a09e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:37.690232 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13232137-1a7d-455b-8d0e-612ea3d3a09e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:37.696736 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c061d-c1d9-4f1a-9c2e-b93eae887234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:37.697418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c061d-c1d9-4f1a-9c2e-b93eae887234 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:37.697694 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c061d-c1d9-4f1a-9c2e-b93eae887234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:37.698009 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16c061d-c1d9-4f1a-9c2e-b93eae887234 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:37.698718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c061d-c1d9-4f1a-9c2e-b93eae887234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:37.700701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16c061d-c1d9-4f1a-9c2e-b93eae887234 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:37.711014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-03c797cf-0c78-4dfe-b1c1-c920ccddb43e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3fcf55840c4d7ca061fe2f39b714cd'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.711788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-03c797cf-0c78-4dfe-b1c1-c920ccddb43e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3fcf55840c4d7ca061fe2f39b714cd'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.712496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-03c797cf-0c78-4dfe-b1c1-c920ccddb43e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3fcf55840c4d7ca061fe2f39b714cd'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.724640 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-03c797cf-0c78-4dfe-b1c1-c920ccddb43e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3fcf55840c4d7ca061fe2f39b714cd'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.731214 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-03c797cf-0c78-4dfe-b1c1-c920ccddb43e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3fcf55840c4d7ca061fe2f39b714cd'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:37.787519 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 980/1951] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:37 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:37.791659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c061d-c1d9-4f1a-9c2e-b93eae887234 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:37.793243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e16c061d-c1d9-4f1a-9c2e-b93eae887234 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:37.805910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16c061d-c1d9-4f1a-9c2e-b93eae887234 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:37.810501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9ab9d-7a42-427e-9af0-900e404025de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:37.811146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9ab9d-7a42-427e-9af0-900e404025de admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:37.811457 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9ab9d-7a42-427e-9af0-900e404025de admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:37.812998 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e9ab9d-7a42-427e-9af0-900e404025de admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:37.812998 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9ab9d-7a42-427e-9af0-900e404025de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:37.814080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e9ab9d-7a42-427e-9af0-900e404025de admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:37.815477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 972/1952] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:37 2022] DELETE /identity/v3/users/1c3fcf55840c4d7ca061fe2f39b714cd => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:37.824360 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 981/1953] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:37.828522 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c797cf-0c78-4dfe-b1c1-c920ccddb43e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:37.892665 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c797cf-0c78-4dfe-b1c1-c920ccddb43e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:37.897635 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e69386e-b3fe-4db7-b39c-eeb0bc738501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:37.898326 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69386e-b3fe-4db7-b39c-eeb0bc738501 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:37.898861 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69386e-b3fe-4db7-b39c-eeb0bc738501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:37.899279 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69386e-b3fe-4db7-b39c-eeb0bc738501 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:37.900008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69386e-b3fe-4db7-b39c-eeb0bc738501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:37.901703 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e69386e-b3fe-4db7-b39c-eeb0bc738501 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:37.912834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 973/1954] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:37.917047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9ab9d-7a42-427e-9af0-900e404025de admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:37.927858 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e9ab9d-7a42-427e-9af0-900e404025de admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:37.932504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86c898-c18d-4605-a3cb-670e274901ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:37.933434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86c898-c18d-4605-a3cb-670e274901ba admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:37.933717 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86c898-c18d-4605-a3cb-670e274901ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:37.933990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff86c898-c18d-4605-a3cb-670e274901ba admin admin] PATH_INFO: `/v3/projects/1ee060427df94583b4a3f11c7ea6e6cf/users/b07e8756499046928304eb0c07da8eab/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:37.949084 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86c898-c18d-4605-a3cb-670e274901ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee060427df94583b4a3f11c7ea6e6cf, user_id=b07e8756499046928304eb0c07da8eab, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:37.951802 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff86c898-c18d-4605-a3cb-670e274901ba admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:38.042627 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 982/1955] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:37 2022] PUT /identity/v3/projects/1ee060427df94583b4a3f11c7ea6e6cf/users/b07e8756499046928304eb0c07da8eab/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:38.052473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce156688-9a57-4b97-8688-0d6bf2b1a21d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:38.053525 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce156688-9a57-4b97-8688-0d6bf2b1a21d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:38.053675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce156688-9a57-4b97-8688-0d6bf2b1a21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:38.083380 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-ce156688-9a57-4b97-8688-0d6bf2b1a21d None None] MFA Rules not processed for user `b07e8756499046928304eb0c07da8eab`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:38.084763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ce156688-9a57-4b97-8688-0d6bf2b1a21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:38.147563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 974/1956] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:38.152258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86c898-c18d-4605-a3cb-670e274901ba admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:38.212780 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff86c898-c18d-4605-a3cb-670e274901ba admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:38.217385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412dac9-cd8a-4e44-9db6-e96afb8f7243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:38.218027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412dac9-cd8a-4e44-9db6-e96afb8f7243 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:38.218308 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412dac9-cd8a-4e44-9db6-e96afb8f7243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:38.218581 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412dac9-cd8a-4e44-9db6-e96afb8f7243 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:38.219364 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412dac9-cd8a-4e44-9db6-e96afb8f7243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:38.221343 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412dac9-cd8a-4e44-9db6-e96afb8f7243 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:38.250901 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce156688-9a57-4b97-8688-0d6bf2b1a21d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:38.252344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ce156688-9a57-4b97-8688-0d6bf2b1a21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:38.268149 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce156688-9a57-4b97-8688-0d6bf2b1a21d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:38.280429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:38.280429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:38.280429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:38.280429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] PATH_INFO: `/v3/projects/41303678602e430e9ecf06fe4626b7f2` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:38.281018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41303678602e430e9ecf06fe4626b7f2)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:38.281018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:38.307296 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 983/1957] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:38 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:38.311274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412dac9-cd8a-4e44-9db6-e96afb8f7243 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:38.372139 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412dac9-cd8a-4e44-9db6-e96afb8f7243 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:38.376753 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895bc7b-eadf-4377-b3cc-8e31507fd35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:38.377405 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895bc7b-eadf-4377-b3cc-8e31507fd35f admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:38.377686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895bc7b-eadf-4377-b3cc-8e31507fd35f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:38.377960 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895bc7b-eadf-4377-b3cc-8e31507fd35f admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:38.378657 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895bc7b-eadf-4377-b3cc-8e31507fd35f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:38.381084 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895bc7b-eadf-4377-b3cc-8e31507fd35f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:38.398752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41303678602e430e9ecf06fe4626b7f2', 'request_id': 'req-57afcaf8-5e7f-4046-942e-b584a2405b20'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:38.404885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41303678602e430e9ecf06fe4626b7f2', 'request_id': 'req-57afcaf8-5e7f-4046-942e-b584a2405b20'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:38.410587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41303678602e430e9ecf06fe4626b7f2', 'request_id': 'req-57afcaf8-5e7f-4046-942e-b584a2405b20'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:38.489554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 984/1958] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:38 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:38.493355 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895bc7b-eadf-4377-b3cc-8e31507fd35f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:38.500678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] The token cache is being invalidate because project 41303678602e430e9ecf06fe4626b7f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:38.500972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:38.501681 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:38.502665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895bc7b-eadf-4377-b3cc-8e31507fd35f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:38.503430 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 975/1959] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:38 2022] DELETE /identity/v3/projects/41303678602e430e9ecf06fe4626b7f2 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:38.507678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:38.508977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:38.561159 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a816b6-d760-4d3b-84cf-367ad5d5345a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:38.561885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a816b6-d760-4d3b-84cf-367ad5d5345a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:38.562103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a816b6-d760-4d3b-84cf-367ad5d5345a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:38.562377 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a816b6-d760-4d3b-84cf-367ad5d5345a admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:38.563149 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a816b6-d760-4d3b-84cf-367ad5d5345a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:38.564773 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a816b6-d760-4d3b-84cf-367ad5d5345a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:38.573220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57afcaf8-5e7f-4046-942e-b584a2405b20 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:38.575534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 985/1960] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:38.578447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1f7bc-50fe-4807-a6db-57ab9ef24455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:38.579413 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a816b6-d760-4d3b-84cf-367ad5d5345a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:38.579549 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1f7bc-50fe-4807-a6db-57ab9ef24455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:38.579755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1f7bc-50fe-4807-a6db-57ab9ef24455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:38.580032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1f7bc-50fe-4807-a6db-57ab9ef24455 admin admin] PATH_INFO: `/v3/users/a0502fec581e42aca5ac2e801fb43810` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:38.581160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-56a816b6-d760-4d3b-84cf-367ad5d5345a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:38.581334 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1f7bc-50fe-4807-a6db-57ab9ef24455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0502fec581e42aca5ac2e801fb43810)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:38.583912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1f7bc-50fe-4807-a6db-57ab9ef24455 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:38.594925 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a816b6-d760-4d3b-84cf-367ad5d5345a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:38.600887 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a138a7b-8ffa-4a70-b162-6862b77757b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:38.601922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a138a7b-8ffa-4a70-b162-6862b77757b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:38.602214 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a138a7b-8ffa-4a70-b162-6862b77757b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:38.602503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a138a7b-8ffa-4a70-b162-6862b77757b8 admin admin] PATH_INFO: `/v3/projects/4b702369398444a29a8a9130c7afd68c/users/3bbc97ea7a74449c82b12f9fa6b3db1c/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:38.619687 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a138a7b-8ffa-4a70-b162-6862b77757b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b702369398444a29a8a9130c7afd68c, user_id=3bbc97ea7a74449c82b12f9fa6b3db1c, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:38.622433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a138a7b-8ffa-4a70-b162-6862b77757b8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:38.769787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 986/1961] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:38 2022] PUT /identity/v3/projects/4b702369398444a29a8a9130c7afd68c/users/3bbc97ea7a74449c82b12f9fa6b3db1c/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:38.773819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a138a7b-8ffa-4a70-b162-6862b77757b8 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:38.833303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a138a7b-8ffa-4a70-b162-6862b77757b8 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:38.837268 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a4b1f7bc-50fe-4807-a6db-57ab9ef24455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0502fec581e42aca5ac2e801fb43810'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:38.838132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a4b1f7bc-50fe-4807-a6db-57ab9ef24455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0502fec581e42aca5ac2e801fb43810'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:38.838252 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff06457-6d9d-4820-8fab-bdd93ab8cad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:38.838887 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06457-6d9d-4820-8fab-bdd93ab8cad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:38.839003 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a4b1f7bc-50fe-4807-a6db-57ab9ef24455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0502fec581e42aca5ac2e801fb43810'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:38.839155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06457-6d9d-4820-8fab-bdd93ab8cad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:38.839469 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff06457-6d9d-4820-8fab-bdd93ab8cad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:38.840266 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff06457-6d9d-4820-8fab-bdd93ab8cad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:38.841856 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff06457-6d9d-4820-8fab-bdd93ab8cad5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:38.852515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a4b1f7bc-50fe-4807-a6db-57ab9ef24455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0502fec581e42aca5ac2e801fb43810'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:38.855383 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 987/1962] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:38.859100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff06457-6d9d-4820-8fab-bdd93ab8cad5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:38.859100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3ff06457-6d9d-4820-8fab-bdd93ab8cad5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:38.860147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a4b1f7bc-50fe-4807-a6db-57ab9ef24455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0502fec581e42aca5ac2e801fb43810'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:38.871659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff06457-6d9d-4820-8fab-bdd93ab8cad5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:38.878653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81948b-a896-4470-8341-adbd98c85df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:38.880275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81948b-a896-4470-8341-adbd98c85df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:38.880653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81948b-a896-4470-8341-adbd98c85df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:38.880929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81948b-a896-4470-8341-adbd98c85df6 admin admin] PATH_INFO: `/v3/projects/4b702369398444a29a8a9130c7afd68c/users/3bbc97ea7a74449c82b12f9fa6b3db1c/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:38.883077 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81948b-a896-4470-8341-adbd98c85df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b702369398444a29a8a9130c7afd68c, user_id=3bbc97ea7a74449c82b12f9fa6b3db1c, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:38.885767 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81948b-a896-4470-8341-adbd98c85df6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:38.897129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 988/1963] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:38 2022] PUT /identity/v3/projects/4b702369398444a29a8a9130c7afd68c/users/3bbc97ea7a74449c82b12f9fa6b3db1c/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:38.909191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3dbd7-6b0e-463d-9cd8-5830a328be37 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:38.909477 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3dbd7-6b0e-463d-9cd8-5830a328be37 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:38.909748 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3dbd7-6b0e-463d-9cd8-5830a328be37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:38.937563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-66f3dbd7-6b0e-463d-9cd8-5830a328be37 None None] MFA Rules not processed for user `3bbc97ea7a74449c82b12f9fa6b3db1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:38.938753 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-66f3dbd7-6b0e-463d-9cd8-5830a328be37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:38.959749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 976/1964] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:38 2022] DELETE /identity/v3/users/a0502fec581e42aca5ac2e801fb43810 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:39.033023 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 989/1965] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:39.042948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1f7bc-50fe-4807-a6db-57ab9ef24455 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:39.044369 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a4b1f7bc-50fe-4807-a6db-57ab9ef24455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:39.103528 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1f7bc-50fe-4807-a6db-57ab9ef24455 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:39.107543 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c7248-d44d-4f3e-807d-ab0e8290500f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:39.108193 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c7248-d44d-4f3e-807d-ab0e8290500f service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:39.108486 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c7248-d44d-4f3e-807d-ab0e8290500f service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:39.108743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c7248-d44d-4f3e-807d-ab0e8290500f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:39.110854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e61c7248-d44d-4f3e-807d-ab0e8290500f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:39.177336 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c7248-d44d-4f3e-807d-ab0e8290500f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:39.178972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c7248-d44d-4f3e-807d-ab0e8290500f service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:39.188479 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 977/1966] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:39.342359 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3dbd7-6b0e-463d-9cd8-5830a328be37 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:39.344274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-66f3dbd7-6b0e-463d-9cd8-5830a328be37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:39.416557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3dbd7-6b0e-463d-9cd8-5830a328be37 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:39.472656 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7038401-21b9-4b90-86c0-596e025829a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:39.474170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7038401-21b9-4b90-86c0-596e025829a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:39.474451 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7038401-21b9-4b90-86c0-596e025829a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:39.474725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7038401-21b9-4b90-86c0-596e025829a9 admin admin] PATH_INFO: `/v3/projects/468046f8a5e449efabb72d3b3ebf1303` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:39.476024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7038401-21b9-4b90-86c0-596e025829a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=468046f8a5e449efabb72d3b3ebf1303)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:39.477969 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7038401-21b9-4b90-86c0-596e025829a9 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:39.580520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f7038401-21b9-4b90-86c0-596e025829a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '468046f8a5e449efabb72d3b3ebf1303', 'request_id': 'req-f7038401-21b9-4b90-86c0-596e025829a9'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:39.672276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f7038401-21b9-4b90-86c0-596e025829a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '468046f8a5e449efabb72d3b3ebf1303', 'request_id': 'req-f7038401-21b9-4b90-86c0-596e025829a9'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:39.679416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f7038401-21b9-4b90-86c0-596e025829a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '468046f8a5e449efabb72d3b3ebf1303', 'request_id': 'req-f7038401-21b9-4b90-86c0-596e025829a9'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:39.690588 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f7038401-21b9-4b90-86c0-596e025829a9 admin admin] The token cache is being invalidate because project 468046f8a5e449efabb72d3b3ebf1303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:39.690874 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f7038401-21b9-4b90-86c0-596e025829a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:39.691539 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f7038401-21b9-4b90-86c0-596e025829a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:39.693188 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 990/1967] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:39 2022] DELETE /identity/v3/projects/468046f8a5e449efabb72d3b3ebf1303 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:39.698067 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba89b4-d256-44e3-a96c-9af801b37eb9 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:39.698511 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba89b4-d256-44e3-a96c-9af801b37eb9 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:39.698598 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba89b4-d256-44e3-a96c-9af801b37eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:39.716053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-b7ba89b4-d256-44e3-a96c-9af801b37eb9 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:39.717223 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b7ba89b4-d256-44e3-a96c-9af801b37eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:39.777204 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 978/1968] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:39.794749 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d41cf8-e94f-46e8-95b0-43ea79b21fff None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:39.794749 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d41cf8-e94f-46e8-95b0-43ea79b21fff None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:39.794749 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d41cf8-e94f-46e8-95b0-43ea79b21fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:39.804677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-32d41cf8-e94f-46e8-95b0-43ea79b21fff None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:39.805864 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-32d41cf8-e94f-46e8-95b0-43ea79b21fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:39.814489 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 991/1969] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:39.819093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba89b4-d256-44e3-a96c-9af801b37eb9 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:39.829654 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba89b4-d256-44e3-a96c-9af801b37eb9 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:39.835417 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9452ee-3ccf-4fe9-bbdb-3f9907ed1adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:39.836078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9452ee-3ccf-4fe9-bbdb-3f9907ed1adb admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:39.837878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9452ee-3ccf-4fe9-bbdb-3f9907ed1adb admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:39.837878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9452ee-3ccf-4fe9-bbdb-3f9907ed1adb admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:39.837878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9452ee-3ccf-4fe9-bbdb-3f9907ed1adb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:39.837878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9452ee-3ccf-4fe9-bbdb-3f9907ed1adb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:39.840060 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9452ee-3ccf-4fe9-bbdb-3f9907ed1adb admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:39.852548 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 979/1970] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:34:39.856861 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d41cf8-e94f-46e8-95b0-43ea79b21fff None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:39.866616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d41cf8-e94f-46e8-95b0-43ea79b21fff None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:39.871592 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2cbeb-9074-4010-83a9-20985298a396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:39.874701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2cbeb-9074-4010-83a9-20985298a396 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:39.874701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2cbeb-9074-4010-83a9-20985298a396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:39.874701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2cbeb-9074-4010-83a9-20985298a396 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:39.874701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2cbeb-9074-4010-83a9-20985298a396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:39.875584 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2cbeb-9074-4010-83a9-20985298a396 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:39.991284 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 992/1971] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:39 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:39.995214 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9452ee-3ccf-4fe9-bbdb-3f9907ed1adb admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:40.005655 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9452ee-3ccf-4fe9-bbdb-3f9907ed1adb admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:40.095885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb8407-e4f9-40a5-b2d3-8362c6744cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:40.096567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb8407-e4f9-40a5-b2d3-8362c6744cca admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:40.096854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb8407-e4f9-40a5-b2d3-8362c6744cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:40.097142 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb8407-e4f9-40a5-b2d3-8362c6744cca admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:40.098507 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb8407-e4f9-40a5-b2d3-8362c6744cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:40.101091 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eb8407-e4f9-40a5-b2d3-8362c6744cca admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:40.185232 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 980/1972] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:39 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:40.186437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2cbeb-9074-4010-83a9-20985298a396 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:40.197501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2cbeb-9074-4010-83a9-20985298a396 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:40.202331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01957e98-69fe-4711-b0cb-9b6ae693bfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:40.203043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01957e98-69fe-4711-b0cb-9b6ae693bfbc admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:40.203363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01957e98-69fe-4711-b0cb-9b6ae693bfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:40.203647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01957e98-69fe-4711-b0cb-9b6ae693bfbc admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:40.204667 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01957e98-69fe-4711-b0cb-9b6ae693bfbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:40.206155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01957e98-69fe-4711-b0cb-9b6ae693bfbc admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:40.217791 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 993/1973] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:40.221624 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb8407-e4f9-40a5-b2d3-8362c6744cca admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:40.232101 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb8407-e4f9-40a5-b2d3-8362c6744cca admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:40.237144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c04dcd-2e3b-469d-ad94-47c0bf47a7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:40.237812 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c04dcd-2e3b-469d-ad94-47c0bf47a7fb admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:40.238093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c04dcd-2e3b-469d-ad94-47c0bf47a7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:40.238464 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c04dcd-2e3b-469d-ad94-47c0bf47a7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:40.239200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c04dcd-2e3b-469d-ad94-47c0bf47a7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:40.240844 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c04dcd-2e3b-469d-ad94-47c0bf47a7fb admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:40.250822 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 981/1974] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:40.255036 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01957e98-69fe-4711-b0cb-9b6ae693bfbc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:40.265029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01957e98-69fe-4711-b0cb-9b6ae693bfbc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:40.270430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2235b-a712-49db-9504-931ec38e3254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:40.271563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2235b-a712-49db-9504-931ec38e3254 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:40.271843 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2235b-a712-49db-9504-931ec38e3254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:40.272121 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2235b-a712-49db-9504-931ec38e3254 admin admin] PATH_INFO: `/v3/projects/2bf65f62690f4c2ea3daf79e1021e475/users/9d263d17f5844d95a75a9b0ba4fb2455/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:40.291590 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2235b-a712-49db-9504-931ec38e3254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bf65f62690f4c2ea3daf79e1021e475, user_id=9d263d17f5844d95a75a9b0ba4fb2455, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:40.294692 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2235b-a712-49db-9504-931ec38e3254 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:40.376812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 994/1975] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:40 2022] PUT /identity/v3/projects/2bf65f62690f4c2ea3daf79e1021e475/users/9d263d17f5844d95a75a9b0ba4fb2455/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:40.385167 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afae54-7649-477e-bbde-7eb84180cda0 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:40.385455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afae54-7649-477e-bbde-7eb84180cda0 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:40.385739 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afae54-7649-477e-bbde-7eb84180cda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:40.408743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-23afae54-7649-477e-bbde-7eb84180cda0 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:40.412572 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-23afae54-7649-477e-bbde-7eb84180cda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:40.477771 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 982/1976] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:40.500133 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2235b-a712-49db-9504-931ec38e3254 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:40.502019 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3ad2235b-a712-49db-9504-931ec38e3254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:40.562128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2235b-a712-49db-9504-931ec38e3254 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:40.565979 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc37727-4884-4442-94d7-31062474f24a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:40.567276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc37727-4884-4442-94d7-31062474f24a service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:40.567563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc37727-4884-4442-94d7-31062474f24a service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:40.568042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc37727-4884-4442-94d7-31062474f24a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:40.577920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc37727-4884-4442-94d7-31062474f24a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:40.579577 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc37727-4884-4442-94d7-31062474f24a service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:40.590463 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 995/1977] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:40.729172 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afae54-7649-477e-bbde-7eb84180cda0 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:40.730702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-23afae54-7649-477e-bbde-7eb84180cda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:40.743207 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afae54-7649-477e-bbde-7eb84180cda0 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:40.747859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d1242-a01b-4dd9-a4f8-e52c06754a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:40.748754 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d1242-a01b-4dd9-a4f8-e52c06754a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:40.749030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d1242-a01b-4dd9-a4f8-e52c06754a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:40.749302 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d1242-a01b-4dd9-a4f8-e52c06754a2d admin admin] PATH_INFO: `/v3/users/a3f955b7078f4b328a7d2d02517cce88` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:40.750504 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d1242-a01b-4dd9-a4f8-e52c06754a2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3f955b7078f4b328a7d2d02517cce88)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:40.752779 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d1242-a01b-4dd9-a4f8-e52c06754a2d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:40.974588 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-017d1242-a01b-4dd9-a4f8-e52c06754a2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3f955b7078f4b328a7d2d02517cce88'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:40.975782 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-017d1242-a01b-4dd9-a4f8-e52c06754a2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3f955b7078f4b328a7d2d02517cce88'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:40.976396 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-017d1242-a01b-4dd9-a4f8-e52c06754a2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3f955b7078f4b328a7d2d02517cce88'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:40.989675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-017d1242-a01b-4dd9-a4f8-e52c06754a2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3f955b7078f4b328a7d2d02517cce88'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:40.997599 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-017d1242-a01b-4dd9-a4f8-e52c06754a2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3f955b7078f4b328a7d2d02517cce88'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:41.086104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 983/1978] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:40 2022] DELETE /identity/v3/users/a3f955b7078f4b328a7d2d02517cce88 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:41.090464 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690c683-f473-4ccb-804c-6cd77e90582b None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:41.090755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690c683-f473-4ccb-804c-6cd77e90582b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:41.091071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5690c683-f473-4ccb-804c-6cd77e90582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:41.109142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-5690c683-f473-4ccb-804c-6cd77e90582b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:41.110452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5690c683-f473-4ccb-804c-6cd77e90582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:41.187808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 996/1979] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:41.195827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d1242-a01b-4dd9-a4f8-e52c06754a2d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:41.197457 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-017d1242-a01b-4dd9-a4f8-e52c06754a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:41.327127 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d1242-a01b-4dd9-a4f8-e52c06754a2d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:41.331638 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33b4e1-a597-4540-bbb0-2575bef8a21b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:41.332406 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33b4e1-a597-4540-bbb0-2575bef8a21b service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:41.332684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33b4e1-a597-4540-bbb0-2575bef8a21b service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:41.333025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33b4e1-a597-4540-bbb0-2575bef8a21b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:41.343603 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33b4e1-a597-4540-bbb0-2575bef8a21b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:41.345081 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33b4e1-a597-4540-bbb0-2575bef8a21b service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:41.356952 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 984/1980] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:41.892095 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690c683-f473-4ccb-804c-6cd77e90582b None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:41.895636 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5690c683-f473-4ccb-804c-6cd77e90582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:41.911092 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5690c683-f473-4ccb-804c-6cd77e90582b None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:41.919889 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:41.920769 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:41.921049 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:41.922615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] PATH_INFO: `/v3/projects/7529886c7b6f481b94bfccd9a191e20a` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:41.925429 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7529886c7b6f481b94bfccd9a191e20a)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:41.927722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:42.039703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7529886c7b6f481b94bfccd9a191e20a', 'request_id': 'req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.175669 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7529886c7b6f481b94bfccd9a191e20a', 'request_id': 'req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.182714 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7529886c7b6f481b94bfccd9a191e20a', 'request_id': 'req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.193546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] The token cache is being invalidate because project 7529886c7b6f481b94bfccd9a191e20a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:42.193878 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.194476 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.196047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 997/1981] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:41 2022] DELETE /identity/v3/projects/7529886c7b6f481b94bfccd9a191e20a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:42.200061 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33b4e1-a597-4540-bbb0-2575bef8a21b service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:42.209961 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33b4e1-a597-4540-bbb0-2575bef8a21b service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:42.269512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec2ec72-cff5-40d2-99a1-fc924df7a007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:42.271849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2ec72-cff5-40d2-99a1-fc924df7a007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:42.271849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2ec72-cff5-40d2-99a1-fc924df7a007 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:42.271849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec2ec72-cff5-40d2-99a1-fc924df7a007 admin admin] PATH_INFO: `/v3/users/dd44311b852c4852a13ecb529fe986f8` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:42.271849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2ec72-cff5-40d2-99a1-fc924df7a007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd44311b852c4852a13ecb529fe986f8)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:42.274057 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec2ec72-cff5-40d2-99a1-fc924df7a007 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:42.286805 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:42.288294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:42.303094 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5d5e5-b462-476b-90fb-e5f1ec12e04b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:42.308126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477cfc5f-b490-4024-b680-b43b86ad459b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:42.308993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cfc5f-b490-4024-b680-b43b86ad459b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:42.309280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cfc5f-b490-4024-b680-b43b86ad459b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:42.309559 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477cfc5f-b490-4024-b680-b43b86ad459b admin admin] PATH_INFO: `/v3/users/b07e8756499046928304eb0c07da8eab` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:42.310784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cfc5f-b490-4024-b680-b43b86ad459b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07e8756499046928304eb0c07da8eab)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:42.312793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477cfc5f-b490-4024-b680-b43b86ad459b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:42.447133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-7ec2ec72-cff5-40d2-99a1-fc924df7a007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd44311b852c4852a13ecb529fe986f8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.448031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-7ec2ec72-cff5-40d2-99a1-fc924df7a007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd44311b852c4852a13ecb529fe986f8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.448887 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-7ec2ec72-cff5-40d2-99a1-fc924df7a007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd44311b852c4852a13ecb529fe986f8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.464945 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-7ec2ec72-cff5-40d2-99a1-fc924df7a007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd44311b852c4852a13ecb529fe986f8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.472617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-7ec2ec72-cff5-40d2-99a1-fc924df7a007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd44311b852c4852a13ecb529fe986f8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.498624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-477cfc5f-b490-4024-b680-b43b86ad459b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07e8756499046928304eb0c07da8eab'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.499586 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-477cfc5f-b490-4024-b680-b43b86ad459b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07e8756499046928304eb0c07da8eab'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.500227 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-477cfc5f-b490-4024-b680-b43b86ad459b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07e8756499046928304eb0c07da8eab'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.514605 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-477cfc5f-b490-4024-b680-b43b86ad459b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07e8756499046928304eb0c07da8eab'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.524746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-477cfc5f-b490-4024-b680-b43b86ad459b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07e8756499046928304eb0c07da8eab'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:42.542064 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 985/1982] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:42 2022] DELETE /identity/v3/users/dd44311b852c4852a13ecb529fe986f8 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:42.543416 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf226a72-1cdd-43d6-af81-a5f6d4e1c95e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:42.543707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf226a72-1cdd-43d6-af81-a5f6d4e1c95e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:42.543983 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf226a72-1cdd-43d6-af81-a5f6d4e1c95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:42.574364 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-cf226a72-1cdd-43d6-af81-a5f6d4e1c95e None None] MFA Rules not processed for user `9d263d17f5844d95a75a9b0ba4fb2455`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:42.575721 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-cf226a72-1cdd-43d6-af81-a5f6d4e1c95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:42.634654 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 998/1983] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:42 2022] DELETE /identity/v3/users/b07e8756499046928304eb0c07da8eab => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:42.646426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7abbf9-9e25-4254-893f-8bb62692cdbb None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:42.647047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7abbf9-9e25-4254-893f-8bb62692cdbb None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:42.647047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7abbf9-9e25-4254-893f-8bb62692cdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:42.650925 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 986/1984] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:42.661362 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf226a72-1cdd-43d6-af81-a5f6d4e1c95e None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:42.662759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-cf226a72-1cdd-43d6-af81-a5f6d4e1c95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:42.665803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1f7abbf9-9e25-4254-893f-8bb62692cdbb None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:42.666982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1f7abbf9-9e25-4254-893f-8bb62692cdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:42.719379 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf226a72-1cdd-43d6-af81-a5f6d4e1c95e None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:42.727199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 999/1985] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:42.736908 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7abbf9-9e25-4254-893f-8bb62692cdbb None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:42.739386 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1f7abbf9-9e25-4254-893f-8bb62692cdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:42.778099 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb486763-69d0-4db5-bcbd-db93096a30d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:42.778099 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb486763-69d0-4db5-bcbd-db93096a30d9 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:42.778099 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb486763-69d0-4db5-bcbd-db93096a30d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:42.778099 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb486763-69d0-4db5-bcbd-db93096a30d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:42.802974 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7abbf9-9e25-4254-893f-8bb62692cdbb None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:42.807088 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcec49-c6dc-48e2-b953-1778c734196b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:42.807787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcec49-c6dc-48e2-b953-1778c734196b service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:42.808066 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcec49-c6dc-48e2-b953-1778c734196b service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:42.808577 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcec49-c6dc-48e2-b953-1778c734196b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:42.818786 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcec49-c6dc-48e2-b953-1778c734196b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:42.820272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bcec49-c6dc-48e2-b953-1778c734196b service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:42.832320 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1000/1986] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:42.852464 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb486763-69d0-4db5-bcbd-db93096a30d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:42.854407 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb486763-69d0-4db5-bcbd-db93096a30d9 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:42.864995 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 987/1987] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:34:43.041005 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcec49-c6dc-48e2-b953-1778c734196b service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:43.042735 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b7bcec49-c6dc-48e2-b953-1778c734196b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:43.057609 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcec49-c6dc-48e2-b953-1778c734196b service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:43.062885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:43.065141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:43.065141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:43.065141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4 admin admin] PATH_INFO: `/v3/projects/76719c1d23d64b998b51d544fc48a51c` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:43.066135 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76719c1d23d64b998b51d544fc48a51c)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:43.068502 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:43.191840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76719c1d23d64b998b51d544fc48a51c', 'request_id': 'req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:43.257227 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76719c1d23d64b998b51d544fc48a51c', 'request_id': 'req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:43.264555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76719c1d23d64b998b51d544fc48a51c', 'request_id': 'req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:43.278810 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4 admin admin] The token cache is being invalidate because project 76719c1d23d64b998b51d544fc48a51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:43.278810 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:43.279516 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-19e4f8cb-fc6e-4cb9-bae5-0e97004cceb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:43.282618 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1001/1988] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:43 2022] DELETE /identity/v3/projects/76719c1d23d64b998b51d544fc48a51c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:43.288597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3c04-6680-4cff-b8f1-7eba4aa0a9ef None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:43.289145 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3c04-6680-4cff-b8f1-7eba4aa0a9ef None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:43.289145 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0d3c04-6680-4cff-b8f1-7eba4aa0a9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:43.313128 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-ce0d3c04-6680-4cff-b8f1-7eba4aa0a9ef None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:43.314529 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ce0d3c04-6680-4cff-b8f1-7eba4aa0a9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:43.398142 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 988/1989] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:43.408893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22509496-f35d-49fa-91f4-bb392a5b82b5 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:43.408893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22509496-f35d-49fa-91f4-bb392a5b82b5 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:43.408893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22509496-f35d-49fa-91f4-bb392a5b82b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:43.431308 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-22509496-f35d-49fa-91f4-bb392a5b82b5 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:43.431308 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-22509496-f35d-49fa-91f4-bb392a5b82b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:43.434009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3c04-6680-4cff-b8f1-7eba4aa0a9ef None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:43.435378 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ce0d3c04-6680-4cff-b8f1-7eba4aa0a9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:43.437478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1002/1990] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:43.441502 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22509496-f35d-49fa-91f4-bb392a5b82b5 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:43.452768 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22509496-f35d-49fa-91f4-bb392a5b82b5 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:43.457498 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0d3c04-6680-4cff-b8f1-7eba4aa0a9ef None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:43.458500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e578f6-53b6-4823-b53b-593c2c520e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:43.459078 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e578f6-53b6-4823-b53b-593c2c520e28 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:43.459497 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e578f6-53b6-4823-b53b-593c2c520e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:43.459672 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e578f6-53b6-4823-b53b-593c2c520e28 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:43.460347 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e578f6-53b6-4823-b53b-593c2c520e28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:43.460632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e578f6-53b6-4823-b53b-593c2c520e28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:43.462211 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e578f6-53b6-4823-b53b-593c2c520e28 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:43.462872 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:43.463784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:43.464065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:43.464338 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] PATH_INFO: `/v3/projects/1ee060427df94583b4a3f11c7ea6e6cf` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:43.465540 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee060427df94583b4a3f11c7ea6e6cf)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:43.467556 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:43.475716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1003/1991] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:34:43.480271 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e578f6-53b6-4823-b53b-593c2c520e28 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:43.499114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e578f6-53b6-4823-b53b-593c2c520e28 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:43.505788 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c662d5-405d-4d0b-8d8a-4586b3c4b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:43.506081 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c662d5-405d-4d0b-8d8a-4586b3c4b1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:43.506967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c662d5-405d-4d0b-8d8a-4586b3c4b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:43.507276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c662d5-405d-4d0b-8d8a-4586b3c4b1e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:43.507988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c662d5-405d-4d0b-8d8a-4586b3c4b1e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:43.510183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c662d5-405d-4d0b-8d8a-4586b3c4b1e0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:43.618778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1004/1992] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:43 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:43.623434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c662d5-405d-4d0b-8d8a-4586b3c4b1e0 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:43.634985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee060427df94583b4a3f11c7ea6e6cf', 'request_id': 'req-4702afa9-3287-49b3-bc00-0f83a3be694b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:43.650229 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee060427df94583b4a3f11c7ea6e6cf', 'request_id': 'req-4702afa9-3287-49b3-bc00-0f83a3be694b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:43.660827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee060427df94583b4a3f11c7ea6e6cf', 'request_id': 'req-4702afa9-3287-49b3-bc00-0f83a3be694b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:43.704626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c662d5-405d-4d0b-8d8a-4586b3c4b1e0 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:43.710725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fdf66-5162-450a-9026-2a700885767e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:43.711422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fdf66-5162-450a-9026-2a700885767e admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:43.711704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fdf66-5162-450a-9026-2a700885767e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:43.711974 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788fdf66-5162-450a-9026-2a700885767e admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:43.712701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fdf66-5162-450a-9026-2a700885767e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:43.714686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788fdf66-5162-450a-9026-2a700885767e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:43.742162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] The token cache is being invalidate because project 1ee060427df94583b4a3f11c7ea6e6cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:43.742456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:43.744247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:43.745316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 989/1993] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:43 2022] DELETE /identity/v3/projects/1ee060427df94583b4a3f11c7ea6e6cf => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:43.748936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:43.750374 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:43.799130 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1005/1994] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:43 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:43.800029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fdf66-5162-450a-9026-2a700885767e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:43.802890 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-788fdf66-5162-450a-9026-2a700885767e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:43.815959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788fdf66-5162-450a-9026-2a700885767e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:43.821605 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ec05a-6374-4d38-a2ff-27ff0cf54570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:43.824645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec05a-6374-4d38-a2ff-27ff0cf54570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:43.824645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec05a-6374-4d38-a2ff-27ff0cf54570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:43.824645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987ec05a-6374-4d38-a2ff-27ff0cf54570 admin admin] PATH_INFO: `/v3/users/3bbc97ea7a74449c82b12f9fa6b3db1c` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:43.824988 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702afa9-3287-49b3-bc00-0f83a3be694b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:43.825087 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ec05a-6374-4d38-a2ff-27ff0cf54570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bbc97ea7a74449c82b12f9fa6b3db1c)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:43.826187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987ec05a-6374-4d38-a2ff-27ff0cf54570 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:43.829588 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7118966-be0e-4bd1-abf8-8a9a94bafcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:43.830508 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7118966-be0e-4bd1-abf8-8a9a94bafcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:43.830788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7118966-be0e-4bd1-abf8-8a9a94bafcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:43.831125 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7118966-be0e-4bd1-abf8-8a9a94bafcd3 admin admin] PATH_INFO: `/v3/users/54439b72f4af4cbaae41645eb301d6a8` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:43.832453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7118966-be0e-4bd1-abf8-8a9a94bafcd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54439b72f4af4cbaae41645eb301d6a8)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:43.834500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7118966-be0e-4bd1-abf8-8a9a94bafcd3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:44.029897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-987ec05a-6374-4d38-a2ff-27ff0cf54570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bbc97ea7a74449c82b12f9fa6b3db1c'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:44.030586 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-987ec05a-6374-4d38-a2ff-27ff0cf54570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bbc97ea7a74449c82b12f9fa6b3db1c'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:44.031265 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-987ec05a-6374-4d38-a2ff-27ff0cf54570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bbc97ea7a74449c82b12f9fa6b3db1c'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:44.044905 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-987ec05a-6374-4d38-a2ff-27ff0cf54570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bbc97ea7a74449c82b12f9fa6b3db1c'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:44.051962 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-987ec05a-6374-4d38-a2ff-27ff0cf54570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bbc97ea7a74449c82b12f9fa6b3db1c'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:44.136610 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e7118966-be0e-4bd1-abf8-8a9a94bafcd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54439b72f4af4cbaae41645eb301d6a8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:44.137296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e7118966-be0e-4bd1-abf8-8a9a94bafcd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54439b72f4af4cbaae41645eb301d6a8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:44.137911 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e7118966-be0e-4bd1-abf8-8a9a94bafcd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54439b72f4af4cbaae41645eb301d6a8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:44.147402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1006/1995] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:43 2022] DELETE /identity/v3/users/3bbc97ea7a74449c82b12f9fa6b3db1c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:44.148815 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ec05a-6374-4d38-a2ff-27ff0cf54570 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:44.150463 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-987ec05a-6374-4d38-a2ff-27ff0cf54570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:44.156248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e7118966-be0e-4bd1-abf8-8a9a94bafcd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54439b72f4af4cbaae41645eb301d6a8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:44.164194 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e7118966-be0e-4bd1-abf8-8a9a94bafcd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54439b72f4af4cbaae41645eb301d6a8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:44.232194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987ec05a-6374-4d38-a2ff-27ff0cf54570 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:44.239857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fe2c1-97fc-4313-9a89-8b6964b381e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:44.240534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fe2c1-97fc-4313-9a89-8b6964b381e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:44.240819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fe2c1-97fc-4313-9a89-8b6964b381e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:44.241389 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fe2c1-97fc-4313-9a89-8b6964b381e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:44.242160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fe2c1-97fc-4313-9a89-8b6964b381e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:44.244277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fe2c1-97fc-4313-9a89-8b6964b381e4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:44.246393 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 990/1996] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:43 2022] DELETE /identity/v3/users/54439b72f4af4cbaae41645eb301d6a8 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:44.250602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bf365-e140-4a61-a9fd-0c1f0607a32b None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:44.250895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bf365-e140-4a61-a9fd-0c1f0607a32b None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:44.251301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bf365-e140-4a61-a9fd-0c1f0607a32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:44.257035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1007/1997] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:44.260969 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fe2c1-97fc-4313-9a89-8b6964b381e4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:44.263435 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-8a2fe2c1-97fc-4313-9a89-8b6964b381e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:44.280293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-cd8bf365-e140-4a61-a9fd-0c1f0607a32b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:44.283674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-cd8bf365-e140-4a61-a9fd-0c1f0607a32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:44.284753 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fe2c1-97fc-4313-9a89-8b6964b381e4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:44.346899 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025f2dc-8c48-4b0e-b1aa-f0eb3639ec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:44.347617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025f2dc-8c48-4b0e-b1aa-f0eb3639ec60 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:44.347902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025f2dc-8c48-4b0e-b1aa-f0eb3639ec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:44.348173 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025f2dc-8c48-4b0e-b1aa-f0eb3639ec60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:44.348925 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025f2dc-8c48-4b0e-b1aa-f0eb3639ec60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:44.351082 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025f2dc-8c48-4b0e-b1aa-f0eb3639ec60 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:44.357388 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 991/1998] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:44.363193 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1008/1999] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:44.368102 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bf365-e140-4a61-a9fd-0c1f0607a32b None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:44.378678 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025f2dc-8c48-4b0e-b1aa-f0eb3639ec60 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:44.381939 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bf365-e140-4a61-a9fd-0c1f0607a32b None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:44.382349 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-4025f2dc-8c48-4b0e-b1aa-f0eb3639ec60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:44.388457 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947be7f-d8a3-4cba-9b97-f139ba7e96a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:44.389292 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947be7f-d8a3-4cba-9b97-f139ba7e96a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:44.389615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947be7f-d8a3-4cba-9b97-f139ba7e96a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:44.389931 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7947be7f-d8a3-4cba-9b97-f139ba7e96a8 admin admin] PATH_INFO: `/v3/projects/1929e4a3bca9461dbc877e74142a9a33/users/909bb1e55e974587a4cfadd8a8bb4770/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:44.411212 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947be7f-d8a3-4cba-9b97-f139ba7e96a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1929e4a3bca9461dbc877e74142a9a33, user_id=909bb1e55e974587a4cfadd8a8bb4770, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:44.414564 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7947be7f-d8a3-4cba-9b97-f139ba7e96a8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:44.454872 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025f2dc-8c48-4b0e-b1aa-f0eb3639ec60 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:44.461010 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db4bf5-86b8-4c2d-af53-9c3ba6da9efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:44.461769 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db4bf5-86b8-4c2d-af53-9c3ba6da9efd service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:44.461959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db4bf5-86b8-4c2d-af53-9c3ba6da9efd service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:44.462214 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db4bf5-86b8-4c2d-af53-9c3ba6da9efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:44.473954 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db4bf5-86b8-4c2d-af53-9c3ba6da9efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:44.475442 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db4bf5-86b8-4c2d-af53-9c3ba6da9efd service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:44.487552 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1009/2000] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:44.503365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 992/2001] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:44 2022] PUT /identity/v3/projects/1929e4a3bca9461dbc877e74142a9a33/users/909bb1e55e974587a4cfadd8a8bb4770/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:44.514822 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0e5a5-3266-4f0d-bf51-4ef5387da09a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:44.515161 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0e5a5-3266-4f0d-bf51-4ef5387da09a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:44.515875 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b0e5a5-3266-4f0d-bf51-4ef5387da09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:44.544067 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-77b0e5a5-3266-4f0d-bf51-4ef5387da09a None None] MFA Rules not processed for user `909bb1e55e974587a4cfadd8a8bb4770`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:44.545346 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-77b0e5a5-3266-4f0d-bf51-4ef5387da09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:44.611779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1010/2002] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:44.621928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947be7f-d8a3-4cba-9b97-f139ba7e96a8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:44.623685 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7947be7f-d8a3-4cba-9b97-f139ba7e96a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:44.645409 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0e5a5-3266-4f0d-bf51-4ef5387da09a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:44.647079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-77b0e5a5-3266-4f0d-bf51-4ef5387da09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:44.730376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7947be7f-d8a3-4cba-9b97-f139ba7e96a8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:44.735263 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff573364-c3ca-4d02-b0fd-b4d225ad5fac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:44.743591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff573364-c3ca-4d02-b0fd-b4d225ad5fac service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:44.743591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff573364-c3ca-4d02-b0fd-b4d225ad5fac service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:44.743591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff573364-c3ca-4d02-b0fd-b4d225ad5fac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:44.748703 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff573364-c3ca-4d02-b0fd-b4d225ad5fac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:44.750691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff573364-c3ca-4d02-b0fd-b4d225ad5fac service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:44.764271 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 993/2003] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:44.765831 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55130036-7383-48de-bf13-fef20a4efa95 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:44.766194 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55130036-7383-48de-bf13-fef20a4efa95 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:44.766567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55130036-7383-48de-bf13-fef20a4efa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:44.770120 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b0e5a5-3266-4f0d-bf51-4ef5387da09a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:44.777051 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43934a60-e08d-4ce1-917a-cd57dadcadf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:44.778274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43934a60-e08d-4ce1-917a-cd57dadcadf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:44.778704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43934a60-e08d-4ce1-917a-cd57dadcadf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:44.779208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43934a60-e08d-4ce1-917a-cd57dadcadf5 admin admin] PATH_INFO: `/v3/projects/4b702369398444a29a8a9130c7afd68c` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:44.780609 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43934a60-e08d-4ce1-917a-cd57dadcadf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b702369398444a29a8a9130c7afd68c)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:44.782755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43934a60-e08d-4ce1-917a-cd57dadcadf5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:44.787380 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-55130036-7383-48de-bf13-fef20a4efa95 None None] MFA Rules not processed for user `9d263d17f5844d95a75a9b0ba4fb2455`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:44.788627 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-55130036-7383-48de-bf13-fef20a4efa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:44.866199 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 994/2004] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:44.867143 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55130036-7383-48de-bf13-fef20a4efa95 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:44.877638 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55130036-7383-48de-bf13-fef20a4efa95 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:44.882918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d027f-7192-46bd-b0bc-0d4db12cd8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:44.883828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d027f-7192-46bd-b0bc-0d4db12cd8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:44.884123 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d027f-7192-46bd-b0bc-0d4db12cd8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:44.884588 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d027f-7192-46bd-b0bc-0d4db12cd8aa admin admin] PATH_INFO: `/v3/users/909bb1e55e974587a4cfadd8a8bb4770` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:44.885653 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d027f-7192-46bd-b0bc-0d4db12cd8aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=909bb1e55e974587a4cfadd8a8bb4770)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:44.887610 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d027f-7192-46bd-b0bc-0d4db12cd8aa admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:44.948691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-43934a60-e08d-4ce1-917a-cd57dadcadf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b702369398444a29a8a9130c7afd68c', 'request_id': 'req-43934a60-e08d-4ce1-917a-cd57dadcadf5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.009353 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-43934a60-e08d-4ce1-917a-cd57dadcadf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b702369398444a29a8a9130c7afd68c', 'request_id': 'req-43934a60-e08d-4ce1-917a-cd57dadcadf5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.015470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-43934a60-e08d-4ce1-917a-cd57dadcadf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b702369398444a29a8a9130c7afd68c', 'request_id': 'req-43934a60-e08d-4ce1-917a-cd57dadcadf5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.027130 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-43934a60-e08d-4ce1-917a-cd57dadcadf5 admin admin] The token cache is being invalidate because project 4b702369398444a29a8a9130c7afd68c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:45.027441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-43934a60-e08d-4ce1-917a-cd57dadcadf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.028102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-43934a60-e08d-4ce1-917a-cd57dadcadf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.029655 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1011/2005] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:44 2022] DELETE /identity/v3/projects/4b702369398444a29a8a9130c7afd68c => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:45.034280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aebf0-11a4-45df-826f-b3b4e19a6ec2 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:45.034562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aebf0-11a4-45df-826f-b3b4e19a6ec2 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:45.034836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aebf0-11a4-45df-826f-b3b4e19a6ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:45.054373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-0b5aebf0-11a4-45df-826f-b3b4e19a6ec2 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:45.055613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-0b5aebf0-11a4-45df-826f-b3b4e19a6ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:45.118147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-875d027f-7192-46bd-b0bc-0d4db12cd8aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909bb1e55e974587a4cfadd8a8bb4770'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.118951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-875d027f-7192-46bd-b0bc-0d4db12cd8aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909bb1e55e974587a4cfadd8a8bb4770'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.119854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-875d027f-7192-46bd-b0bc-0d4db12cd8aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909bb1e55e974587a4cfadd8a8bb4770'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.136275 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-875d027f-7192-46bd-b0bc-0d4db12cd8aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909bb1e55e974587a4cfadd8a8bb4770'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.146499 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-875d027f-7192-46bd-b0bc-0d4db12cd8aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909bb1e55e974587a4cfadd8a8bb4770'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.170961 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1012/2006] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:45.173134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5aebf0-11a4-45df-826f-b3b4e19a6ec2 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:45.173134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-0b5aebf0-11a4-45df-826f-b3b4e19a6ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:45.185215 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5aebf0-11a4-45df-826f-b3b4e19a6ec2 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:45.190154 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:45.191205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:45.192082 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:45.192348 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] PATH_INFO: `/v3/projects/873a37121e2f41548f1e6f6e2dd0cd7e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:45.193731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873a37121e2f41548f1e6f6e2dd0cd7e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:45.195935 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:45.238630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 995/2007] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:44 2022] DELETE /identity/v3/users/909bb1e55e974587a4cfadd8a8bb4770 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:45.240339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93fcff-f048-4c2f-a838-a08ee61b071b None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:45.240632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93fcff-f048-4c2f-a838-a08ee61b071b None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:45.240913 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93fcff-f048-4c2f-a838-a08ee61b071b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:45.260452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-6f93fcff-f048-4c2f-a838-a08ee61b071b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:45.261653 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-6f93fcff-f048-4c2f-a838-a08ee61b071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:45.307846 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873a37121e2f41548f1e6f6e2dd0cd7e', 'request_id': 'req-e4d06b25-daac-420a-beaf-1528cab86bd9'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.339186 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 996/2008] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:45.340673 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9fdc7-7180-4a53-a8fc-ea177c9695c4 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:45.340968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9fdc7-7180-4a53-a8fc-ea177c9695c4 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:45.341246 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9fdc7-7180-4a53-a8fc-ea177c9695c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:45.360611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-41e9fdc7-7180-4a53-a8fc-ea177c9695c4 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:45.361881 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-41e9fdc7-7180-4a53-a8fc-ea177c9695c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:45.392654 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873a37121e2f41548f1e6f6e2dd0cd7e', 'request_id': 'req-e4d06b25-daac-420a-beaf-1528cab86bd9'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.409847 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873a37121e2f41548f1e6f6e2dd0cd7e', 'request_id': 'req-e4d06b25-daac-420a-beaf-1528cab86bd9'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.421692 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] The token cache is being invalidate because project 873a37121e2f41548f1e6f6e2dd0cd7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:45.422643 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.423813 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.426686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1013/2009] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:45 2022] DELETE /identity/v3/projects/873a37121e2f41548f1e6f6e2dd0cd7e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:45.427928 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:45.429561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:45.444171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 997/2010] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:45.445169 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9fdc7-7180-4a53-a8fc-ea177c9695c4 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:45.449105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-41e9fdc7-7180-4a53-a8fc-ea177c9695c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:45.462082 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9fdc7-7180-4a53-a8fc-ea177c9695c4 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:45.467280 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c104a8-d639-41f4-a20a-16b2c9ca7053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:45.468143 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c104a8-d639-41f4-a20a-16b2c9ca7053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:45.468420 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c104a8-d639-41f4-a20a-16b2c9ca7053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:45.468693 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c104a8-d639-41f4-a20a-16b2c9ca7053 admin admin] PATH_INFO: `/v3/users/5bcc6bd867c14d95a27102d5636b4cc5` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:45.469946 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c104a8-d639-41f4-a20a-16b2c9ca7053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bcc6bd867c14d95a27102d5636b4cc5)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:45.471972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c104a8-d639-41f4-a20a-16b2c9ca7053 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:45.510205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d06b25-daac-420a-beaf-1528cab86bd9 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:45.514985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae420b46-bba5-4c1e-9fb4-99fa73485128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:45.518151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae420b46-bba5-4c1e-9fb4-99fa73485128 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:45.518151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae420b46-bba5-4c1e-9fb4-99fa73485128 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:45.518151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae420b46-bba5-4c1e-9fb4-99fa73485128 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:45.518151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae420b46-bba5-4c1e-9fb4-99fa73485128 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:45.518151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae420b46-bba5-4c1e-9fb4-99fa73485128 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:45.518851 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae420b46-bba5-4c1e-9fb4-99fa73485128 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:45.534933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1014/2011] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:34:45.534933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae420b46-bba5-4c1e-9fb4-99fa73485128 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:45.534933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ae420b46-bba5-4c1e-9fb4-99fa73485128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:45.599488 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae420b46-bba5-4c1e-9fb4-99fa73485128 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:45.603651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e4caf-9689-4483-89d8-456f6e3a2bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:45.604554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e4caf-9689-4483-89d8-456f6e3a2bad service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:45.605034 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e4caf-9689-4483-89d8-456f6e3a2bad service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:45.605314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e4caf-9689-4483-89d8-456f6e3a2bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:45.622294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e4caf-9689-4483-89d8-456f6e3a2bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:45.623789 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311e4caf-9689-4483-89d8-456f6e3a2bad service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:45.634774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1015/2012] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:45.635760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e4caf-9689-4483-89d8-456f6e3a2bad service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:45.645515 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e4caf-9689-4483-89d8-456f6e3a2bad service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:45.651559 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd91d4-3fad-46b1-9051-2f6f082a7d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:45.652223 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd91d4-3fad-46b1-9051-2f6f082a7d21 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:45.652507 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd91d4-3fad-46b1-9051-2f6f082a7d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:45.652788 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd91d4-3fad-46b1-9051-2f6f082a7d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:45.653506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd91d4-3fad-46b1-9051-2f6f082a7d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:45.655454 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd91d4-3fad-46b1-9051-2f6f082a7d21 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:45.681222 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f4c104a8-d639-41f4-a20a-16b2c9ca7053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bcc6bd867c14d95a27102d5636b4cc5'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.682029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f4c104a8-d639-41f4-a20a-16b2c9ca7053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bcc6bd867c14d95a27102d5636b4cc5'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.682743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f4c104a8-d639-41f4-a20a-16b2c9ca7053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bcc6bd867c14d95a27102d5636b4cc5'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.695295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f4c104a8-d639-41f4-a20a-16b2c9ca7053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bcc6bd867c14d95a27102d5636b4cc5'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.702869 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f4c104a8-d639-41f4-a20a-16b2c9ca7053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bcc6bd867c14d95a27102d5636b4cc5'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:45.740316 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1016/2013] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:45 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:45.742455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd91d4-3fad-46b1-9051-2f6f082a7d21 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:45.744491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-34cd91d4-3fad-46b1-9051-2f6f082a7d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:45.782139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 998/2014] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:45 2022] DELETE /identity/v3/users/5bcc6bd867c14d95a27102d5636b4cc5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:45.825434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd91d4-3fad-46b1-9051-2f6f082a7d21 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:45.890265 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379f4b1-c403-454c-9623-078903ed6c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:45.890973 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379f4b1-c403-454c-9623-078903ed6c70 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:45.891277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379f4b1-c403-454c-9623-078903ed6c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:45.891554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6379f4b1-c403-454c-9623-078903ed6c70 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:45.892273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379f4b1-c403-454c-9623-078903ed6c70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:45.894387 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6379f4b1-c403-454c-9623-078903ed6c70 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:46.004587 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1017/2015] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:45 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:46.008880 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c104a8-d639-41f4-a20a-16b2c9ca7053 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:46.019035 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c104a8-d639-41f4-a20a-16b2c9ca7053 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:46.024317 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf2770-c4d9-4c62-9c6d-62fc8b0829a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:46.025147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf2770-c4d9-4c62-9c6d-62fc8b0829a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.025369 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf2770-c4d9-4c62-9c6d-62fc8b0829a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.025640 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf2770-c4d9-4c62-9c6d-62fc8b0829a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.026568 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf2770-c4d9-4c62-9c6d-62fc8b0829a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:46.028295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf2770-c4d9-4c62-9c6d-62fc8b0829a7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:46.040232 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 999/2016] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:46.045646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379f4b1-c403-454c-9623-078903ed6c70 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:46.063632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6379f4b1-c403-454c-9623-078903ed6c70 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:46.069421 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d80ea-c769-4ac9-aa94-295f99482e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:46.070128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d80ea-c769-4ac9-aa94-295f99482e9c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.070370 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d80ea-c769-4ac9-aa94-295f99482e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.070649 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d80ea-c769-4ac9-aa94-295f99482e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.071524 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d80ea-c769-4ac9-aa94-295f99482e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:46.073238 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d80ea-c769-4ac9-aa94-295f99482e9c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:46.085378 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1018/2017] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:46.089454 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf2770-c4d9-4c62-9c6d-62fc8b0829a7 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:46.101125 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf2770-c4d9-4c62-9c6d-62fc8b0829a7 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:46.107470 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e27d1-223d-487b-81e7-b15b5e8216a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:46.108682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e27d1-223d-487b-81e7-b15b5e8216a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.109088 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e27d1-223d-487b-81e7-b15b5e8216a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.109542 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e27d1-223d-487b-81e7-b15b5e8216a3 admin admin] PATH_INFO: `/v3/projects/762170cc7224438e9218e6f757a87f1c/users/c9adc5fa6066418aa8ae53463bcee3b6/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.122682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d80ea-c769-4ac9-aa94-295f99482e9c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:46.124842 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-424d80ea-c769-4ac9-aa94-295f99482e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:46.136521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e27d1-223d-487b-81e7-b15b5e8216a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=762170cc7224438e9218e6f757a87f1c, user_id=c9adc5fa6066418aa8ae53463bcee3b6, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:46.139841 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e27d1-223d-487b-81e7-b15b5e8216a3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:46.149819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d80ea-c769-4ac9-aa94-295f99482e9c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:46.159820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:46.164128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.164413 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.164717 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] PATH_INFO: `/v3/projects/1929e4a3bca9461dbc877e74142a9a33` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.166044 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1929e4a3bca9461dbc877e74142a9a33)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:46.168055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:46.330982 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1000/2018] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:46 2022] PUT /identity/v3/projects/762170cc7224438e9218e6f757a87f1c/users/c9adc5fa6066418aa8ae53463bcee3b6/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:46.342007 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955118a-4416-4d2f-9cbd-5dafd56b7ac7 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.342290 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955118a-4416-4d2f-9cbd-5dafd56b7ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.342594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e955118a-4416-4d2f-9cbd-5dafd56b7ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.348979 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1929e4a3bca9461dbc877e74142a9a33', 'request_id': 'req-9b7c5d50-4425-4447-8060-7718f74bbf1f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:46.379508 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-e955118a-4416-4d2f-9cbd-5dafd56b7ac7 None None] MFA Rules not processed for user `c9adc5fa6066418aa8ae53463bcee3b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:46.380715 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e955118a-4416-4d2f-9cbd-5dafd56b7ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:46.438175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1929e4a3bca9461dbc877e74142a9a33', 'request_id': 'req-9b7c5d50-4425-4447-8060-7718f74bbf1f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:46.445484 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1929e4a3bca9461dbc877e74142a9a33', 'request_id': 'req-9b7c5d50-4425-4447-8060-7718f74bbf1f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:46.449070 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1001/2019] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:46.449070 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955118a-4416-4d2f-9cbd-5dafd56b7ac7 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:46.449070 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e955118a-4416-4d2f-9cbd-5dafd56b7ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:46.463246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] The token cache is being invalidate because project 1929e4a3bca9461dbc877e74142a9a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:46.463591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:46.464198 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:46.466706 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1019/2020] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:46 2022] DELETE /identity/v3/projects/1929e4a3bca9461dbc877e74142a9a33 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:46.467524 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:46.468912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:46.518343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e955118a-4416-4d2f-9cbd-5dafd56b7ac7 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:46.525865 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bcd7a-6129-4839-84d8-42134ba5812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:46.526858 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bcd7a-6129-4839-84d8-42134ba5812e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.527201 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bcd7a-6129-4839-84d8-42134ba5812e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.527565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bcd7a-6129-4839-84d8-42134ba5812e admin admin] PATH_INFO: `/v3/projects/1aea36d52fd3407a893ce427a7111b16` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.528891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bcd7a-6129-4839-84d8-42134ba5812e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1aea36d52fd3407a893ce427a7111b16)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:46.535752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bcd7a-6129-4839-84d8-42134ba5812e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:46.544939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7c5d50-4425-4447-8060-7718f74bbf1f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:46.548968 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b36ca2-2561-4d8b-b31a-11cba5e44042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:46.549613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b36ca2-2561-4d8b-b31a-11cba5e44042 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.549894 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b36ca2-2561-4d8b-b31a-11cba5e44042 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.550167 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b36ca2-2561-4d8b-b31a-11cba5e44042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.552886 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-89b36ca2-2561-4d8b-b31a-11cba5e44042 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:46.564142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b36ca2-2561-4d8b-b31a-11cba5e44042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:46.565568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b36ca2-2561-4d8b-b31a-11cba5e44042 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:46.576179 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1020/2021] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:46.577868 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402bfea-ea7a-4036-9bef-39ab0697ccc8 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.578203 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402bfea-ea7a-4036-9bef-39ab0697ccc8 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.578482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402bfea-ea7a-4036-9bef-39ab0697ccc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.597363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-2402bfea-ea7a-4036-9bef-39ab0697ccc8 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:46.598603 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2402bfea-ea7a-4036-9bef-39ab0697ccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:46.609806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1021/2022] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:46.617601 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dcf18-f567-498a-a5ca-7d82bc3ee85a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.618036 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dcf18-f567-498a-a5ca-7d82bc3ee85a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.618258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dcf18-f567-498a-a5ca-7d82bc3ee85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.639910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-930dcf18-f567-498a-a5ca-7d82bc3ee85a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:46.641226 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-930dcf18-f567-498a-a5ca-7d82bc3ee85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:46.651556 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6b9bcd7a-6129-4839-84d8-42134ba5812e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1aea36d52fd3407a893ce427a7111b16', 'request_id': 'req-6b9bcd7a-6129-4839-84d8-42134ba5812e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:46.660196 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6b9bcd7a-6129-4839-84d8-42134ba5812e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1aea36d52fd3407a893ce427a7111b16', 'request_id': 'req-6b9bcd7a-6129-4839-84d8-42134ba5812e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:46.666246 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6b9bcd7a-6129-4839-84d8-42134ba5812e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1aea36d52fd3407a893ce427a7111b16', 'request_id': 'req-6b9bcd7a-6129-4839-84d8-42134ba5812e'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:46.724288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1022/2023] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:46.730706 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6b9bcd7a-6129-4839-84d8-42134ba5812e admin admin] The token cache is being invalidate because project 1aea36d52fd3407a893ce427a7111b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:46.731003 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6b9bcd7a-6129-4839-84d8-42134ba5812e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:46.743473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6b9bcd7a-6129-4839-84d8-42134ba5812e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:46.743473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1002/2024] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:46 2022] DELETE /identity/v3/projects/1aea36d52fd3407a893ce427a7111b16 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:46.743825 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dcf18-f567-498a-a5ca-7d82bc3ee85a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:46.743903 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f93cd-3e5f-4647-ab96-d922bb69c4de None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.743903 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f93cd-3e5f-4647-ab96-d922bb69c4de None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.743903 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f93cd-3e5f-4647-ab96-d922bb69c4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.752972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dcf18-f567-498a-a5ca-7d82bc3ee85a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:46.758825 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c897c4d-cc21-4328-899d-b4593ae8ecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:46.766777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-9b1f93cd-3e5f-4647-ab96-d922bb69c4de None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:46.768661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9b1f93cd-3e5f-4647-ab96-d922bb69c4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:46.769689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c897c4d-cc21-4328-899d-b4593ae8ecc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.770016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c897c4d-cc21-4328-899d-b4593ae8ecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.770264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c897c4d-cc21-4328-899d-b4593ae8ecc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.771047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c897c4d-cc21-4328-899d-b4593ae8ecc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:46.771383 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c897c4d-cc21-4328-899d-b4593ae8ecc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:46.773021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c897c4d-cc21-4328-899d-b4593ae8ecc5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:46.787291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1003/2025] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:46.797857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1023/2026] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:34:46.799484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f93cd-3e5f-4647-ab96-d922bb69c4de None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:46.799843 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97850e-150c-49fb-aa0f-1baf811c20d4 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.800209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97850e-150c-49fb-aa0f-1baf811c20d4 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.800439 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a97850e-150c-49fb-aa0f-1baf811c20d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.802086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9b1f93cd-3e5f-4647-ab96-d922bb69c4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:46.814677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f93cd-3e5f-4647-ab96-d922bb69c4de None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:46.820179 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d828f1-7cf0-4cf6-a340-cf3b4ccf67cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:46.820846 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d828f1-7cf0-4cf6-a340-cf3b4ccf67cb admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.821333 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d828f1-7cf0-4cf6-a340-cf3b4ccf67cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.821597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d828f1-7cf0-4cf6-a340-cf3b4ccf67cb admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.822636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d828f1-7cf0-4cf6-a340-cf3b4ccf67cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:46.822764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-4a97850e-150c-49fb-aa0f-1baf811c20d4 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:46.823845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-4a97850e-150c-49fb-aa0f-1baf811c20d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:46.824275 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d828f1-7cf0-4cf6-a340-cf3b4ccf67cb admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:46.834222 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1024/2027] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:46.837967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97850e-150c-49fb-aa0f-1baf811c20d4 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:46.857477 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a97850e-150c-49fb-aa0f-1baf811c20d4 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:46.862405 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ec825-f4b5-4409-b2e2-6fbb74817154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:46.866272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ec825-f4b5-4409-b2e2-6fbb74817154 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.866272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ec825-f4b5-4409-b2e2-6fbb74817154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.866272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ec825-f4b5-4409-b2e2-6fbb74817154 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.866272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ec825-f4b5-4409-b2e2-6fbb74817154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:46.866272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ec825-f4b5-4409-b2e2-6fbb74817154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:46.867172 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ec825-f4b5-4409-b2e2-6fbb74817154 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:46.879043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1025/2028] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:34:46.883381 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ec825-f4b5-4409-b2e2-6fbb74817154 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:46.893619 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ec825-f4b5-4409-b2e2-6fbb74817154 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:46.898956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381411ae-43b3-410e-859a-472c5dcb2d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:46.899729 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381411ae-43b3-410e-859a-472c5dcb2d08 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:46.900025 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381411ae-43b3-410e-859a-472c5dcb2d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:46.900395 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381411ae-43b3-410e-859a-472c5dcb2d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:46.901268 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381411ae-43b3-410e-859a-472c5dcb2d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:46.903381 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381411ae-43b3-410e-859a-472c5dcb2d08 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:46.936311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1004/2029] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:46 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:46.940283 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d828f1-7cf0-4cf6-a340-cf3b4ccf67cb admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:47.002861 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d828f1-7cf0-4cf6-a340-cf3b4ccf67cb admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:47.007912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e113312-fd10-47c8-9ffa-0334f9e58aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:47.008575 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e113312-fd10-47c8-9ffa-0334f9e58aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:47.008860 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e113312-fd10-47c8-9ffa-0334f9e58aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:47.009138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e113312-fd10-47c8-9ffa-0334f9e58aa3 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:47.009844 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e113312-fd10-47c8-9ffa-0334f9e58aa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:47.011798 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e113312-fd10-47c8-9ffa-0334f9e58aa3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:47.030381 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1026/2030] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:46 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:47.034438 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381411ae-43b3-410e-859a-472c5dcb2d08 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:47.100174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381411ae-43b3-410e-859a-472c5dcb2d08 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:47.104972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8eace-5f9c-4c85-9920-78bf8672ae63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:47.105629 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8eace-5f9c-4c85-9920-78bf8672ae63 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:47.105912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8eace-5f9c-4c85-9920-78bf8672ae63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:47.106192 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e8eace-5f9c-4c85-9920-78bf8672ae63 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:47.106900 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8eace-5f9c-4c85-9920-78bf8672ae63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:47.108838 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e8eace-5f9c-4c85-9920-78bf8672ae63 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:47.164640 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1005/2031] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:46 2022] POST /identity/v3/users => generated 289 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:47.171579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e113312-fd10-47c8-9ffa-0334f9e58aa3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:47.181966 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e113312-fd10-47c8-9ffa-0334f9e58aa3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:47.186626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fe3aa-3440-45c9-883c-b2ac17ac8950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:47.187300 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fe3aa-3440-45c9-883c-b2ac17ac8950 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:47.187584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fe3aa-3440-45c9-883c-b2ac17ac8950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:47.187854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6fe3aa-3440-45c9-883c-b2ac17ac8950 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:47.188729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fe3aa-3440-45c9-883c-b2ac17ac8950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:47.190159 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6fe3aa-3440-45c9-883c-b2ac17ac8950 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:47.200276 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1006/2032] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:47.204276 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fe3aa-3440-45c9-883c-b2ac17ac8950 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:47.214894 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6fe3aa-3440-45c9-883c-b2ac17ac8950 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:47.219985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f40ae-635f-4928-aaaf-45a95915872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:47.220619 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f40ae-635f-4928-aaaf-45a95915872e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:47.220895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f40ae-635f-4928-aaaf-45a95915872e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:47.221165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594f40ae-635f-4928-aaaf-45a95915872e admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:47.221896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f40ae-635f-4928-aaaf-45a95915872e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:47.224058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594f40ae-635f-4928-aaaf-45a95915872e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:47.232158 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1027/2033] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:47 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:47.236481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8eace-5f9c-4c85-9920-78bf8672ae63 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:47.238053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1007/2034] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:47.241911 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f40ae-635f-4928-aaaf-45a95915872e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:47.247347 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e8eace-5f9c-4c85-9920-78bf8672ae63 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:47.252217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594f40ae-635f-4928-aaaf-45a95915872e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:47.257942 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538c1882-3cf5-4128-940d-0cc9909a978d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:47.258381 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c1882-3cf5-4128-940d-0cc9909a978d admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:47.258665 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c1882-3cf5-4128-940d-0cc9909a978d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:47.258936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538c1882-3cf5-4128-940d-0cc9909a978d admin admin] PATH_INFO: `/v3/projects/113ad0793bbb4cd9b50324091e80c2e2/users/0e5d68dfe7a74926b823c20716d5e5e8/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:47.260757 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66740816-46ef-451c-8e56-a4ad9b07ea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:47.261428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66740816-46ef-451c-8e56-a4ad9b07ea3e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:47.261709 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66740816-46ef-451c-8e56-a4ad9b07ea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:47.261979 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66740816-46ef-451c-8e56-a4ad9b07ea3e admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:47.262893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66740816-46ef-451c-8e56-a4ad9b07ea3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:47.264521 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66740816-46ef-451c-8e56-a4ad9b07ea3e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:47.277955 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c1882-3cf5-4128-940d-0cc9909a978d admin admin] RBAC: Authorizing `identity:create_grant(project_id=113ad0793bbb4cd9b50324091e80c2e2, user_id=0e5d68dfe7a74926b823c20716d5e5e8, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:47.279176 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1028/2035] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:47.280304 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66740816-46ef-451c-8e56-a4ad9b07ea3e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:47.281362 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538c1882-3cf5-4128-940d-0cc9909a978d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:47.292913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66740816-46ef-451c-8e56-a4ad9b07ea3e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:47.298088 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb66e6a-d587-4b7c-9f1f-87b05369ca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:47.298770 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb66e6a-d587-4b7c-9f1f-87b05369ca49 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:47.299159 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb66e6a-d587-4b7c-9f1f-87b05369ca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:47.299467 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb66e6a-d587-4b7c-9f1f-87b05369ca49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:47.300357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb66e6a-d587-4b7c-9f1f-87b05369ca49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:47.302751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb66e6a-d587-4b7c-9f1f-87b05369ca49 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:47.317388 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1029/2036] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:47.323163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb66e6a-d587-4b7c-9f1f-87b05369ca49 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:47.333739 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb66e6a-d587-4b7c-9f1f-87b05369ca49 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:47.339203 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac539e7f-ca88-4380-aa3c-080806ebb37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:47.340109 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac539e7f-ca88-4380-aa3c-080806ebb37e admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:47.340394 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac539e7f-ca88-4380-aa3c-080806ebb37e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:47.340672 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac539e7f-ca88-4380-aa3c-080806ebb37e admin admin] PATH_INFO: `/v3/projects/6d639956b48b4e1fad7b66c8aedd8269/users/6d255e8602c34198adc5073cf915ebb3/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:47.355409 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac539e7f-ca88-4380-aa3c-080806ebb37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d639956b48b4e1fad7b66c8aedd8269, user_id=6d255e8602c34198adc5073cf915ebb3, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:47.358178 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac539e7f-ca88-4380-aa3c-080806ebb37e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:47.375955 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1008/2037] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:47 2022] PUT /identity/v3/projects/113ad0793bbb4cd9b50324091e80c2e2/users/0e5d68dfe7a74926b823c20716d5e5e8/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:47.387399 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66981ea-751d-49e7-ab7d-071800ed38d0 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:47.388336 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66981ea-751d-49e7-ab7d-071800ed38d0 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:47.388768 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66981ea-751d-49e7-ab7d-071800ed38d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:47.418980 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-c66981ea-751d-49e7-ab7d-071800ed38d0 None None] MFA Rules not processed for user `0e5d68dfe7a74926b823c20716d5e5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:47.420243 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c66981ea-751d-49e7-ab7d-071800ed38d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:47.481713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1009/2038] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:47.495495 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1030/2039] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:47 2022] PUT /identity/v3/projects/6d639956b48b4e1fad7b66c8aedd8269/users/6d255e8602c34198adc5073cf915ebb3/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:47.499076 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66981ea-751d-49e7-ab7d-071800ed38d0 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:47.499076 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c66981ea-751d-49e7-ab7d-071800ed38d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:47.508130 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04665c-19ba-4d21-87de-711268b61a06 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:47.508477 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04665c-19ba-4d21-87de-711268b61a06 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:47.508889 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04665c-19ba-4d21-87de-711268b61a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:47.539205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-2a04665c-19ba-4d21-87de-711268b61a06 None None] MFA Rules not processed for user `6d255e8602c34198adc5073cf915ebb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:47.540441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2a04665c-19ba-4d21-87de-711268b61a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:47.562087 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66981ea-751d-49e7-ab7d-071800ed38d0 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:47.610516 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1031/2040] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:47.613761 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bb063-8d38-461f-9270-5b2e077e4104 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3df18302cd84e6eae6a1a60b0a8b2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:47.614663 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bb063-8d38-461f-9270-5b2e077e4104 service glance] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:47.614987 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bb063-8d38-461f-9270-5b2e077e4104 service glance] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:47.615109 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04665c-19ba-4d21-87de-711268b61a06 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:47.615299 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bb063-8d38-461f-9270-5b2e077e4104 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:47.680356 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04665c-19ba-4d21-87de-711268b61a06 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:47.685177 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bb063-8d38-461f-9270-5b2e077e4104 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:47.686064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35adae-2fc2-4b1f-80e1-91a852e192ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:47.686621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8bb063-8d38-461f-9270-5b2e077e4104 service glance] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:47.686732 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35adae-2fc2-4b1f-80e1-91a852e192ce admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:47.687654 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35adae-2fc2-4b1f-80e1-91a852e192ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:47.687654 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e35adae-2fc2-4b1f-80e1-91a852e192ce admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:47.688006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35adae-2fc2-4b1f-80e1-91a852e192ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:47.690289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e35adae-2fc2-4b1f-80e1-91a852e192ce admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:47.703994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1010/2041] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:47.795891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1032/2042] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:47 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:47.796215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bb063-8d38-461f-9270-5b2e077e4104 service glance] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:47.808185 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bb063-8d38-461f-9270-5b2e077e4104 service glance] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:47.869785 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538747be-3954-4ca1-baf2-e025511eaacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:47.870375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538747be-3954-4ca1-baf2-e025511eaacb admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:47.870661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538747be-3954-4ca1-baf2-e025511eaacb admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:47.870937 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538747be-3954-4ca1-baf2-e025511eaacb admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:47.871681 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538747be-3954-4ca1-baf2-e025511eaacb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:47.873622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538747be-3954-4ca1-baf2-e025511eaacb admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:47.964450 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1011/2043] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:47 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:47.968767 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35adae-2fc2-4b1f-80e1-91a852e192ce admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:47.980551 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e35adae-2fc2-4b1f-80e1-91a852e192ce admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:47.985729 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79231c26-e9ce-4951-9efe-4d8141319bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:47.986382 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231c26-e9ce-4951-9efe-4d8141319bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:47.986659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231c26-e9ce-4951-9efe-4d8141319bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:47.986930 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79231c26-e9ce-4951-9efe-4d8141319bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:47.987711 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79231c26-e9ce-4951-9efe-4d8141319bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:47.989320 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79231c26-e9ce-4951-9efe-4d8141319bd0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:48.000003 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1033/2044] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:48.004248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538747be-3954-4ca1-baf2-e025511eaacb admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:48.014245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538747be-3954-4ca1-baf2-e025511eaacb admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:48.020006 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7011173-ed70-4aba-b262-c9c975747c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:48.020596 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7011173-ed70-4aba-b262-c9c975747c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:48.020891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7011173-ed70-4aba-b262-c9c975747c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:48.021230 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7011173-ed70-4aba-b262-c9c975747c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:48.021975 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7011173-ed70-4aba-b262-c9c975747c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:48.023844 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7011173-ed70-4aba-b262-c9c975747c50 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:48.034178 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1012/2045] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:48.045531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79231c26-e9ce-4951-9efe-4d8141319bd0 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:48.049877 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79231c26-e9ce-4951-9efe-4d8141319bd0 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:48.054734 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34871b4-9dbf-438f-96ad-2b425c6dafc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:48.055640 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34871b4-9dbf-438f-96ad-2b425c6dafc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:48.055917 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34871b4-9dbf-438f-96ad-2b425c6dafc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:48.056190 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34871b4-9dbf-438f-96ad-2b425c6dafc7 admin admin] PATH_INFO: `/v3/projects/25c4c525ab2c482cad74059505be9a31/users/63d00da8ae18480ebf08e37495f698b0/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:48.071559 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34871b4-9dbf-438f-96ad-2b425c6dafc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25c4c525ab2c482cad74059505be9a31, user_id=63d00da8ae18480ebf08e37495f698b0, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:48.074275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34871b4-9dbf-438f-96ad-2b425c6dafc7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:48.149120 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1034/2046] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:48 2022] PUT /identity/v3/projects/25c4c525ab2c482cad74059505be9a31/users/63d00da8ae18480ebf08e37495f698b0/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:48.162811 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775e2a3-6c10-403b-bd71-df9268b407f1 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:48.163337 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775e2a3-6c10-403b-bd71-df9268b407f1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:48.163784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7775e2a3-6c10-403b-bd71-df9268b407f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:48.198174 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-7775e2a3-6c10-403b-bd71-df9268b407f1 None None] MFA Rules not processed for user `63d00da8ae18480ebf08e37495f698b0`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:48.199864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7775e2a3-6c10-403b-bd71-df9268b407f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:48.271065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1013/2047] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:48.275346 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34871b4-9dbf-438f-96ad-2b425c6dafc7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:48.356262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34871b4-9dbf-438f-96ad-2b425c6dafc7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:48.361298 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ef140-f69a-4445-85e8-9e43a54369ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:48.362184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef140-f69a-4445-85e8-9e43a54369ad admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:48.362480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef140-f69a-4445-85e8-9e43a54369ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:48.362776 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797ef140-f69a-4445-85e8-9e43a54369ad admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:48.363572 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ef140-f69a-4445-85e8-9e43a54369ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:48.366022 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797ef140-f69a-4445-85e8-9e43a54369ad admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:48.489122 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1035/2048] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:48 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:48.490553 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775e2a3-6c10-403b-bd71-df9268b407f1 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:48.507162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7775e2a3-6c10-403b-bd71-df9268b407f1 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:48.607487 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad7a8f-6e75-42b7-9bf3-75a1b53eef67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:48.608247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad7a8f-6e75-42b7-9bf3-75a1b53eef67 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:48.608635 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad7a8f-6e75-42b7-9bf3-75a1b53eef67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:48.608981 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad7a8f-6e75-42b7-9bf3-75a1b53eef67 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:48.609764 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad7a8f-6e75-42b7-9bf3-75a1b53eef67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:48.611870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad7a8f-6e75-42b7-9bf3-75a1b53eef67 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:48.711255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1014/2049] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:48 2022] POST /identity/v3/users => generated 295 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:48.713363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ef140-f69a-4445-85e8-9e43a54369ad admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:48.723983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797ef140-f69a-4445-85e8-9e43a54369ad admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:48.729118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4790e2e-6b2c-4394-9dac-c2d6edb521f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:48.729766 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4790e2e-6b2c-4394-9dac-c2d6edb521f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:48.730043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4790e2e-6b2c-4394-9dac-c2d6edb521f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:48.730314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4790e2e-6b2c-4394-9dac-c2d6edb521f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:48.731051 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4790e2e-6b2c-4394-9dac-c2d6edb521f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:48.732774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4790e2e-6b2c-4394-9dac-c2d6edb521f3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:48.744007 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1036/2050] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:48.748314 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad7a8f-6e75-42b7-9bf3-75a1b53eef67 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:48.759003 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad7a8f-6e75-42b7-9bf3-75a1b53eef67 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:48.763651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612bbe6-96bb-44d4-a724-4fd2695179a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:48.764564 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612bbe6-96bb-44d4-a724-4fd2695179a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:48.764926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612bbe6-96bb-44d4-a724-4fd2695179a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:48.765204 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612bbe6-96bb-44d4-a724-4fd2695179a2 admin admin] PATH_INFO: `/v3/projects/447e5057818c4313b01342b3c548f7cd/users/e1d03166fdd946a58c7e1c7a83801ba9/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:48.780933 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612bbe6-96bb-44d4-a724-4fd2695179a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=447e5057818c4313b01342b3c548f7cd, user_id=e1d03166fdd946a58c7e1c7a83801ba9, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:48.783589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612bbe6-96bb-44d4-a724-4fd2695179a2 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:48.850484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1015/2051] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:48 2022] PUT /identity/v3/projects/447e5057818c4313b01342b3c548f7cd/users/e1d03166fdd946a58c7e1c7a83801ba9/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:48.855903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4790e2e-6b2c-4394-9dac-c2d6edb521f3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:48.866414 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4790e2e-6b2c-4394-9dac-c2d6edb521f3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:48.932324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0292e-a073-40ec-af03-c8107272955a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:48.933005 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0292e-a073-40ec-af03-c8107272955a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:48.933357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0292e-a073-40ec-af03-c8107272955a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:48.934035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0292e-a073-40ec-af03-c8107272955a admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:48.934885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0292e-a073-40ec-af03-c8107272955a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:48.936528 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0292e-a073-40ec-af03-c8107272955a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:48.947149 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1037/2052] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:48.951264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612bbe6-96bb-44d4-a724-4fd2695179a2 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:48.966251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612bbe6-96bb-44d4-a724-4fd2695179a2 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:48.973107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd98d9-7d6f-4fcd-bb81-5c8e64593c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:48.974991 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd98d9-7d6f-4fcd-bb81-5c8e64593c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:48.974991 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd98d9-7d6f-4fcd-bb81-5c8e64593c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:48.974991 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd98d9-7d6f-4fcd-bb81-5c8e64593c7d admin admin] PATH_INFO: `/v3/projects/447e5057818c4313b01342b3c548f7cd/users/e1d03166fdd946a58c7e1c7a83801ba9/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:48.977765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd98d9-7d6f-4fcd-bb81-5c8e64593c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=447e5057818c4313b01342b3c548f7cd, user_id=e1d03166fdd946a58c7e1c7a83801ba9, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:48.980754 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cd98d9-7d6f-4fcd-bb81-5c8e64593c7d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:49.005938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1016/2053] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:48 2022] PUT /identity/v3/projects/447e5057818c4313b01342b3c548f7cd/users/e1d03166fdd946a58c7e1c7a83801ba9/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:49.016897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007f94c-9248-45b0-b7d6-470b82dded9a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:49.017186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007f94c-9248-45b0-b7d6-470b82dded9a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:49.021763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9007f94c-9248-45b0-b7d6-470b82dded9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:49.055347 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-9007f94c-9248-45b0-b7d6-470b82dded9a None None] MFA Rules not processed for user `e1d03166fdd946a58c7e1c7a83801ba9`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:49.060711 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9007f94c-9248-45b0-b7d6-470b82dded9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:49.162911 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1038/2054] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:49.174521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd98d9-7d6f-4fcd-bb81-5c8e64593c7d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:49.177031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-14cd98d9-7d6f-4fcd-bb81-5c8e64593c7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:49.256735 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd98d9-7d6f-4fcd-bb81-5c8e64593c7d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:49.260480 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24843ea-ceac-4890-96df-c9d1d489d829 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:49.261129 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24843ea-ceac-4890-96df-c9d1d489d829 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:49.261408 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24843ea-ceac-4890-96df-c9d1d489d829 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:49.261731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24843ea-ceac-4890-96df-c9d1d489d829 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:49.271751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24843ea-ceac-4890-96df-c9d1d489d829 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:49.273479 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24843ea-ceac-4890-96df-c9d1d489d829 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:49.291359 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1017/2055] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:49.432551 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007f94c-9248-45b0-b7d6-470b82dded9a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:49.442803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9007f94c-9248-45b0-b7d6-470b82dded9a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:49.446422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c675482-e2c6-405f-8251-dc8050b14cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:49.447059 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c675482-e2c6-405f-8251-dc8050b14cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:49.447862 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c675482-e2c6-405f-8251-dc8050b14cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:49.447862 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c675482-e2c6-405f-8251-dc8050b14cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:49.529933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c675482-e2c6-405f-8251-dc8050b14cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:49.532102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c675482-e2c6-405f-8251-dc8050b14cb0 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:49.554668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1039/2056] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:49.639122 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24843ea-ceac-4890-96df-c9d1d489d829 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:49.645288 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a24843ea-ceac-4890-96df-c9d1d489d829 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:49.721103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24843ea-ceac-4890-96df-c9d1d489d829 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:49.726840 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2104e5-49b4-411a-9c50-2e78a1610014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:49.729041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2104e5-49b4-411a-9c50-2e78a1610014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:49.729041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2104e5-49b4-411a-9c50-2e78a1610014 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:49.729041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2104e5-49b4-411a-9c50-2e78a1610014 admin admin] PATH_INFO: `/v3/users/79b9e6bee639494ba78fb2117d51239f` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:49.730268 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2104e5-49b4-411a-9c50-2e78a1610014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79b9e6bee639494ba78fb2117d51239f)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:49.731912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2104e5-49b4-411a-9c50-2e78a1610014 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:49.891599 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9a2104e5-49b4-411a-9c50-2e78a1610014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79b9e6bee639494ba78fb2117d51239f'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:49.892366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9a2104e5-49b4-411a-9c50-2e78a1610014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79b9e6bee639494ba78fb2117d51239f'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:49.892982 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9a2104e5-49b4-411a-9c50-2e78a1610014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79b9e6bee639494ba78fb2117d51239f'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:49.906146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9a2104e5-49b4-411a-9c50-2e78a1610014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79b9e6bee639494ba78fb2117d51239f'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:49.914091 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9a2104e5-49b4-411a-9c50-2e78a1610014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79b9e6bee639494ba78fb2117d51239f'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:50.006488 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1018/2057] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:49 2022] DELETE /identity/v3/users/79b9e6bee639494ba78fb2117d51239f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:50.258463 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c675482-e2c6-405f-8251-dc8050b14cb0 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:50.290684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c675482-e2c6-405f-8251-dc8050b14cb0 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:50.363027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:50.363027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:50.363027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:50.363027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865 admin admin] PATH_INFO: `/v3/projects/a83d4bf3604840f4be5877a0081825e7` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:50.364431 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83d4bf3604840f4be5877a0081825e7)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:50.364431 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:50.478407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83d4bf3604840f4be5877a0081825e7', 'request_id': 'req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:50.546327 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83d4bf3604840f4be5877a0081825e7', 'request_id': 'req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:50.552980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83d4bf3604840f4be5877a0081825e7', 'request_id': 'req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:50.564938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865 admin admin] The token cache is being invalidate because project a83d4bf3604840f4be5877a0081825e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:50.565251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:50.565914 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8c46131c-dfe8-4a81-b5d7-fdce0fa5c865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:50.568246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1040/2058] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:50 2022] DELETE /identity/v3/projects/a83d4bf3604840f4be5877a0081825e7 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:50.574194 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c96a37-af03-494f-8b5c-166de8be05ec None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:50.574484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c96a37-af03-494f-8b5c-166de8be05ec None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:50.574762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c96a37-af03-494f-8b5c-166de8be05ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:50.592869 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-90c96a37-af03-494f-8b5c-166de8be05ec None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:50.594076 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-90c96a37-af03-494f-8b5c-166de8be05ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:50.680273 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1019/2059] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:50.689497 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0a544-7f59-40ee-8a4b-46057d1c5743 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:50.689873 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0a544-7f59-40ee-8a4b-46057d1c5743 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:50.690232 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da0a544-7f59-40ee-8a4b-46057d1c5743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:50.710820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-9da0a544-7f59-40ee-8a4b-46057d1c5743 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:50.712216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9da0a544-7f59-40ee-8a4b-46057d1c5743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:50.721429 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1041/2060] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:50.725915 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c96a37-af03-494f-8b5c-166de8be05ec None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:50.735563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c96a37-af03-494f-8b5c-166de8be05ec None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:50.741043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087702d3-8b88-4f8d-9edf-b2db224de659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:50.741692 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087702d3-8b88-4f8d-9edf-b2db224de659 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:50.741974 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087702d3-8b88-4f8d-9edf-b2db224de659 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:50.742248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087702d3-8b88-4f8d-9edf-b2db224de659 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:50.742989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087702d3-8b88-4f8d-9edf-b2db224de659 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:50.743331 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087702d3-8b88-4f8d-9edf-b2db224de659 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:50.744940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087702d3-8b88-4f8d-9edf-b2db224de659 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:50.758110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1020/2061] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:34:50.762411 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0a544-7f59-40ee-8a4b-46057d1c5743 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:50.771670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da0a544-7f59-40ee-8a4b-46057d1c5743 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:50.776930 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f9d4c-7427-48aa-8ad3-f2bf3ae53ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:50.777587 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f9d4c-7427-48aa-8ad3-f2bf3ae53ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:50.777869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f9d4c-7427-48aa-8ad3-f2bf3ae53ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:50.778145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f9d4c-7427-48aa-8ad3-f2bf3ae53ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:50.778864 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f9d4c-7427-48aa-8ad3-f2bf3ae53ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:50.780817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f9d4c-7427-48aa-8ad3-f2bf3ae53ff6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:50.869550 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1042/2062] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:50 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:50.873910 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087702d3-8b88-4f8d-9edf-b2db224de659 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:50.884809 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087702d3-8b88-4f8d-9edf-b2db224de659 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:50.940539 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7107c70-aa0c-47b4-b9cf-a6d3ec12e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:50.941827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7107c70-aa0c-47b4-b9cf-a6d3ec12e51a admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:50.942208 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7107c70-aa0c-47b4-b9cf-a6d3ec12e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:50.942485 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7107c70-aa0c-47b4-b9cf-a6d3ec12e51a admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:50.943194 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7107c70-aa0c-47b4-b9cf-a6d3ec12e51a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:50.945424 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7107c70-aa0c-47b4-b9cf-a6d3ec12e51a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:51.039319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f9d4c-7427-48aa-8ad3-f2bf3ae53ff6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:51.039319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a18f9d4c-7427-48aa-8ad3-f2bf3ae53ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:51.051299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f9d4c-7427-48aa-8ad3-f2bf3ae53ff6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:51.056067 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a57ef4-77f6-4585-be35-9b203ba754e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:51.056913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a57ef4-77f6-4585-be35-9b203ba754e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:51.057189 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a57ef4-77f6-4585-be35-9b203ba754e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:51.057461 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a57ef4-77f6-4585-be35-9b203ba754e2 admin admin] PATH_INFO: `/v3/users/c9adc5fa6066418aa8ae53463bcee3b6` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:51.058733 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a57ef4-77f6-4585-be35-9b203ba754e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9adc5fa6066418aa8ae53463bcee3b6)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:51.060688 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a57ef4-77f6-4585-be35-9b203ba754e2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:51.067899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1021/2063] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:50 2022] POST /identity/v3/users => generated 282 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:34:51.073758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7107c70-aa0c-47b4-b9cf-a6d3ec12e51a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:51.086370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7107c70-aa0c-47b4-b9cf-a6d3ec12e51a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:51.091489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4156c10-134e-4feb-9e71-70db51c425fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:51.092363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4156c10-134e-4feb-9e71-70db51c425fd admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:51.092647 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4156c10-134e-4feb-9e71-70db51c425fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:51.092930 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4156c10-134e-4feb-9e71-70db51c425fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:51.093827 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4156c10-134e-4feb-9e71-70db51c425fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:51.095477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4156c10-134e-4feb-9e71-70db51c425fd admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:51.108928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1022/2064] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:51.113643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4156c10-134e-4feb-9e71-70db51c425fd admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:51.125181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4156c10-134e-4feb-9e71-70db51c425fd admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:51.130937 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea0708-558a-4072-b3ec-7ec1c0008476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:51.131726 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea0708-558a-4072-b3ec-7ec1c0008476 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:51.132043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea0708-558a-4072-b3ec-7ec1c0008476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:51.132437 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea0708-558a-4072-b3ec-7ec1c0008476 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:51.133481 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea0708-558a-4072-b3ec-7ec1c0008476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:51.135923 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea0708-558a-4072-b3ec-7ec1c0008476 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:51.147128 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1023/2065] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:34:51.151386 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea0708-558a-4072-b3ec-7ec1c0008476 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:51.161533 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea0708-558a-4072-b3ec-7ec1c0008476 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:51.166144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065be24-8d29-458c-a119-8115e54d5a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:51.167022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065be24-8d29-458c-a119-8115e54d5a41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:51.167330 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065be24-8d29-458c-a119-8115e54d5a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:51.167633 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065be24-8d29-458c-a119-8115e54d5a41 admin admin] PATH_INFO: `/v3/projects/0b12ef94a576449fbb26437d05ad0b9e/users/09a22a90e63a4747bf2562f3b2118d7a/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:51.182993 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065be24-8d29-458c-a119-8115e54d5a41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b12ef94a576449fbb26437d05ad0b9e, user_id=09a22a90e63a4747bf2562f3b2118d7a, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:51.185810 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065be24-8d29-458c-a119-8115e54d5a41 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:51.277631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-96a57ef4-77f6-4585-be35-9b203ba754e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9adc5fa6066418aa8ae53463bcee3b6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:51.278284 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-96a57ef4-77f6-4585-be35-9b203ba754e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9adc5fa6066418aa8ae53463bcee3b6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:51.278875 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-96a57ef4-77f6-4585-be35-9b203ba754e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9adc5fa6066418aa8ae53463bcee3b6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:51.289801 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1024/2066] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:51 2022] PUT /identity/v3/projects/0b12ef94a576449fbb26437d05ad0b9e/users/09a22a90e63a4747bf2562f3b2118d7a/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:51.292052 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-96a57ef4-77f6-4585-be35-9b203ba754e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9adc5fa6066418aa8ae53463bcee3b6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:51.299103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-96a57ef4-77f6-4585-be35-9b203ba754e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9adc5fa6066418aa8ae53463bcee3b6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:51.300146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59c48c-b688-468b-9254-f6ca68f5dd96 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:51.301089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59c48c-b688-468b-9254-f6ca68f5dd96 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:51.301643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59c48c-b688-468b-9254-f6ca68f5dd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:51.336214 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-bd59c48c-b688-468b-9254-f6ca68f5dd96 None None] MFA Rules not processed for user `09a22a90e63a4747bf2562f3b2118d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:51.337620 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-bd59c48c-b688-468b-9254-f6ca68f5dd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:51.370894 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1043/2067] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:51 2022] DELETE /identity/v3/users/c9adc5fa6066418aa8ae53463bcee3b6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:51.375148 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc34433-38aa-4605-8929-d6ed45daef75 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:51.375583 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc34433-38aa-4605-8929-d6ed45daef75 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:51.375807 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc34433-38aa-4605-8929-d6ed45daef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:51.395162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-9cc34433-38aa-4605-8929-d6ed45daef75 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:51.396741 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9cc34433-38aa-4605-8929-d6ed45daef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:51.409704 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1025/2068] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:51.417831 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59c48c-b688-468b-9254-f6ca68f5dd96 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:51.420610 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-bd59c48c-b688-468b-9254-f6ca68f5dd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:51.526914 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1044/2069] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:51.527707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59c48c-b688-468b-9254-f6ca68f5dd96 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:51.540484 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc34433-38aa-4605-8929-d6ed45daef75 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:51.541883 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9cc34433-38aa-4605-8929-d6ed45daef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:51.585821 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b7a95-6e6f-453b-ad90-2551dc84aa56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:51.586465 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b7a95-6e6f-453b-ad90-2551dc84aa56 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:51.586757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b7a95-6e6f-453b-ad90-2551dc84aa56 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:51.587037 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b7a95-6e6f-453b-ad90-2551dc84aa56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:51.603660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc34433-38aa-4605-8929-d6ed45daef75 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:51.612412 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a860b7-d104-4672-b5c4-90aa6f35c811 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:51.616740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a860b7-d104-4672-b5c4-90aa6f35c811 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:51.617695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a860b7-d104-4672-b5c4-90aa6f35c811 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:51.618160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a860b7-d104-4672-b5c4-90aa6f35c811 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:51.637936 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a860b7-d104-4672-b5c4-90aa6f35c811 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:51.640153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a860b7-d104-4672-b5c4-90aa6f35c811 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:51.652375 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1045/2070] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:51.662289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b7a95-6e6f-453b-ad90-2551dc84aa56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:51.663858 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b7a95-6e6f-453b-ad90-2551dc84aa56 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:51.674363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1026/2071] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:51 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:34:52.039338 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a860b7-d104-4672-b5c4-90aa6f35c811 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:52.042555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-19a860b7-d104-4672-b5c4-90aa6f35c811 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:52.064653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a860b7-d104-4672-b5c4-90aa6f35c811 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:52.086108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d3575-e90b-445c-ab2c-14590fd694fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:52.086108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3575-e90b-445c-ab2c-14590fd694fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:52.086108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3575-e90b-445c-ab2c-14590fd694fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:52.086108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d3575-e90b-445c-ab2c-14590fd694fd admin admin] PATH_INFO: `/v3/projects/762170cc7224438e9218e6f757a87f1c` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:52.086486 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d3575-e90b-445c-ab2c-14590fd694fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=762170cc7224438e9218e6f757a87f1c)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:52.086486 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d3575-e90b-445c-ab2c-14590fd694fd admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:52.267422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c36d3575-e90b-445c-ab2c-14590fd694fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762170cc7224438e9218e6f757a87f1c', 'request_id': 'req-c36d3575-e90b-445c-ab2c-14590fd694fd'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:52.355256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c36d3575-e90b-445c-ab2c-14590fd694fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762170cc7224438e9218e6f757a87f1c', 'request_id': 'req-c36d3575-e90b-445c-ab2c-14590fd694fd'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:52.361191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c36d3575-e90b-445c-ab2c-14590fd694fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762170cc7224438e9218e6f757a87f1c', 'request_id': 'req-c36d3575-e90b-445c-ab2c-14590fd694fd'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:52.375731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c36d3575-e90b-445c-ab2c-14590fd694fd admin admin] The token cache is being invalidate because project 762170cc7224438e9218e6f757a87f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:52.375731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c36d3575-e90b-445c-ab2c-14590fd694fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:52.375731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c36d3575-e90b-445c-ab2c-14590fd694fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:52.375731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1046/2072] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:52 2022] DELETE /identity/v3/projects/762170cc7224438e9218e6f757a87f1c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:53.694290 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b7a95-6e6f-453b-ad90-2551dc84aa56 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:53.695787 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-707b7a95-6e6f-453b-ad90-2551dc84aa56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:53.710140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b7a95-6e6f-453b-ad90-2551dc84aa56 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:53.771517 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8cb9f-cde7-4598-bc0f-4fa78001cb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:53.772380 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8cb9f-cde7-4598-bc0f-4fa78001cb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:53.772657 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8cb9f-cde7-4598-bc0f-4fa78001cb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:53.773197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8cb9f-cde7-4598-bc0f-4fa78001cb44 admin admin] PATH_INFO: `/v3/users/6d255e8602c34198adc5073cf915ebb3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:53.774414 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8cb9f-cde7-4598-bc0f-4fa78001cb44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d255e8602c34198adc5073cf915ebb3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:53.776392 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8cb9f-cde7-4598-bc0f-4fa78001cb44 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:53.977777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-edd8cb9f-cde7-4598-bc0f-4fa78001cb44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d255e8602c34198adc5073cf915ebb3'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:53.980354 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-edd8cb9f-cde7-4598-bc0f-4fa78001cb44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d255e8602c34198adc5073cf915ebb3'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:53.980354 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-edd8cb9f-cde7-4598-bc0f-4fa78001cb44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d255e8602c34198adc5073cf915ebb3'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:54.014989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-edd8cb9f-cde7-4598-bc0f-4fa78001cb44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d255e8602c34198adc5073cf915ebb3'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:54.023805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-edd8cb9f-cde7-4598-bc0f-4fa78001cb44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d255e8602c34198adc5073cf915ebb3'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:54.140958 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1027/2073] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:53 2022] DELETE /identity/v3/users/6d255e8602c34198adc5073cf915ebb3 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:54.146142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73954b4-d3d7-4afa-8943-d2c798d640db None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:54.146563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73954b4-d3d7-4afa-8943-d2c798d640db None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:54.146697 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73954b4-d3d7-4afa-8943-d2c798d640db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:54.165257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-d73954b4-d3d7-4afa-8943-d2c798d640db None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:54.166531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d73954b4-d3d7-4afa-8943-d2c798d640db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:54.225974 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1047/2074] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:54.236476 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8cb9f-cde7-4598-bc0f-4fa78001cb44 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:54.238230 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-edd8cb9f-cde7-4598-bc0f-4fa78001cb44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:54.306431 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8cb9f-cde7-4598-bc0f-4fa78001cb44 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:54.310208 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4278e-c237-428c-9b26-e37a0ab7313d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:54.310891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4278e-c237-428c-9b26-e37a0ab7313d service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:54.311166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4278e-c237-428c-9b26-e37a0ab7313d service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:54.311470 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4278e-c237-428c-9b26-e37a0ab7313d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:54.321268 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4278e-c237-428c-9b26-e37a0ab7313d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:54.322684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4278e-c237-428c-9b26-e37a0ab7313d service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:54.333074 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1028/2075] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:54.725145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73954b4-d3d7-4afa-8943-d2c798d640db None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:54.726828 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d73954b4-d3d7-4afa-8943-d2c798d640db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:54.741899 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73954b4-d3d7-4afa-8943-d2c798d640db None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:54.746898 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:54.747965 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:54.748249 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:54.748554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] PATH_INFO: `/v3/projects/6d639956b48b4e1fad7b66c8aedd8269` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:54.749876 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d639956b48b4e1fad7b66c8aedd8269)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:54.751834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:54.856378 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d639956b48b4e1fad7b66c8aedd8269', 'request_id': 'req-1eff103f-41bf-4935-9f87-6c2a5be3e582'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:54.940440 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d639956b48b4e1fad7b66c8aedd8269', 'request_id': 'req-1eff103f-41bf-4935-9f87-6c2a5be3e582'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:54.948299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d639956b48b4e1fad7b66c8aedd8269', 'request_id': 'req-1eff103f-41bf-4935-9f87-6c2a5be3e582'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:54.961944 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] The token cache is being invalidate because project 6d639956b48b4e1fad7b66c8aedd8269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:54.962237 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:54.962893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:54.964867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1048/2076] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:54 2022] DELETE /identity/v3/projects/6d639956b48b4e1fad7b66c8aedd8269 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:54.968490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4278e-c237-428c-9b26-e37a0ab7313d service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:54.979213 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4278e-c237-428c-9b26-e37a0ab7313d service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:55.035425 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd229e9-e4f6-434c-b3f8-ed75649120a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:55.036408 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd229e9-e4f6-434c-b3f8-ed75649120a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:55.036683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd229e9-e4f6-434c-b3f8-ed75649120a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:55.036953 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd229e9-e4f6-434c-b3f8-ed75649120a8 admin admin] PATH_INFO: `/v3/users/63d00da8ae18480ebf08e37495f698b0` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:55.038168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd229e9-e4f6-434c-b3f8-ed75649120a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d00da8ae18480ebf08e37495f698b0)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:55.040088 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd229e9-e4f6-434c-b3f8-ed75649120a8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:55.234430 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5cd229e9-e4f6-434c-b3f8-ed75649120a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d00da8ae18480ebf08e37495f698b0'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:55.235391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5cd229e9-e4f6-434c-b3f8-ed75649120a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d00da8ae18480ebf08e37495f698b0'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:55.235714 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5cd229e9-e4f6-434c-b3f8-ed75649120a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d00da8ae18480ebf08e37495f698b0'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:55.247686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5cd229e9-e4f6-434c-b3f8-ed75649120a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d00da8ae18480ebf08e37495f698b0'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:55.254514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5cd229e9-e4f6-434c-b3f8-ed75649120a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d00da8ae18480ebf08e37495f698b0'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:55.317532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1029/2077] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:54 2022] DELETE /identity/v3/users/63d00da8ae18480ebf08e37495f698b0 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:55.746370 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:55.747882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:55.762049 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff103f-41bf-4935-9f87-6c2a5be3e582 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:55.818975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:55.820113 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:55.820426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:55.820660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] PATH_INFO: `/v3/projects/25c4c525ab2c482cad74059505be9a31` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:55.821918 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=25c4c525ab2c482cad74059505be9a31)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:55.823850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:55.939162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25c4c525ab2c482cad74059505be9a31', 'request_id': 'req-239a1538-c890-440f-ab7e-3f5adb1643ec'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:56.002824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25c4c525ab2c482cad74059505be9a31', 'request_id': 'req-239a1538-c890-440f-ab7e-3f5adb1643ec'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:56.008786 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25c4c525ab2c482cad74059505be9a31', 'request_id': 'req-239a1538-c890-440f-ab7e-3f5adb1643ec'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:56.020323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] The token cache is being invalidate because project 25c4c525ab2c482cad74059505be9a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:56.020614 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:56.021247 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:56.023153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1049/2078] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:55 2022] DELETE /identity/v3/projects/25c4c525ab2c482cad74059505be9a31 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:56.027103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd229e9-e4f6-434c-b3f8-ed75649120a8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:56.028567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-5cd229e9-e4f6-434c-b3f8-ed75649120a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:56.042089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd229e9-e4f6-434c-b3f8-ed75649120a8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:56.102484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d81a8-5b2c-487f-b8d4-ce9691c83487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:56.103478 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d81a8-5b2c-487f-b8d4-ce9691c83487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:56.103759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d81a8-5b2c-487f-b8d4-ce9691c83487 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:56.104032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d81a8-5b2c-487f-b8d4-ce9691c83487 admin admin] PATH_INFO: `/v3/users/e1d03166fdd946a58c7e1c7a83801ba9` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:56.105250 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d81a8-5b2c-487f-b8d4-ce9691c83487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1d03166fdd946a58c7e1c7a83801ba9)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:56.107166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80d81a8-5b2c-487f-b8d4-ce9691c83487 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:56.269743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b80d81a8-5b2c-487f-b8d4-ce9691c83487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1d03166fdd946a58c7e1c7a83801ba9'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:56.270707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b80d81a8-5b2c-487f-b8d4-ce9691c83487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1d03166fdd946a58c7e1c7a83801ba9'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:56.271353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b80d81a8-5b2c-487f-b8d4-ce9691c83487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1d03166fdd946a58c7e1c7a83801ba9'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:56.285571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b80d81a8-5b2c-487f-b8d4-ce9691c83487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1d03166fdd946a58c7e1c7a83801ba9'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:56.292406 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-b80d81a8-5b2c-487f-b8d4-ce9691c83487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1d03166fdd946a58c7e1c7a83801ba9'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:56.427339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1030/2079] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:56 2022] DELETE /identity/v3/users/e1d03166fdd946a58c7e1c7a83801ba9 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:56.839695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:56.841954 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:56.862040 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a1538-c890-440f-ab7e-3f5adb1643ec admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:56.934314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c6e1f-7b42-4bae-81b5-0d88afc2709d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:56.935781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c6e1f-7b42-4bae-81b5-0d88afc2709d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:56.936212 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c6e1f-7b42-4bae-81b5-0d88afc2709d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:56.936627 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c6e1f-7b42-4bae-81b5-0d88afc2709d admin admin] PATH_INFO: `/v3/projects/447e5057818c4313b01342b3c548f7cd` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:56.937940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c6e1f-7b42-4bae-81b5-0d88afc2709d admin admin] RBAC: Authorizing `identity:delete_project(project_id=447e5057818c4313b01342b3c548f7cd)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:56.940263 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305c6e1f-7b42-4bae-81b5-0d88afc2709d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:57.033370 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-305c6e1f-7b42-4bae-81b5-0d88afc2709d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '447e5057818c4313b01342b3c548f7cd', 'request_id': 'req-305c6e1f-7b42-4bae-81b5-0d88afc2709d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:57.117197 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-305c6e1f-7b42-4bae-81b5-0d88afc2709d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '447e5057818c4313b01342b3c548f7cd', 'request_id': 'req-305c6e1f-7b42-4bae-81b5-0d88afc2709d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:57.123704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-305c6e1f-7b42-4bae-81b5-0d88afc2709d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '447e5057818c4313b01342b3c548f7cd', 'request_id': 'req-305c6e1f-7b42-4bae-81b5-0d88afc2709d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:57.135939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-305c6e1f-7b42-4bae-81b5-0d88afc2709d admin admin] The token cache is being invalidate because project 447e5057818c4313b01342b3c548f7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:34:57.136231 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-305c6e1f-7b42-4bae-81b5-0d88afc2709d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:57.137520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-305c6e1f-7b42-4bae-81b5-0d88afc2709d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:34:57.139445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1050/2080] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:34:56 2022] DELETE /identity/v3/projects/447e5057818c4313b01342b3c548f7cd => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:57.146612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5b91-92b8-43db-91cf-f61da95e5e87 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:57.147527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5b91-92b8-43db-91cf-f61da95e5e87 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:57.147527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca5b91-92b8-43db-91cf-f61da95e5e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:57.167601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-aaca5b91-92b8-43db-91cf-f61da95e5e87 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:57.169136 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-aaca5b91-92b8-43db-91cf-f61da95e5e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:57.251056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1031/2081] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:57.261566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e9b2-cbb5-4d45-ab67-9e6218269fe1 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:57.261857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e9b2-cbb5-4d45-ab67-9e6218269fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:57.262141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e9b2-cbb5-4d45-ab67-9e6218269fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:57.285890 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-17c3e9b2-cbb5-4d45-ab67-9e6218269fe1 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:57.287101 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-17c3e9b2-cbb5-4d45-ab67-9e6218269fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:57.299582 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1051/2082] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:34:57.309114 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca5b91-92b8-43db-91cf-f61da95e5e87 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:57.319439 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca5b91-92b8-43db-91cf-f61da95e5e87 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:57.324905 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7f0c7-6559-4e15-b2d6-5c7b77164781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:57.325435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7f0c7-6559-4e15-b2d6-5c7b77164781 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:57.325720 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7f0c7-6559-4e15-b2d6-5c7b77164781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:57.326078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7f0c7-6559-4e15-b2d6-5c7b77164781 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:57.326734 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7f0c7-6559-4e15-b2d6-5c7b77164781 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:34:57.327204 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7f0c7-6559-4e15-b2d6-5c7b77164781 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:57.329150 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7f0c7-6559-4e15-b2d6-5c7b77164781 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:57.346766 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1032/2083] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:34:57.348984 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3e9b2-cbb5-4d45-ab67-9e6218269fe1 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:57.358677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3e9b2-cbb5-4d45-ab67-9e6218269fe1 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:57.365483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160e20e-aeab-417b-8175-258dd414e028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:57.366216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160e20e-aeab-417b-8175-258dd414e028 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:57.366565 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160e20e-aeab-417b-8175-258dd414e028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:57.366846 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160e20e-aeab-417b-8175-258dd414e028 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:57.367589 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160e20e-aeab-417b-8175-258dd414e028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:57.369549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160e20e-aeab-417b-8175-258dd414e028 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:57.487356 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1052/2084] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:57 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:57.489605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7f0c7-6559-4e15-b2d6-5c7b77164781 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:57.500711 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7f0c7-6559-4e15-b2d6-5c7b77164781 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:57.568667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db84aea-2eff-46f2-a192-c906d767b3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:57.569639 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db84aea-2eff-46f2-a192-c906d767b3ae admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:57.569922 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db84aea-2eff-46f2-a192-c906d767b3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:57.570255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db84aea-2eff-46f2-a192-c906d767b3ae admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:57.571271 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db84aea-2eff-46f2-a192-c906d767b3ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:57.573107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db84aea-2eff-46f2-a192-c906d767b3ae admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:57.650366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1033/2085] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:57 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:57.654434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160e20e-aeab-417b-8175-258dd414e028 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:57.664954 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160e20e-aeab-417b-8175-258dd414e028 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:57.669684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a51aa-b577-4aa1-b350-f0d3df8054c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:57.670322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a51aa-b577-4aa1-b350-f0d3df8054c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:57.670603 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a51aa-b577-4aa1-b350-f0d3df8054c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:57.670878 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a51aa-b577-4aa1-b350-f0d3df8054c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:57.671649 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a51aa-b577-4aa1-b350-f0d3df8054c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:57.673244 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a51aa-b577-4aa1-b350-f0d3df8054c6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:57.685314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1053/2086] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:57.689450 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db84aea-2eff-46f2-a192-c906d767b3ae admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:57.702992 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db84aea-2eff-46f2-a192-c906d767b3ae admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:57.707698 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c74bfc-9836-43b7-865c-df752a251bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:57.708344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c74bfc-9836-43b7-865c-df752a251bdb admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:57.708622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c74bfc-9836-43b7-865c-df752a251bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:57.708893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c74bfc-9836-43b7-865c-df752a251bdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:57.709627 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c74bfc-9836-43b7-865c-df752a251bdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:57.711444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c74bfc-9836-43b7-865c-df752a251bdb admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:57.724777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1034/2087] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:57.725862 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a51aa-b577-4aa1-b350-f0d3df8054c6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:57.735678 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a51aa-b577-4aa1-b350-f0d3df8054c6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:57.741406 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c86d1-2d17-4e86-908c-aaf60aab6f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:57.742213 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c86d1-2d17-4e86-908c-aaf60aab6f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:57.742494 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c86d1-2d17-4e86-908c-aaf60aab6f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:57.742768 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c86d1-2d17-4e86-908c-aaf60aab6f9a admin admin] PATH_INFO: `/v3/projects/61669c2646344e13905313c633d3256f/users/7e524e5403cf4b41bb4c16b52dd2d37d/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:57.758101 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c86d1-2d17-4e86-908c-aaf60aab6f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=61669c2646344e13905313c633d3256f, user_id=7e524e5403cf4b41bb4c16b52dd2d37d, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:57.760825 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c86d1-2d17-4e86-908c-aaf60aab6f9a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:57.827323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1054/2088] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:57 2022] PUT /identity/v3/projects/61669c2646344e13905313c633d3256f/users/7e524e5403cf4b41bb4c16b52dd2d37d/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:57.840206 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6b05-595a-4cdd-b545-bf8cf6f9001d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:57.840475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6b05-595a-4cdd-b545-bf8cf6f9001d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:57.840785 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bc6b05-595a-4cdd-b545-bf8cf6f9001d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:57.867877 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-e2bc6b05-595a-4cdd-b545-bf8cf6f9001d None None] MFA Rules not processed for user `7e524e5403cf4b41bb4c16b52dd2d37d`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:57.869075 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e2bc6b05-595a-4cdd-b545-bf8cf6f9001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:57.931102 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1035/2089] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:57.935675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c86d1-2d17-4e86-908c-aaf60aab6f9a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:57.998302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c86d1-2d17-4e86-908c-aaf60aab6f9a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:58.003393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45269b29-89d4-493b-a118-eefe392f9663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:58.004143 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45269b29-89d4-493b-a118-eefe392f9663 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:58.004416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45269b29-89d4-493b-a118-eefe392f9663 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:58.004791 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45269b29-89d4-493b-a118-eefe392f9663 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:58.005497 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45269b29-89d4-493b-a118-eefe392f9663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:58.007499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45269b29-89d4-493b-a118-eefe392f9663 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:58.078999 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1055/2090] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:34:57 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:58.083316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc6b05-595a-4cdd-b545-bf8cf6f9001d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:58.093785 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bc6b05-595a-4cdd-b545-bf8cf6f9001d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:58.151685 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fef71b-6de5-46c9-813d-998092f35ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:58.152393 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fef71b-6de5-46c9-813d-998092f35ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:58.152632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fef71b-6de5-46c9-813d-998092f35ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:58.152907 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fef71b-6de5-46c9-813d-998092f35ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:58.153610 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fef71b-6de5-46c9-813d-998092f35ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:58.155544 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fef71b-6de5-46c9-813d-998092f35ac4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:58.220442 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1036/2091] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:34:58 2022] POST /identity/v3/users => generated 299 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:34:58.225303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45269b29-89d4-493b-a118-eefe392f9663 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:58.235832 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45269b29-89d4-493b-a118-eefe392f9663 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:58.240706 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378429a-806d-4469-b4a3-3650405cb2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:58.241359 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378429a-806d-4469-b4a3-3650405cb2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:58.241639 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378429a-806d-4469-b4a3-3650405cb2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:58.241992 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378429a-806d-4469-b4a3-3650405cb2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:58.242710 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378429a-806d-4469-b4a3-3650405cb2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:58.244376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378429a-806d-4469-b4a3-3650405cb2e4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:58.254955 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1056/2092] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:58.259005 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fef71b-6de5-46c9-813d-998092f35ac4 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:58.269434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fef71b-6de5-46c9-813d-998092f35ac4 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:58.275488 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9794e-5ba2-4ba0-9b13-39d9f15a346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:58.277373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9794e-5ba2-4ba0-9b13-39d9f15a346d admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:58.277373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9794e-5ba2-4ba0-9b13-39d9f15a346d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:58.277373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9794e-5ba2-4ba0-9b13-39d9f15a346d admin admin] PATH_INFO: `/v3/projects/ff72dfbc416d4dd79f1d646b8def7a72/users/a00e928b0e2f40c48b1a0a02aa45a3a2/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:58.292573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9794e-5ba2-4ba0-9b13-39d9f15a346d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff72dfbc416d4dd79f1d646b8def7a72, user_id=a00e928b0e2f40c48b1a0a02aa45a3a2, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:58.295339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9794e-5ba2-4ba0-9b13-39d9f15a346d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:58.359407 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1037/2093] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:58 2022] PUT /identity/v3/projects/ff72dfbc416d4dd79f1d646b8def7a72/users/a00e928b0e2f40c48b1a0a02aa45a3a2/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:34:58.363408 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378429a-806d-4469-b4a3-3650405cb2e4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:58.373654 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378429a-806d-4469-b4a3-3650405cb2e4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:58.433800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c4f40-8162-4a25-8bd8-d58d0168c477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:58.433800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c4f40-8162-4a25-8bd8-d58d0168c477 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:58.433800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c4f40-8162-4a25-8bd8-d58d0168c477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:58.433800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c4f40-8162-4a25-8bd8-d58d0168c477 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:58.434169 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c4f40-8162-4a25-8bd8-d58d0168c477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:58.434169 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7c4f40-8162-4a25-8bd8-d58d0168c477 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:58.443659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1057/2094] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:34:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:34:58.448086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9794e-5ba2-4ba0-9b13-39d9f15a346d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:58.459627 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9794e-5ba2-4ba0-9b13-39d9f15a346d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:58.464728 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2abe8a-dfbc-4502-bbce-e5eeafe7f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:58.469970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2abe8a-dfbc-4502-bbce-e5eeafe7f6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:58.469970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2abe8a-dfbc-4502-bbce-e5eeafe7f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:58.469970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2abe8a-dfbc-4502-bbce-e5eeafe7f6a4 admin admin] PATH_INFO: `/v3/projects/ff72dfbc416d4dd79f1d646b8def7a72/users/a00e928b0e2f40c48b1a0a02aa45a3a2/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:58.469970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2abe8a-dfbc-4502-bbce-e5eeafe7f6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff72dfbc416d4dd79f1d646b8def7a72, user_id=a00e928b0e2f40c48b1a0a02aa45a3a2, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:58.471085 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2abe8a-dfbc-4502-bbce-e5eeafe7f6a4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:58.485575 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1038/2095] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:34:58 2022] PUT /identity/v3/projects/ff72dfbc416d4dd79f1d646b8def7a72/users/a00e928b0e2f40c48b1a0a02aa45a3a2/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:34:58.496777 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a6b73-a961-45ee-a2c4-57929fc73dc0 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:58.497065 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a6b73-a961-45ee-a2c4-57929fc73dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:58.497395 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a6b73-a961-45ee-a2c4-57929fc73dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:58.529634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-aa0a6b73-a961-45ee-a2c4-57929fc73dc0 None None] MFA Rules not processed for user `a00e928b0e2f40c48b1a0a02aa45a3a2`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:34:58.530691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-aa0a6b73-a961-45ee-a2c4-57929fc73dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:58.608126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1058/2096] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:34:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:34:58.621844 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2abe8a-dfbc-4502-bbce-e5eeafe7f6a4 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:58.623832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2f2abe8a-dfbc-4502-bbce-e5eeafe7f6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:34:58.683608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2abe8a-dfbc-4502-bbce-e5eeafe7f6a4 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:58.688386 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4482c-f13d-45dd-b460-b17c1a96dc60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:58.690039 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4482c-f13d-45dd-b460-b17c1a96dc60 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:58.690331 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4482c-f13d-45dd-b460-b17c1a96dc60 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:58.690611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4482c-f13d-45dd-b460-b17c1a96dc60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:58.704341 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4482c-f13d-45dd-b460-b17c1a96dc60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:58.705786 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4482c-f13d-45dd-b460-b17c1a96dc60 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:34:58.716338 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1039/2097] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:34:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:34:59.754430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a6b73-a961-45ee-a2c4-57929fc73dc0 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:34:59.822064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a6b73-a961-45ee-a2c4-57929fc73dc0 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:34:59.826994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078494e-adc1-446a-87b6-ecef76bb860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:34:59.827880 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078494e-adc1-446a-87b6-ecef76bb860b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:34:59.830428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078494e-adc1-446a-87b6-ecef76bb860b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:34:59.830428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078494e-adc1-446a-87b6-ecef76bb860b admin admin] PATH_INFO: `/v3/users/7e524e5403cf4b41bb4c16b52dd2d37d` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:34:59.830428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078494e-adc1-446a-87b6-ecef76bb860b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e524e5403cf4b41bb4c16b52dd2d37d)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:34:59.832272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078494e-adc1-446a-87b6-ecef76bb860b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:00.056716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1078494e-adc1-446a-87b6-ecef76bb860b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e524e5403cf4b41bb4c16b52dd2d37d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:00.057365 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1078494e-adc1-446a-87b6-ecef76bb860b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e524e5403cf4b41bb4c16b52dd2d37d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:00.057981 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1078494e-adc1-446a-87b6-ecef76bb860b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e524e5403cf4b41bb4c16b52dd2d37d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:00.069762 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1078494e-adc1-446a-87b6-ecef76bb860b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e524e5403cf4b41bb4c16b52dd2d37d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:00.076536 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1078494e-adc1-446a-87b6-ecef76bb860b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e524e5403cf4b41bb4c16b52dd2d37d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:00.301612 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1059/2098] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:34:59 2022] DELETE /identity/v3/users/7e524e5403cf4b41bb4c16b52dd2d37d => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:00.421583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5892f5b-ad61-42b6-89c6-f683b966aaf4 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:00.421583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5892f5b-ad61-42b6-89c6-f683b966aaf4 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:00.421583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5892f5b-ad61-42b6-89c6-f683b966aaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:00.439685 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-f5892f5b-ad61-42b6-89c6-f683b966aaf4 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:00.440920 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f5892f5b-ad61-42b6-89c6-f683b966aaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:00.498358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1040/2099] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:00.508405 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078494e-adc1-446a-87b6-ecef76bb860b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:00.509832 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1078494e-adc1-446a-87b6-ecef76bb860b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:00.570600 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078494e-adc1-446a-87b6-ecef76bb860b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:00.575868 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f790a97-94cc-4853-85f6-ca62d3e8b9d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:00.576739 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f790a97-94cc-4853-85f6-ca62d3e8b9d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:00.578117 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f790a97-94cc-4853-85f6-ca62d3e8b9d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:00.578400 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f790a97-94cc-4853-85f6-ca62d3e8b9d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:00.588247 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f790a97-94cc-4853-85f6-ca62d3e8b9d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:00.589691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f790a97-94cc-4853-85f6-ca62d3e8b9d0 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:00.599678 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1060/2100] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:35:00.987555 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5892f5b-ad61-42b6-89c6-f683b966aaf4 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:00.990502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f5892f5b-ad61-42b6-89c6-f683b966aaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:01.005152 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5892f5b-ad61-42b6-89c6-f683b966aaf4 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:01.009753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:01.011300 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:01.011300 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:01.011300 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] PATH_INFO: `/v3/projects/61669c2646344e13905313c633d3256f` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:01.012446 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61669c2646344e13905313c633d3256f)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:01.014447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:01.141419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61669c2646344e13905313c633d3256f', 'request_id': 'req-7d7761d2-5df7-40f1-865e-1cd61899b393'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:01.148911 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61669c2646344e13905313c633d3256f', 'request_id': 'req-7d7761d2-5df7-40f1-865e-1cd61899b393'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:01.154286 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61669c2646344e13905313c633d3256f', 'request_id': 'req-7d7761d2-5df7-40f1-865e-1cd61899b393'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:01.237445 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] The token cache is being invalidate because project 61669c2646344e13905313c633d3256f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:01.237762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:01.238493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:01.240120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1041/2101] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:00 2022] DELETE /identity/v3/projects/61669c2646344e13905313c633d3256f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:01.244110 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f790a97-94cc-4853-85f6-ca62d3e8b9d0 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:01.254271 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f790a97-94cc-4853-85f6-ca62d3e8b9d0 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:01.314334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce556c7b-f8b9-4f78-8c4a-a68f4738fc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:01.315218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce556c7b-f8b9-4f78-8c4a-a68f4738fc3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:01.315529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce556c7b-f8b9-4f78-8c4a-a68f4738fc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:01.315799 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce556c7b-f8b9-4f78-8c4a-a68f4738fc3e admin admin] PATH_INFO: `/v3/users/a00e928b0e2f40c48b1a0a02aa45a3a2` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:01.317044 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce556c7b-f8b9-4f78-8c4a-a68f4738fc3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00e928b0e2f40c48b1a0a02aa45a3a2)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:01.318980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce556c7b-f8b9-4f78-8c4a-a68f4738fc3e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:01.450214 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ce556c7b-f8b9-4f78-8c4a-a68f4738fc3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00e928b0e2f40c48b1a0a02aa45a3a2'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:01.450848 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ce556c7b-f8b9-4f78-8c4a-a68f4738fc3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00e928b0e2f40c48b1a0a02aa45a3a2'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:01.451482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ce556c7b-f8b9-4f78-8c4a-a68f4738fc3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00e928b0e2f40c48b1a0a02aa45a3a2'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:01.464009 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ce556c7b-f8b9-4f78-8c4a-a68f4738fc3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00e928b0e2f40c48b1a0a02aa45a3a2'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:01.470507 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ce556c7b-f8b9-4f78-8c4a-a68f4738fc3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00e928b0e2f40c48b1a0a02aa45a3a2'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:01.523754 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1061/2102] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:35:01 2022] DELETE /identity/v3/users/a00e928b0e2f40c48b1a0a02aa45a3a2 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:01.643636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:01.645843 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:01.663183 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7761d2-5df7-40f1-865e-1cd61899b393 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:01.745308 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ff276-29e6-4456-8d33-ccfc2533f50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:01.746316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ff276-29e6-4456-8d33-ccfc2533f50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:01.746593 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ff276-29e6-4456-8d33-ccfc2533f50d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:01.746864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ff276-29e6-4456-8d33-ccfc2533f50d admin admin] PATH_INFO: `/v3/users/09a22a90e63a4747bf2562f3b2118d7a` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:01.748220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ff276-29e6-4456-8d33-ccfc2533f50d admin admin] RBAC: Authorizing `identity:delete_user(user_id=09a22a90e63a4747bf2562f3b2118d7a)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:01.750778 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ff276-29e6-4456-8d33-ccfc2533f50d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:01.896438 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce556c7b-f8b9-4f78-8c4a-a68f4738fc3e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:01.898203 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ce556c7b-f8b9-4f78-8c4a-a68f4738fc3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:01.911527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce556c7b-f8b9-4f78-8c4a-a68f4738fc3e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:01.916574 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ced42-695c-4d87-9a44-4ce5e4e46814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:01.917855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ced42-695c-4d87-9a44-4ce5e4e46814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:01.918138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ced42-695c-4d87-9a44-4ce5e4e46814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:01.918757 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ced42-695c-4d87-9a44-4ce5e4e46814 admin admin] PATH_INFO: `/v3/projects/ff72dfbc416d4dd79f1d646b8def7a72` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:01.926610 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ced42-695c-4d87-9a44-4ce5e4e46814 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff72dfbc416d4dd79f1d646b8def7a72)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:01.926610 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ced42-695c-4d87-9a44-4ce5e4e46814 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:01.959337 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2f4ff276-29e6-4456-8d33-ccfc2533f50d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a22a90e63a4747bf2562f3b2118d7a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:01.959993 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2f4ff276-29e6-4456-8d33-ccfc2533f50d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a22a90e63a4747bf2562f3b2118d7a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:01.960702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2f4ff276-29e6-4456-8d33-ccfc2533f50d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a22a90e63a4747bf2562f3b2118d7a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:01.977258 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2f4ff276-29e6-4456-8d33-ccfc2533f50d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a22a90e63a4747bf2562f3b2118d7a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:01.980694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2f4ff276-29e6-4456-8d33-ccfc2533f50d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a22a90e63a4747bf2562f3b2118d7a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:02.048781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-972ced42-695c-4d87-9a44-4ce5e4e46814 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff72dfbc416d4dd79f1d646b8def7a72', 'request_id': 'req-972ced42-695c-4d87-9a44-4ce5e4e46814'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:02.067252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1042/2103] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:35:01 2022] DELETE /identity/v3/users/09a22a90e63a4747bf2562f3b2118d7a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:02.071731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b2a70-ee50-4c54-b4eb-23068d74b3c0 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:02.072021 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b2a70-ee50-4c54-b4eb-23068d74b3c0 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:02.072299 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b2a70-ee50-4c54-b4eb-23068d74b3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:02.089373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-ff3b2a70-ee50-4c54-b4eb-23068d74b3c0 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:02.090615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ff3b2a70-ee50-4c54-b4eb-23068d74b3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:02.148534 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1043/2104] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:02.163726 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b2a70-ee50-4c54-b4eb-23068d74b3c0 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:02.166912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ff3b2a70-ee50-4c54-b4eb-23068d74b3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:02.174264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-972ced42-695c-4d87-9a44-4ce5e4e46814 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff72dfbc416d4dd79f1d646b8def7a72', 'request_id': 'req-972ced42-695c-4d87-9a44-4ce5e4e46814'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:02.181778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-972ced42-695c-4d87-9a44-4ce5e4e46814 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff72dfbc416d4dd79f1d646b8def7a72', 'request_id': 'req-972ced42-695c-4d87-9a44-4ce5e4e46814'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:02.194538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-972ced42-695c-4d87-9a44-4ce5e4e46814 admin admin] The token cache is being invalidate because project ff72dfbc416d4dd79f1d646b8def7a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:02.194889 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-972ced42-695c-4d87-9a44-4ce5e4e46814 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:02.195606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-972ced42-695c-4d87-9a44-4ce5e4e46814 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:02.197444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1062/2105] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:01 2022] DELETE /identity/v3/projects/ff72dfbc416d4dd79f1d646b8def7a72 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:02.201807 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f0212-920d-4cef-a8f6-b2e87cba004b None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:02.202159 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f0212-920d-4cef-a8f6-b2e87cba004b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:02.202503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f0212-920d-4cef-a8f6-b2e87cba004b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:02.222026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-381f0212-920d-4cef-a8f6-b2e87cba004b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:02.223505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-381f0212-920d-4cef-a8f6-b2e87cba004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:02.231993 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b2a70-ee50-4c54-b4eb-23068d74b3c0 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:02.238467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4205dc6-82f9-48f4-838e-be6a5539e100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:02.239172 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4205dc6-82f9-48f4-838e-be6a5539e100 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:02.239666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4205dc6-82f9-48f4-838e-be6a5539e100 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:02.240053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4205dc6-82f9-48f4-838e-be6a5539e100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:02.242244 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e4205dc6-82f9-48f4-838e-be6a5539e100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:02.254590 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1063/2106] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:02.257519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4205dc6-82f9-48f4-838e-be6a5539e100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:02.260498 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4205dc6-82f9-48f4-838e-be6a5539e100 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:02.262186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93843cb4-41f1-4203-b0e4-9c8d4d25d63a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:02.262680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93843cb4-41f1-4203-b0e4-9c8d4d25d63a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:02.263160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93843cb4-41f1-4203-b0e4-9c8d4d25d63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:02.274451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1044/2107] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:35:02.287369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-93843cb4-41f1-4203-b0e4-9c8d4d25d63a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:02.289024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-93843cb4-41f1-4203-b0e4-9c8d4d25d63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:02.298224 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1064/2108] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:02.305579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4205dc6-82f9-48f4-838e-be6a5539e100 service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:02.314239 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4205dc6-82f9-48f4-838e-be6a5539e100 service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:02.319074 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e614-6abd-469e-9068-087c38baa11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:02.319764 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e614-6abd-469e-9068-087c38baa11c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:02.320110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e614-6abd-469e-9068-087c38baa11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:02.320309 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2744e614-6abd-469e-9068-087c38baa11c admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:02.321277 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744e614-6abd-469e-9068-087c38baa11c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:35:02.321390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744e614-6abd-469e-9068-087c38baa11c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:02.323052 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2744e614-6abd-469e-9068-087c38baa11c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:02.334921 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1045/2109] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:35:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:35:02.339085 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93843cb4-41f1-4203-b0e4-9c8d4d25d63a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:02.349867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93843cb4-41f1-4203-b0e4-9c8d4d25d63a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:02.355965 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97da8c-fed3-48d7-91f2-b64cd5a474c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:02.356784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97da8c-fed3-48d7-91f2-b64cd5a474c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:02.357294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97da8c-fed3-48d7-91f2-b64cd5a474c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:02.357562 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97da8c-fed3-48d7-91f2-b64cd5a474c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:02.358964 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97da8c-fed3-48d7-91f2-b64cd5a474c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:02.361174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97da8c-fed3-48d7-91f2-b64cd5a474c8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:02.455673 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1065/2110] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:02 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:02.459805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e614-6abd-469e-9068-087c38baa11c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:02.469929 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2744e614-6abd-469e-9068-087c38baa11c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:02.536601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3deecda-f34c-4d20-a489-9b068875125a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:02.537427 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deecda-f34c-4d20-a489-9b068875125a admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:02.537523 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deecda-f34c-4d20-a489-9b068875125a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:02.537763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3deecda-f34c-4d20-a489-9b068875125a admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:02.538494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3deecda-f34c-4d20-a489-9b068875125a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:02.540669 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3deecda-f34c-4d20-a489-9b068875125a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:02.607602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1046/2111] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:02 2022] POST /identity/v3/users => generated 290 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:02.611819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97da8c-fed3-48d7-91f2-b64cd5a474c8 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:02.623196 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97da8c-fed3-48d7-91f2-b64cd5a474c8 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:02.628118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7532394-a71d-4c60-a8e7-9524e8af242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:02.629054 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7532394-a71d-4c60-a8e7-9524e8af242b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:02.629340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7532394-a71d-4c60-a8e7-9524e8af242b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:02.629622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7532394-a71d-4c60-a8e7-9524e8af242b admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:02.630373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7532394-a71d-4c60-a8e7-9524e8af242b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:02.632118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7532394-a71d-4c60-a8e7-9524e8af242b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:02.643496 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1066/2112] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:02.648544 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3deecda-f34c-4d20-a489-9b068875125a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:02.659214 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3deecda-f34c-4d20-a489-9b068875125a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:02.664738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45deaf21-a236-4e7b-a8a0-31b33a4b3fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:02.665413 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deaf21-a236-4e7b-a8a0-31b33a4b3fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:02.665701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deaf21-a236-4e7b-a8a0-31b33a4b3fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:02.665970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45deaf21-a236-4e7b-a8a0-31b33a4b3fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:02.666720 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45deaf21-a236-4e7b-a8a0-31b33a4b3fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:02.668350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45deaf21-a236-4e7b-a8a0-31b33a4b3fc7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:02.683802 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1047/2113] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:02.685396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7532394-a71d-4c60-a8e7-9524e8af242b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:02.696134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7532394-a71d-4c60-a8e7-9524e8af242b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:02.700843 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad7ac9-7dd9-4976-bb88-8faf2348bc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:02.701735 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad7ac9-7dd9-4976-bb88-8faf2348bc5e admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:02.702046 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad7ac9-7dd9-4976-bb88-8faf2348bc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:02.702318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbad7ac9-7dd9-4976-bb88-8faf2348bc5e admin admin] PATH_INFO: `/v3/projects/24961ca6b98c4c3a87f58d681ae52b1e/users/72cf085a0c654ef59d249a4d1b92ffea/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:02.718505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad7ac9-7dd9-4976-bb88-8faf2348bc5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24961ca6b98c4c3a87f58d681ae52b1e, user_id=72cf085a0c654ef59d249a4d1b92ffea, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:02.721205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbad7ac9-7dd9-4976-bb88-8faf2348bc5e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:02.820571 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1067/2114] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:02 2022] PUT /identity/v3/projects/24961ca6b98c4c3a87f58d681ae52b1e/users/72cf085a0c654ef59d249a4d1b92ffea/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:02.831641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26eb33-7be9-4d65-b551-9a44a4afeb89 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:02.831641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26eb33-7be9-4d65-b551-9a44a4afeb89 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:02.831641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26eb33-7be9-4d65-b551-9a44a4afeb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:02.862153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-2a26eb33-7be9-4d65-b551-9a44a4afeb89 None None] MFA Rules not processed for user `72cf085a0c654ef59d249a4d1b92ffea`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:02.863438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2a26eb33-7be9-4d65-b551-9a44a4afeb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:02.924731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad7ac9-7dd9-4976-bb88-8faf2348bc5e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:02.926751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1048/2115] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:02.930299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-dbad7ac9-7dd9-4976-bb88-8faf2348bc5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:02.931342 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26eb33-7be9-4d65-b551-9a44a4afeb89 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:02.996503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26eb33-7be9-4d65-b551-9a44a4afeb89 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:02.996704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbad7ac9-7dd9-4976-bb88-8faf2348bc5e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:03.001108 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76079a-a896-4a26-8e9e-4f98d3b0bc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:03.001745 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76079a-a896-4a26-8e9e-4f98d3b0bc6e admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.001983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb83b00-4f71-42fe-8124-3bd379a13289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:03.002118 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76079a-a896-4a26-8e9e-4f98d3b0bc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.002293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76079a-a896-4a26-8e9e-4f98d3b0bc6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.002999 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76079a-a896-4a26-8e9e-4f98d3b0bc6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:03.003385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83b00-4f71-42fe-8124-3bd379a13289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.003832 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83b00-4f71-42fe-8124-3bd379a13289 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.004290 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83b00-4f71-42fe-8124-3bd379a13289 admin admin] PATH_INFO: `/v3/projects/0b12ef94a576449fbb26437d05ad0b9e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.005010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76079a-a896-4a26-8e9e-4f98d3b0bc6e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:03.007110 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb83b00-4f71-42fe-8124-3bd379a13289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b12ef94a576449fbb26437d05ad0b9e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:03.013666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb83b00-4f71-42fe-8124-3bd379a13289 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:03.107635 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1049/2116] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:02 2022] POST /identity/v3/projects => generated 381 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:03.111674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76079a-a896-4a26-8e9e-4f98d3b0bc6e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:03.129971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fcb83b00-4f71-42fe-8124-3bd379a13289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b12ef94a576449fbb26437d05ad0b9e', 'request_id': 'req-fcb83b00-4f71-42fe-8124-3bd379a13289'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:03.173586 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76079a-a896-4a26-8e9e-4f98d3b0bc6e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:03.209738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fcb83b00-4f71-42fe-8124-3bd379a13289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b12ef94a576449fbb26437d05ad0b9e', 'request_id': 'req-fcb83b00-4f71-42fe-8124-3bd379a13289'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:03.215755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fcb83b00-4f71-42fe-8124-3bd379a13289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b12ef94a576449fbb26437d05ad0b9e', 'request_id': 'req-fcb83b00-4f71-42fe-8124-3bd379a13289'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:03.227380 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fcb83b00-4f71-42fe-8124-3bd379a13289 admin admin] The token cache is being invalidate because project 0b12ef94a576449fbb26437d05ad0b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:03.227850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fcb83b00-4f71-42fe-8124-3bd379a13289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:03.228637 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fcb83b00-4f71-42fe-8124-3bd379a13289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:03.231012 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1068/2117] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:02 2022] DELETE /identity/v3/projects/0b12ef94a576449fbb26437d05ad0b9e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:03.234386 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d8c99-1d6d-48a1-b8dd-3844fb5615ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:03.235125 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d8c99-1d6d-48a1-b8dd-3844fb5615ab admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.235438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d8c99-1d6d-48a1-b8dd-3844fb5615ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.235713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d8c99-1d6d-48a1-b8dd-3844fb5615ab admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.236454 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d8c99-1d6d-48a1-b8dd-3844fb5615ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:03.238534 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09d8c99-1d6d-48a1-b8dd-3844fb5615ab admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:03.239082 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae9480-a440-4846-9815-02852998445f None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.239493 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae9480-a440-4846-9815-02852998445f None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.239893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae9480-a440-4846-9815-02852998445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.258803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-ffae9480-a440-4846-9815-02852998445f None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:03.259914 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ffae9480-a440-4846-9815-02852998445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:03.267738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1069/2118] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:03.276410 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58245423-81c8-4b36-bf99-a01f6b387e6f None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.276702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58245423-81c8-4b36-bf99-a01f6b387e6f None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.276995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58245423-81c8-4b36-bf99-a01f6b387e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.294691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-58245423-81c8-4b36-bf99-a01f6b387e6f None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:03.295901 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-58245423-81c8-4b36-bf99-a01f6b387e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:03.303428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1050/2119] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:03 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:35:03.308035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1070/2120] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:03.308162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d8c99-1d6d-48a1-b8dd-3844fb5615ab admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:03.308162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b09d8c99-1d6d-48a1-b8dd-3844fb5615ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:03.310668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58245423-81c8-4b36-bf99-a01f6b387e6f None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:03.318311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d8c99-1d6d-48a1-b8dd-3844fb5615ab admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:03.320093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58245423-81c8-4b36-bf99-a01f6b387e6f None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:03.323347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f24ad-ab2a-453f-9fb6-f0ac92b71f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:03.324023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f24ad-ab2a-453f-9fb6-f0ac92b71f9f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.324303 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f24ad-ab2a-453f-9fb6-f0ac92b71f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.324579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f24ad-ab2a-453f-9fb6-f0ac92b71f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.324760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659362b-571d-4802-9c62-fc2cbbaf18b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:03.325318 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f24ad-ab2a-453f-9fb6-f0ac92b71f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:03.325432 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659362b-571d-4802-9c62-fc2cbbaf18b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.325662 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659362b-571d-4802-9c62-fc2cbbaf18b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.325936 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659362b-571d-4802-9c62-fc2cbbaf18b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.326665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659362b-571d-4802-9c62-fc2cbbaf18b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:35:03.326917 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f24ad-ab2a-453f-9fb6-f0ac92b71f9f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:03.327020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659362b-571d-4802-9c62-fc2cbbaf18b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:03.328567 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659362b-571d-4802-9c62-fc2cbbaf18b4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:03.339494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1051/2121] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:35:03.341714 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1071/2122] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:35:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:35:03.343481 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f24ad-ab2a-453f-9fb6-f0ac92b71f9f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:03.346347 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659362b-571d-4802-9c62-fc2cbbaf18b4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:03.354114 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f24ad-ab2a-453f-9fb6-f0ac92b71f9f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:03.356363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659362b-571d-4802-9c62-fc2cbbaf18b4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:03.359043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d472f-fea1-42e5-ac38-902de1545686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:03.361942 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d472f-fea1-42e5-ac38-902de1545686 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.362225 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d472f-fea1-42e5-ac38-902de1545686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.362503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d472f-fea1-42e5-ac38-902de1545686 admin admin] PATH_INFO: `/v3/projects/c1c01edd9eea4d678a131639a7bd9025/users/46cb55c747bf4457936341d0bfe2e362/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.372634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ae1b5-007d-4630-8ceb-99ae6fba3ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:03.373300 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae1b5-007d-4630-8ceb-99ae6fba3ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.373624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae1b5-007d-4630-8ceb-99ae6fba3ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.375404 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae1b5-007d-4630-8ceb-99ae6fba3ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.376123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ae1b5-007d-4630-8ceb-99ae6fba3ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:03.378028 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ae1b5-007d-4630-8ceb-99ae6fba3ac4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:03.392217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d472f-fea1-42e5-ac38-902de1545686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c01edd9eea4d678a131639a7bd9025, user_id=46cb55c747bf4457936341d0bfe2e362, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:03.396234 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d472f-fea1-42e5-ac38-902de1545686 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:03.469267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1052/2123] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:03 2022] PUT /identity/v3/projects/c1c01edd9eea4d678a131639a7bd9025/users/46cb55c747bf4457936341d0bfe2e362/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:03.469572 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1072/2124] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:03 2022] POST /identity/v3/projects => generated 405 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:35:03.471315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d472f-fea1-42e5-ac38-902de1545686 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:03.474699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ae1b5-007d-4630-8ceb-99ae6fba3ac4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:03.550150 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d472f-fea1-42e5-ac38-902de1545686 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:03.550947 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ae1b5-007d-4630-8ceb-99ae6fba3ac4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:03.555318 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674bda9-78bf-4559-80a8-f94c3f213af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:03.555688 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff556cb-2943-47c2-bee4-552ace85d556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:03.556143 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674bda9-78bf-4559-80a8-f94c3f213af0 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.556342 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff556cb-2943-47c2-bee4-552ace85d556 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.556441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674bda9-78bf-4559-80a8-f94c3f213af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.556621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff556cb-2943-47c2-bee4-552ace85d556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.556719 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674bda9-78bf-4559-80a8-f94c3f213af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.556893 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff556cb-2943-47c2-bee4-552ace85d556 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.557436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674bda9-78bf-4559-80a8-f94c3f213af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:03.557618 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff556cb-2943-47c2-bee4-552ace85d556 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:03.559006 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674bda9-78bf-4559-80a8-f94c3f213af0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:03.559531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff556cb-2943-47c2-bee4-552ace85d556 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:03.572021 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1053/2125] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:35:03.573369 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674bda9-78bf-4559-80a8-f94c3f213af0 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:03.583212 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674bda9-78bf-4559-80a8-f94c3f213af0 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:03.587914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c51dd0-c5fa-47db-9b2c-f4654cec5838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:03.588758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c51dd0-c5fa-47db-9b2c-f4654cec5838 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.589039 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c51dd0-c5fa-47db-9b2c-f4654cec5838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.589316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c51dd0-c5fa-47db-9b2c-f4654cec5838 admin admin] PATH_INFO: `/v3/projects/c1c01edd9eea4d678a131639a7bd9025/users/46cb55c747bf4457936341d0bfe2e362/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.591315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c51dd0-c5fa-47db-9b2c-f4654cec5838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1c01edd9eea4d678a131639a7bd9025, user_id=46cb55c747bf4457936341d0bfe2e362, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:03.593904 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c51dd0-c5fa-47db-9b2c-f4654cec5838 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:03.604138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1054/2126] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:03 2022] PUT /identity/v3/projects/c1c01edd9eea4d678a131639a7bd9025/users/46cb55c747bf4457936341d0bfe2e362/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:03.615418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0944b-6aa9-4a6f-8b6b-2c7902f8b703 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.615709 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0944b-6aa9-4a6f-8b6b-2c7902f8b703 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.615987 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee0944b-6aa9-4a6f-8b6b-2c7902f8b703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.625825 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1073/2127] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:03 2022] POST /identity/v3/users => generated 303 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:03.630526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff556cb-2943-47c2-bee4-552ace85d556 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:03.641014 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff556cb-2943-47c2-bee4-552ace85d556 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:03.645352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-9ee0944b-6aa9-4a6f-8b6b-2c7902f8b703 None None] MFA Rules not processed for user `46cb55c747bf4457936341d0bfe2e362`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:03.650222 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9ee0944b-6aa9-4a6f-8b6b-2c7902f8b703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:03.698988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75275ef-2965-4608-b34c-abb7846c2ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:03.699698 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75275ef-2965-4608-b34c-abb7846c2ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.699977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75275ef-2965-4608-b34c-abb7846c2ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.700250 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75275ef-2965-4608-b34c-abb7846c2ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.700990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75275ef-2965-4608-b34c-abb7846c2ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:03.702600 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75275ef-2965-4608-b34c-abb7846c2ee2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:03.712480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1074/2128] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:35:03.714480 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1055/2129] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:03.718144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75275ef-2965-4608-b34c-abb7846c2ee2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:03.724168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0944b-6aa9-4a6f-8b6b-2c7902f8b703 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:03.725712 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9ee0944b-6aa9-4a6f-8b6b-2c7902f8b703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:03.727199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75275ef-2965-4608-b34c-abb7846c2ee2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:03.731959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9060f9-db2e-42ca-9755-b02f80056146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:03.732598 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9060f9-db2e-42ca-9755-b02f80056146 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.732877 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9060f9-db2e-42ca-9755-b02f80056146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.733149 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9060f9-db2e-42ca-9755-b02f80056146 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.733871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9060f9-db2e-42ca-9755-b02f80056146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:03.735528 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9060f9-db2e-42ca-9755-b02f80056146 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:03.750205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1075/2130] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:03.751604 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9060f9-db2e-42ca-9755-b02f80056146 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:03.762246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9060f9-db2e-42ca-9755-b02f80056146 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:03.766865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7cc04-2083-4bf8-aa31-1937d6245a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:03.767769 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7cc04-2083-4bf8-aa31-1937d6245a73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.768049 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7cc04-2083-4bf8-aa31-1937d6245a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.768323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7cc04-2083-4bf8-aa31-1937d6245a73 admin admin] PATH_INFO: `/v3/projects/c450269df98442f78a5c4579c21d13ef/users/504490e185174e0eaffb26d89ebf32ec/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.783995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7cc04-2083-4bf8-aa31-1937d6245a73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c450269df98442f78a5c4579c21d13ef, user_id=504490e185174e0eaffb26d89ebf32ec, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:03.784164 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee0944b-6aa9-4a6f-8b6b-2c7902f8b703 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:03.787103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7cc04-2083-4bf8-aa31-1937d6245a73 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:03.788692 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9158bf-fe5c-4c3e-8d1c-fcb8237b9559 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:03.789331 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9158bf-fe5c-4c3e-8d1c-fcb8237b9559 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.789609 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9158bf-fe5c-4c3e-8d1c-fcb8237b9559 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.789878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9158bf-fe5c-4c3e-8d1c-fcb8237b9559 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.799121 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9158bf-fe5c-4c3e-8d1c-fcb8237b9559 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:03.801132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9158bf-fe5c-4c3e-8d1c-fcb8237b9559 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:03.810629 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1056/2131] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:35:03.871585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1076/2132] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:03 2022] PUT /identity/v3/projects/c450269df98442f78a5c4579c21d13ef/users/504490e185174e0eaffb26d89ebf32ec/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:03.876647 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1714d-bb05-4d8c-b29f-466565867309 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:03.876931 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1714d-bb05-4d8c-b29f-466565867309 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:03.877203 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1714d-bb05-4d8c-b29f-466565867309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:03.893890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-45a1714d-bb05-4d8c-b29f-466565867309 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:03.895066 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-45a1714d-bb05-4d8c-b29f-466565867309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:03.957005 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1057/2133] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:03.966294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7cc04-2083-4bf8-aa31-1937d6245a73 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:03.968133 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-69f7cc04-2083-4bf8-aa31-1937d6245a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:04.047510 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7cc04-2083-4bf8-aa31-1937d6245a73 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:04.052679 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789ed39-7b9d-4955-a149-885a745890d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:04.053482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789ed39-7b9d-4955-a149-885a745890d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:04.053970 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789ed39-7b9d-4955-a149-885a745890d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:04.054301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789ed39-7b9d-4955-a149-885a745890d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:04.064919 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789ed39-7b9d-4955-a149-885a745890d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:04.066379 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789ed39-7b9d-4955-a149-885a745890d4 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:04.076312 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1077/2134] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:35:04.290517 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1714d-bb05-4d8c-b29f-466565867309 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:04.299876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1714d-bb05-4d8c-b29f-466565867309 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:04.305080 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a43fae-f0ac-4a51-bc74-a306d3eee77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:04.305926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a43fae-f0ac-4a51-bc74-a306d3eee77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:04.306253 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a43fae-f0ac-4a51-bc74-a306d3eee77a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:04.306513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a43fae-f0ac-4a51-bc74-a306d3eee77a admin admin] PATH_INFO: `/v3/users/72cf085a0c654ef59d249a4d1b92ffea` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:04.307742 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a43fae-f0ac-4a51-bc74-a306d3eee77a admin admin] RBAC: Authorizing `identity:delete_user(user_id=72cf085a0c654ef59d249a4d1b92ffea)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:04.309707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a43fae-f0ac-4a51-bc74-a306d3eee77a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:04.480296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d2a43fae-f0ac-4a51-bc74-a306d3eee77a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72cf085a0c654ef59d249a4d1b92ffea'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:04.480949 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d2a43fae-f0ac-4a51-bc74-a306d3eee77a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72cf085a0c654ef59d249a4d1b92ffea'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:04.481583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d2a43fae-f0ac-4a51-bc74-a306d3eee77a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72cf085a0c654ef59d249a4d1b92ffea'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:04.493942 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d2a43fae-f0ac-4a51-bc74-a306d3eee77a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72cf085a0c654ef59d249a4d1b92ffea'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:04.500875 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d2a43fae-f0ac-4a51-bc74-a306d3eee77a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72cf085a0c654ef59d249a4d1b92ffea'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:04.580217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1058/2135] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:35:04 2022] DELETE /identity/v3/users/72cf085a0c654ef59d249a4d1b92ffea => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:04.585526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546274-bcf3-4085-abab-95a44e2958df None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:04.586385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546274-bcf3-4085-abab-95a44e2958df None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:04.586728 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53546274-bcf3-4085-abab-95a44e2958df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:04.604954 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-53546274-bcf3-4085-abab-95a44e2958df None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:04.606178 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-53546274-bcf3-4085-abab-95a44e2958df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:04.674065 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1078/2136] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:04.687901 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a43fae-f0ac-4a51-bc74-a306d3eee77a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:04.689816 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d2a43fae-f0ac-4a51-bc74-a306d3eee77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:04.761053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a43fae-f0ac-4a51-bc74-a306d3eee77a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:04.766362 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9d767-d7a7-4da0-86e8-222b6d21779d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:04.771591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9d767-d7a7-4da0-86e8-222b6d21779d service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:04.772056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9d767-d7a7-4da0-86e8-222b6d21779d service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:04.772448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9d767-d7a7-4da0-86e8-222b6d21779d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:04.784216 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9d767-d7a7-4da0-86e8-222b6d21779d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:04.786395 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9d767-d7a7-4da0-86e8-222b6d21779d service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:04.797176 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1059/2137] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:35:05.240738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fe4dd-8c28-484c-85e8-fc1134402d02 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:05.241036 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fe4dd-8c28-484c-85e8-fc1134402d02 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:05.241323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fe4dd-8c28-484c-85e8-fc1134402d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:05.260494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9d767-d7a7-4da0-86e8-222b6d21779d service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:05.260494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-fde9d767-d7a7-4da0-86e8-222b6d21779d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:05.276138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9d767-d7a7-4da0-86e8-222b6d21779d service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:05.276691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-192fe4dd-8c28-484c-85e8-fc1134402d02 None None] MFA Rules not processed for user `504490e185174e0eaffb26d89ebf32ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:05.278109 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-192fe4dd-8c28-484c-85e8-fc1134402d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:05.288616 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:05.289483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:05.289760 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:05.290036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] PATH_INFO: `/v3/projects/24961ca6b98c4c3a87f58d681ae52b1e` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:05.291471 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24961ca6b98c4c3a87f58d681ae52b1e)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:05.299462 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:05.356299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1079/2138] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:05 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:05.360425 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fe4dd-8c28-484c-85e8-fc1134402d02 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:05.361841 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-192fe4dd-8c28-484c-85e8-fc1134402d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:05.375189 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fe4dd-8c28-484c-85e8-fc1134402d02 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:05.380304 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0bdcb-dfe5-487d-a43d-aa0e87119255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:05.380941 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0bdcb-dfe5-487d-a43d-aa0e87119255 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:05.381225 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0bdcb-dfe5-487d-a43d-aa0e87119255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:05.381500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0bdcb-dfe5-487d-a43d-aa0e87119255 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:05.382199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0bdcb-dfe5-487d-a43d-aa0e87119255 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:05.384131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0bdcb-dfe5-487d-a43d-aa0e87119255 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:05.392080 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24961ca6b98c4c3a87f58d681ae52b1e', 'request_id': 'req-77f32045-1544-461e-be1a-3f953421dfe9'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:05.399078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24961ca6b98c4c3a87f58d681ae52b1e', 'request_id': 'req-77f32045-1544-461e-be1a-3f953421dfe9'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:05.404370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24961ca6b98c4c3a87f58d681ae52b1e', 'request_id': 'req-77f32045-1544-461e-be1a-3f953421dfe9'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:05.484637 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1080/2139] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:05 2022] POST /identity/v3/projects => generated 403 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:35:05.490871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0bdcb-dfe5-487d-a43d-aa0e87119255 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:05.533882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] The token cache is being invalidate because project 24961ca6b98c4c3a87f58d681ae52b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:05.534170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:05.534810 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:05.536453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1060/2140] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:05 2022] DELETE /identity/v3/projects/24961ca6b98c4c3a87f58d681ae52b1e => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:05.540776 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:05.542336 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:05.553493 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0bdcb-dfe5-487d-a43d-aa0e87119255 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:05.558263 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a7ad0-bef3-45d4-9fcc-2399e0164ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:05.558920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a7ad0-bef3-45d4-9fcc-2399e0164ffd admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:05.559195 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a7ad0-bef3-45d4-9fcc-2399e0164ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:05.559499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a7ad0-bef3-45d4-9fcc-2399e0164ffd admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:05.560221 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a7ad0-bef3-45d4-9fcc-2399e0164ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:05.562175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a7ad0-bef3-45d4-9fcc-2399e0164ffd admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:05.604073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f32045-1544-461e-be1a-3f953421dfe9 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:05.608721 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e47730-351c-4335-9d50-fa7aba83ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:05.609490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e47730-351c-4335-9d50-fa7aba83ed5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:05.609764 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e47730-351c-4335-9d50-fa7aba83ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:05.610036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e47730-351c-4335-9d50-fa7aba83ed5c admin admin] PATH_INFO: `/v3/users/46cb55c747bf4457936341d0bfe2e362` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:05.611250 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e47730-351c-4335-9d50-fa7aba83ed5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=46cb55c747bf4457936341d0bfe2e362)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:05.613301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e47730-351c-4335-9d50-fa7aba83ed5c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:05.643413 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1081/2141] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:05 2022] POST /identity/v3/users => generated 308 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:05.648194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a7ad0-bef3-45d4-9fcc-2399e0164ffd admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:05.649784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c63a7ad0-bef3-45d4-9fcc-2399e0164ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:05.661892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a7ad0-bef3-45d4-9fcc-2399e0164ffd admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:05.666766 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf928efd-ca81-4cc8-8200-82d33be53640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:05.667428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928efd-ca81-4cc8-8200-82d33be53640 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:05.667710 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928efd-ca81-4cc8-8200-82d33be53640 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:05.668035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf928efd-ca81-4cc8-8200-82d33be53640 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:05.668865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf928efd-ca81-4cc8-8200-82d33be53640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:05.670517 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf928efd-ca81-4cc8-8200-82d33be53640 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:05.680840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1082/2142] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:35:05.684769 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf928efd-ca81-4cc8-8200-82d33be53640 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:05.694885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf928efd-ca81-4cc8-8200-82d33be53640 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:05.699652 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd70729-2109-4ca4-b8a3-6894d363adfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:05.700498 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd70729-2109-4ca4-b8a3-6894d363adfe admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:05.700778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd70729-2109-4ca4-b8a3-6894d363adfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:05.701051 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd70729-2109-4ca4-b8a3-6894d363adfe admin admin] PATH_INFO: `/v3/projects/3f803e4399444aa4bf2bf193b5b10947/users/d78050ac6da544998fcbb7339137e487/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:05.717436 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd70729-2109-4ca4-b8a3-6894d363adfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f803e4399444aa4bf2bf193b5b10947, user_id=d78050ac6da544998fcbb7339137e487, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:05.720197 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd70729-2109-4ca4-b8a3-6894d363adfe admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:05.801541 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-97e47730-351c-4335-9d50-fa7aba83ed5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46cb55c747bf4457936341d0bfe2e362'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:05.802229 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-97e47730-351c-4335-9d50-fa7aba83ed5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46cb55c747bf4457936341d0bfe2e362'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:05.802862 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-97e47730-351c-4335-9d50-fa7aba83ed5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46cb55c747bf4457936341d0bfe2e362'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:05.814473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-97e47730-351c-4335-9d50-fa7aba83ed5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46cb55c747bf4457936341d0bfe2e362'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:05.820995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1083/2143] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:05 2022] PUT /identity/v3/projects/3f803e4399444aa4bf2bf193b5b10947/users/d78050ac6da544998fcbb7339137e487/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:05.823484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-97e47730-351c-4335-9d50-fa7aba83ed5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46cb55c747bf4457936341d0bfe2e362'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:05.825109 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd70729-2109-4ca4-b8a3-6894d363adfe admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:05.826812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9cd70729-2109-4ca4-b8a3-6894d363adfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:05.899528 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd70729-2109-4ca4-b8a3-6894d363adfe admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:05.904517 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3da2b3-65f2-42ca-94f5-a7a00265e3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:05.909331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3da2b3-65f2-42ca-94f5-a7a00265e3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:05.909331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3da2b3-65f2-42ca-94f5-a7a00265e3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:05.909331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3da2b3-65f2-42ca-94f5-a7a00265e3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:05.909331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3da2b3-65f2-42ca-94f5-a7a00265e3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:05.909713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1061/2144] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:35:05 2022] DELETE /identity/v3/users/46cb55c747bf4457936341d0bfe2e362 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:05.911136 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3da2b3-65f2-42ca-94f5-a7a00265e3d2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:05.921615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1084/2145] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:05 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:35:05.926825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e47730-351c-4335-9d50-fa7aba83ed5c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:05.994823 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e47730-351c-4335-9d50-fa7aba83ed5c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:05.999612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338c11c-70db-4cb6-a58b-46045d54548c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:06.001029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c11c-70db-4cb6-a58b-46045d54548c admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:06.001029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c11c-70db-4cb6-a58b-46045d54548c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:06.001029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338c11c-70db-4cb6-a58b-46045d54548c admin admin] PATH_INFO: `/v3/projects/3f803e4399444aa4bf2bf193b5b10947/users/d78050ac6da544998fcbb7339137e487/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:06.002991 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338c11c-70db-4cb6-a58b-46045d54548c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f803e4399444aa4bf2bf193b5b10947, user_id=d78050ac6da544998fcbb7339137e487, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:06.006260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338c11c-70db-4cb6-a58b-46045d54548c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:06.016382 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1062/2146] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:05 2022] PUT /identity/v3/projects/3f803e4399444aa4bf2bf193b5b10947/users/d78050ac6da544998fcbb7339137e487/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:06.312945 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3da2b3-65f2-42ca-94f5-a7a00265e3d2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:06.314814 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5d3da2b3-65f2-42ca-94f5-a7a00265e3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:06.337557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3da2b3-65f2-42ca-94f5-a7a00265e3d2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:06.400071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:06.400853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:06.401132 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:06.401406 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6 admin admin] PATH_INFO: `/v3/projects/c1c01edd9eea4d678a131639a7bd9025` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:06.402604 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1c01edd9eea4d678a131639a7bd9025)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:06.404538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:06.543058 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1c01edd9eea4d678a131639a7bd9025', 'request_id': 'req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:06.603080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1c01edd9eea4d678a131639a7bd9025', 'request_id': 'req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:06.609165 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1c01edd9eea4d678a131639a7bd9025', 'request_id': 'req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:06.620855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6 admin admin] The token cache is being invalidate because project c1c01edd9eea4d678a131639a7bd9025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:06.621129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:06.621767 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c406ccf2-97e0-4e68-934c-ee43bb7f5be6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:06.623347 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1085/2147] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:06 2022] DELETE /identity/v3/projects/c1c01edd9eea4d678a131639a7bd9025 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:06.628272 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cb732-dba3-4f04-9e3b-3abf10a308d6 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:06.631876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cb732-dba3-4f04-9e3b-3abf10a308d6 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:06.631876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03cb732-dba3-4f04-9e3b-3abf10a308d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:06.649041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-a03cb732-dba3-4f04-9e3b-3abf10a308d6 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:06.655247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a03cb732-dba3-4f04-9e3b-3abf10a308d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:06.711677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1063/2148] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:06.719458 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6b5e6-5af9-43ca-b589-916c40074a39 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:06.719949 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6b5e6-5af9-43ca-b589-916c40074a39 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:06.720166 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d6b5e6-5af9-43ca-b589-916c40074a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:06.740594 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c3d6b5e6-5af9-43ca-b589-916c40074a39 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:06.741939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c3d6b5e6-5af9-43ca-b589-916c40074a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:06.750768 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1086/2149] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:06.756134 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cb732-dba3-4f04-9e3b-3abf10a308d6 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:06.765980 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03cb732-dba3-4f04-9e3b-3abf10a308d6 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:06.771139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed42ca-c23e-4320-bf50-b544a19fba13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:06.771853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed42ca-c23e-4320-bf50-b544a19fba13 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:06.774971 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed42ca-c23e-4320-bf50-b544a19fba13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:06.774971 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed42ca-c23e-4320-bf50-b544a19fba13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:06.774971 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed42ca-c23e-4320-bf50-b544a19fba13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:35:06.774971 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed42ca-c23e-4320-bf50-b544a19fba13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:06.775453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed42ca-c23e-4320-bf50-b544a19fba13 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:06.788115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1064/2150] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:35:06.792401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6b5e6-5af9-43ca-b589-916c40074a39 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:06.802609 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d6b5e6-5af9-43ca-b589-916c40074a39 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:06.807569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5707d2-c7bd-4fd8-9744-449a9c0cfea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:06.808227 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5707d2-c7bd-4fd8-9744-449a9c0cfea8 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:06.808509 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5707d2-c7bd-4fd8-9744-449a9c0cfea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:06.808802 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5707d2-c7bd-4fd8-9744-449a9c0cfea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:06.809520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5707d2-c7bd-4fd8-9744-449a9c0cfea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:06.811510 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5707d2-c7bd-4fd8-9744-449a9c0cfea8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:06.896811 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1087/2151] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:06 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:06.901264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed42ca-c23e-4320-bf50-b544a19fba13 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:06.912941 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed42ca-c23e-4320-bf50-b544a19fba13 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:06.976654 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8996b2f-f1f9-4333-a768-a674ba3e3dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:06.977327 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8996b2f-f1f9-4333-a768-a674ba3e3dfc admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:06.977604 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8996b2f-f1f9-4333-a768-a674ba3e3dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:06.978081 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8996b2f-f1f9-4333-a768-a674ba3e3dfc admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:06.978862 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8996b2f-f1f9-4333-a768-a674ba3e3dfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:06.980788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8996b2f-f1f9-4333-a768-a674ba3e3dfc admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:07.072023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1065/2152] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:06 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:07.076268 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5707d2-c7bd-4fd8-9744-449a9c0cfea8 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:07.086558 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5707d2-c7bd-4fd8-9744-449a9c0cfea8 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:07.091890 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c769a6d-3aba-474a-8db5-17b80be50e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:07.092545 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769a6d-3aba-474a-8db5-17b80be50e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:07.092976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769a6d-3aba-474a-8db5-17b80be50e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:07.093338 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c769a6d-3aba-474a-8db5-17b80be50e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:07.094611 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c769a6d-3aba-474a-8db5-17b80be50e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:07.096085 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c769a6d-3aba-474a-8db5-17b80be50e04 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:07.108222 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1088/2153] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:07.117445 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8996b2f-f1f9-4333-a768-a674ba3e3dfc admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:07.135761 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8996b2f-f1f9-4333-a768-a674ba3e3dfc admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:07.140747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb15b5c-c76d-426b-9dd9-f355cf02cc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:07.141491 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb15b5c-c76d-426b-9dd9-f355cf02cc40 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:07.141758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb15b5c-c76d-426b-9dd9-f355cf02cc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:07.142032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb15b5c-c76d-426b-9dd9-f355cf02cc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:07.142803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb15b5c-c76d-426b-9dd9-f355cf02cc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:07.144549 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb15b5c-c76d-426b-9dd9-f355cf02cc40 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:07.155033 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1066/2154] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:07.159536 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c769a6d-3aba-474a-8db5-17b80be50e04 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:07.171140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c769a6d-3aba-474a-8db5-17b80be50e04 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:07.178959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8904fa-bc97-4c16-961a-be824a141416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:07.180860 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8904fa-bc97-4c16-961a-be824a141416 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:07.181168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7546b2-5fb7-4d69-a65b-6de19bc75729 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:07.181457 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7546b2-5fb7-4d69-a65b-6de19bc75729 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:07.181845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8904fa-bc97-4c16-961a-be824a141416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:07.181973 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7546b2-5fb7-4d69-a65b-6de19bc75729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:07.182623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8904fa-bc97-4c16-961a-be824a141416 admin admin] PATH_INFO: `/v3/projects/f7619382cbc9402a98fad6966ab48508/users/4ce54110926447e9827e44b1f3367c78/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:07.201891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8904fa-bc97-4c16-961a-be824a141416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7619382cbc9402a98fad6966ab48508, user_id=4ce54110926447e9827e44b1f3367c78, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:07.204696 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8904fa-bc97-4c16-961a-be824a141416 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:07.214264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-3d7546b2-5fb7-4d69-a65b-6de19bc75729 None None] MFA Rules not processed for user `d78050ac6da544998fcbb7339137e487`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:07.215633 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-3d7546b2-5fb7-4d69-a65b-6de19bc75729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:07.274581 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1089/2155] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:07 2022] PUT /identity/v3/projects/f7619382cbc9402a98fad6966ab48508/users/4ce54110926447e9827e44b1f3367c78/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:07.282305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f21048-2503-4856-bac7-3250ed07e9d6 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:07.282652 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f21048-2503-4856-bac7-3250ed07e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:07.283381 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f21048-2503-4856-bac7-3250ed07e9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:07.299759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1067/2156] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:07.306487 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-44f21048-2503-4856-bac7-3250ed07e9d6 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:07.307739 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-44f21048-2503-4856-bac7-3250ed07e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:07.367734 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1090/2157] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:07.377591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7546b2-5fb7-4d69-a65b-6de19bc75729 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:07.379144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-3d7546b2-5fb7-4d69-a65b-6de19bc75729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:07.435733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7546b2-5fb7-4d69-a65b-6de19bc75729 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:07.485119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30711312-08f4-43f9-bcce-4b439034997b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:07.485764 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30711312-08f4-43f9-bcce-4b439034997b service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:07.486042 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30711312-08f4-43f9-bcce-4b439034997b service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:07.486315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30711312-08f4-43f9-bcce-4b439034997b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:07.495284 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30711312-08f4-43f9-bcce-4b439034997b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:07.496695 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30711312-08f4-43f9-bcce-4b439034997b service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:07.505770 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1068/2158] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:35:09.129132 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f21048-2503-4856-bac7-3250ed07e9d6 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:09.131139 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-44f21048-2503-4856-bac7-3250ed07e9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:09.146030 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f21048-2503-4856-bac7-3250ed07e9d6 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:09.150965 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24d645-208d-42bf-97c8-c27d8c77af87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:09.151846 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24d645-208d-42bf-97c8-c27d8c77af87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:09.152127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24d645-208d-42bf-97c8-c27d8c77af87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:09.152400 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24d645-208d-42bf-97c8-c27d8c77af87 admin admin] PATH_INFO: `/v3/users/504490e185174e0eaffb26d89ebf32ec` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:09.153627 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24d645-208d-42bf-97c8-c27d8c77af87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=504490e185174e0eaffb26d89ebf32ec)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:09.155550 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab24d645-208d-42bf-97c8-c27d8c77af87 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:09.261668 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9474d-76dc-4443-86d5-d35163e1ae3c None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:09.262213 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9474d-76dc-4443-86d5-d35163e1ae3c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:09.262730 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d9474d-76dc-4443-86d5-d35163e1ae3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:09.293891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ab24d645-208d-42bf-97c8-c27d8c77af87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '504490e185174e0eaffb26d89ebf32ec'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:09.294765 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ab24d645-208d-42bf-97c8-c27d8c77af87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '504490e185174e0eaffb26d89ebf32ec'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:09.295403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ab24d645-208d-42bf-97c8-c27d8c77af87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '504490e185174e0eaffb26d89ebf32ec'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:09.296141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-92d9474d-76dc-4443-86d5-d35163e1ae3c None None] MFA Rules not processed for user `4ce54110926447e9827e44b1f3367c78`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:09.297665 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-92d9474d-76dc-4443-86d5-d35163e1ae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:09.309265 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ab24d645-208d-42bf-97c8-c27d8c77af87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '504490e185174e0eaffb26d89ebf32ec'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:09.317964 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ab24d645-208d-42bf-97c8-c27d8c77af87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '504490e185174e0eaffb26d89ebf32ec'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:09.365650 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1069/2159] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:09.370130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9474d-76dc-4443-86d5-d35163e1ae3c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:09.371482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-92d9474d-76dc-4443-86d5-d35163e1ae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:09.385315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d9474d-76dc-4443-86d5-d35163e1ae3c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:09.390079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f012e7-5087-4d2d-86ac-b255399c5335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:09.390458 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1091/2160] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:35:09 2022] DELETE /identity/v3/users/504490e185174e0eaffb26d89ebf32ec => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:09.390729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f012e7-5087-4d2d-86ac-b255399c5335 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:09.391008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f012e7-5087-4d2d-86ac-b255399c5335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:09.391315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f012e7-5087-4d2d-86ac-b255399c5335 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:09.392016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f012e7-5087-4d2d-86ac-b255399c5335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:09.394622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f012e7-5087-4d2d-86ac-b255399c5335 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:09.455812 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1070/2161] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:09 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:35:09.460125 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24d645-208d-42bf-97c8-c27d8c77af87 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:09.534704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24d645-208d-42bf-97c8-c27d8c77af87 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:09.595319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047529c-c3bd-440a-8c5d-9426b1cb74ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:09.598563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047529c-c3bd-440a-8c5d-9426b1cb74ca admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:09.598563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047529c-c3bd-440a-8c5d-9426b1cb74ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:09.598563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047529c-c3bd-440a-8c5d-9426b1cb74ca admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:09.598563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047529c-c3bd-440a-8c5d-9426b1cb74ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:09.600127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047529c-c3bd-440a-8c5d-9426b1cb74ca admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:09.678615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f012e7-5087-4d2d-86ac-b255399c5335 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:09.680448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e7f012e7-5087-4d2d-86ac-b255399c5335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:09.697930 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f012e7-5087-4d2d-86ac-b255399c5335 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:09.703627 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:09.705110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:09.705395 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:09.705665 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] PATH_INFO: `/v3/projects/c450269df98442f78a5c4579c21d13ef` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:09.707543 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c450269df98442f78a5c4579c21d13ef)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:09.709448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:09.730674 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1092/2162] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:09 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:35:09.734311 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047529c-c3bd-440a-8c5d-9426b1cb74ca admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:09.745300 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047529c-c3bd-440a-8c5d-9426b1cb74ca admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:09.754533 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdb340-c22f-4eca-8fc8-dac9db58a8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:09.755323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdb340-c22f-4eca-8fc8-dac9db58a8fe admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:09.755606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdb340-c22f-4eca-8fc8-dac9db58a8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:09.755876 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdb340-c22f-4eca-8fc8-dac9db58a8fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:09.756618 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdb340-c22f-4eca-8fc8-dac9db58a8fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:09.758501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cdb340-c22f-4eca-8fc8-dac9db58a8fe admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:09.769553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1093/2163] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:09.774221 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdb340-c22f-4eca-8fc8-dac9db58a8fe admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:09.783877 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdb340-c22f-4eca-8fc8-dac9db58a8fe admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:09.789090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396603-bff6-47ae-9ebb-39e0b8e32d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:09.789867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396603-bff6-47ae-9ebb-39e0b8e32d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:09.790142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396603-bff6-47ae-9ebb-39e0b8e32d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:09.790410 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396603-bff6-47ae-9ebb-39e0b8e32d73 admin admin] PATH_INFO: `/v3/projects/04ae863db02049989222dd2c3f71f658/users/81b98f8b8e234c5ea69f4492545ebd5f/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:09.805557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5396603-bff6-47ae-9ebb-39e0b8e32d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ae863db02049989222dd2c3f71f658, user_id=81b98f8b8e234c5ea69f4492545ebd5f, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:09.808276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5396603-bff6-47ae-9ebb-39e0b8e32d73 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:09.823620 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c450269df98442f78a5c4579c21d13ef', 'request_id': 'req-db767e45-c2dc-42b9-8342-2892d1c3f63b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:09.840016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c450269df98442f78a5c4579c21d13ef', 'request_id': 'req-db767e45-c2dc-42b9-8342-2892d1c3f63b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:09.847446 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c450269df98442f78a5c4579c21d13ef', 'request_id': 'req-db767e45-c2dc-42b9-8342-2892d1c3f63b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:09.866004 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1094/2164] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:09 2022] PUT /identity/v3/projects/04ae863db02049989222dd2c3f71f658/users/81b98f8b8e234c5ea69f4492545ebd5f/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:09.870276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396603-bff6-47ae-9ebb-39e0b8e32d73 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:09.922681 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] The token cache is being invalidate because project c450269df98442f78a5c4579c21d13ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:09.923126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:09.923923 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:09.928619 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1071/2165] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:09 2022] DELETE /identity/v3/projects/c450269df98442f78a5c4579c21d13ef => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:09.929608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:09.930951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:09.938443 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396603-bff6-47ae-9ebb-39e0b8e32d73 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:09.943952 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2854236-4d81-488c-bb32-1ac8b6f1e8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:09.944617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2854236-4d81-488c-bb32-1ac8b6f1e8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:09.944902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2854236-4d81-488c-bb32-1ac8b6f1e8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:09.945181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2854236-4d81-488c-bb32-1ac8b6f1e8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:09.946016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2854236-4d81-488c-bb32-1ac8b6f1e8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:09.947602 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2854236-4d81-488c-bb32-1ac8b6f1e8f9 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:09.961532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1095/2166] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:35:09.962449 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2854236-4d81-488c-bb32-1ac8b6f1e8f9 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:09.964221 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d2854236-4d81-488c-bb32-1ac8b6f1e8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:09.977406 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2854236-4d81-488c-bb32-1ac8b6f1e8f9 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:09.982267 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba620b-26e9-44d0-9728-539b15ed7ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:09.983193 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba620b-26e9-44d0-9728-539b15ed7ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:09.983509 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba620b-26e9-44d0-9728-539b15ed7ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:09.983803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ba620b-26e9-44d0-9728-539b15ed7ed1 admin admin] PATH_INFO: `/v3/projects/04ae863db02049989222dd2c3f71f658/users/81b98f8b8e234c5ea69f4492545ebd5f/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:09.985905 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba620b-26e9-44d0-9728-539b15ed7ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ae863db02049989222dd2c3f71f658, user_id=81b98f8b8e234c5ea69f4492545ebd5f, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:09.989282 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ba620b-26e9-44d0-9728-539b15ed7ed1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:10.000170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1096/2167] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:09 2022] PUT /identity/v3/projects/04ae863db02049989222dd2c3f71f658/users/81b98f8b8e234c5ea69f4492545ebd5f/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:10.005666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db767e45-c2dc-42b9-8342-2892d1c3f63b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:10.068654 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0d6c8-7602-4c7a-98dd-09586d3dd80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:10.069654 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d6c8-7602-4c7a-98dd-09586d3dd80a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:10.070204 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d6c8-7602-4c7a-98dd-09586d3dd80a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:10.070484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d6c8-7602-4c7a-98dd-09586d3dd80a admin admin] PATH_INFO: `/v3/users/d78050ac6da544998fcbb7339137e487` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:10.072046 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0d6c8-7602-4c7a-98dd-09586d3dd80a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d78050ac6da544998fcbb7339137e487)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:10.077584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0d6c8-7602-4c7a-98dd-09586d3dd80a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:10.279205 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d9a0d6c8-7602-4c7a-98dd-09586d3dd80a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd78050ac6da544998fcbb7339137e487'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:10.279921 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d9a0d6c8-7602-4c7a-98dd-09586d3dd80a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd78050ac6da544998fcbb7339137e487'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:10.280490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d9a0d6c8-7602-4c7a-98dd-09586d3dd80a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd78050ac6da544998fcbb7339137e487'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:10.292232 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d9a0d6c8-7602-4c7a-98dd-09586d3dd80a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd78050ac6da544998fcbb7339137e487'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:10.298565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d9a0d6c8-7602-4c7a-98dd-09586d3dd80a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd78050ac6da544998fcbb7339137e487'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:10.413034 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1072/2168] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:35:09 2022] DELETE /identity/v3/users/d78050ac6da544998fcbb7339137e487 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:10.645526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba620b-26e9-44d0-9728-539b15ed7ed1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:10.648720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-35ba620b-26e9-44d0-9728-539b15ed7ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:10.664566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ba620b-26e9-44d0-9728-539b15ed7ed1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:10.733021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784beef9-b4d1-4cae-84db-8e0ea6052a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:10.733881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784beef9-b4d1-4cae-84db-8e0ea6052a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:10.734175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784beef9-b4d1-4cae-84db-8e0ea6052a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:10.735376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784beef9-b4d1-4cae-84db-8e0ea6052a23 admin admin] PATH_INFO: `/v3/projects/3f803e4399444aa4bf2bf193b5b10947` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:10.736138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784beef9-b4d1-4cae-84db-8e0ea6052a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f803e4399444aa4bf2bf193b5b10947)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:10.738834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784beef9-b4d1-4cae-84db-8e0ea6052a23 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:10.872929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-784beef9-b4d1-4cae-84db-8e0ea6052a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f803e4399444aa4bf2bf193b5b10947', 'request_id': 'req-784beef9-b4d1-4cae-84db-8e0ea6052a23'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:10.940183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-784beef9-b4d1-4cae-84db-8e0ea6052a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f803e4399444aa4bf2bf193b5b10947', 'request_id': 'req-784beef9-b4d1-4cae-84db-8e0ea6052a23'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:10.946970 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-784beef9-b4d1-4cae-84db-8e0ea6052a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f803e4399444aa4bf2bf193b5b10947', 'request_id': 'req-784beef9-b4d1-4cae-84db-8e0ea6052a23'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:10.961808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-784beef9-b4d1-4cae-84db-8e0ea6052a23 admin admin] The token cache is being invalidate because project 3f803e4399444aa4bf2bf193b5b10947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:10.962097 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-784beef9-b4d1-4cae-84db-8e0ea6052a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:10.962762 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-784beef9-b4d1-4cae-84db-8e0ea6052a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:10.964352 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1097/2169] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:10 2022] DELETE /identity/v3/projects/3f803e4399444aa4bf2bf193b5b10947 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:10.969257 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddb65b-17cc-4f14-bfc2-425ee9899fc9 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:10.969542 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddb65b-17cc-4f14-bfc2-425ee9899fc9 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:10.969816 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbddb65b-17cc-4f14-bfc2-425ee9899fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:10.988613 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-dbddb65b-17cc-4f14-bfc2-425ee9899fc9 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:10.989799 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-dbddb65b-17cc-4f14-bfc2-425ee9899fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:11.057854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1073/2170] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:11.060621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9e8d4-2cf0-415b-9a8d-1c9a14a5186c None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:11.060911 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9e8d4-2cf0-415b-9a8d-1c9a14a5186c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:11.061194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9e8d4-2cf0-415b-9a8d-1c9a14a5186c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:11.083194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-d2b9e8d4-2cf0-415b-9a8d-1c9a14a5186c None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:11.084455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d2b9e8d4-2cf0-415b-9a8d-1c9a14a5186c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:11.092622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1098/2171] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:11.097671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddb65b-17cc-4f14-bfc2-425ee9899fc9 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:11.107524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbddb65b-17cc-4f14-bfc2-425ee9899fc9 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:11.112621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde02d62-97fd-4819-8799-f17c73dc813c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:11.113586 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde02d62-97fd-4819-8799-f17c73dc813c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:11.113875 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde02d62-97fd-4819-8799-f17c73dc813c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:11.114153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde02d62-97fd-4819-8799-f17c73dc813c admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:11.114893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde02d62-97fd-4819-8799-f17c73dc813c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:35:11.115207 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde02d62-97fd-4819-8799-f17c73dc813c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:11.116871 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde02d62-97fd-4819-8799-f17c73dc813c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:11.128177 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1074/2172] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:35:11.134967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9e8d4-2cf0-415b-9a8d-1c9a14a5186c None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:11.145315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9e8d4-2cf0-415b-9a8d-1c9a14a5186c None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:11.150791 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ced55-ef41-4424-8aa4-674d4f4fd4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:11.151719 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ced55-ef41-4424-8aa4-674d4f4fd4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:11.153856 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ced55-ef41-4424-8aa4-674d4f4fd4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:11.153856 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ced55-ef41-4424-8aa4-674d4f4fd4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:11.154456 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ced55-ef41-4424-8aa4-674d4f4fd4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:11.156417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ced55-ef41-4424-8aa4-674d4f4fd4f3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:11.250906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1099/2173] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:11 2022] POST /identity/v3/projects => generated 363 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:11.255358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde02d62-97fd-4819-8799-f17c73dc813c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:11.265785 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde02d62-97fd-4819-8799-f17c73dc813c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:11.319741 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01507af8-e994-4d51-bd40-6c68f863e591 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:11.320039 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01507af8-e994-4d51-bd40-6c68f863e591 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:11.320306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01507af8-e994-4d51-bd40-6c68f863e591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:11.332261 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b3b93-88d8-4775-95cb-67c8da4cc435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:11.333841 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b3b93-88d8-4775-95cb-67c8da4cc435 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:11.334343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b3b93-88d8-4775-95cb-67c8da4cc435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:11.334832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682b3b93-88d8-4775-95cb-67c8da4cc435 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:11.335825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b3b93-88d8-4775-95cb-67c8da4cc435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:11.338179 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682b3b93-88d8-4775-95cb-67c8da4cc435 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:11.359209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-01507af8-e994-4d51-bd40-6c68f863e591 None None] MFA Rules not processed for user `81b98f8b8e234c5ea69f4492545ebd5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:11.360412 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-01507af8-e994-4d51-bd40-6c68f863e591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:11.409885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1075/2174] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:11 2022] POST /identity/v3/users => generated 282 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:35:11.413868 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b3b93-88d8-4775-95cb-67c8da4cc435 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:11.424852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682b3b93-88d8-4775-95cb-67c8da4cc435 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:11.430502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6220d6-9fc1-4460-a8da-577e4358d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:11.431507 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6220d6-9fc1-4460-a8da-577e4358d0f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:11.432086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6220d6-9fc1-4460-a8da-577e4358d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:11.433867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6220d6-9fc1-4460-a8da-577e4358d0f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:11.434786 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6220d6-9fc1-4460-a8da-577e4358d0f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:11.436538 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6220d6-9fc1-4460-a8da-577e4358d0f3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:11.447480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1100/2175] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:11.448642 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01507af8-e994-4d51-bd40-6c68f863e591 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:11.452336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-01507af8-e994-4d51-bd40-6c68f863e591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:11.457250 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1076/2176] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:11.457250 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6220d6-9fc1-4460-a8da-577e4358d0f3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:11.467435 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01507af8-e994-4d51-bd40-6c68f863e591 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:11.472569 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6220d6-9fc1-4460-a8da-577e4358d0f3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:11.474202 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66c05f-8bc0-4c55-946b-7415f631b5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:11.475087 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66c05f-8bc0-4c55-946b-7415f631b5b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:11.475401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66c05f-8bc0-4c55-946b-7415f631b5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:11.475678 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66c05f-8bc0-4c55-946b-7415f631b5b3 admin admin] PATH_INFO: `/v3/users/0e5d68dfe7a74926b823c20716d5e5e8` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:11.476888 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66c05f-8bc0-4c55-946b-7415f631b5b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e5d68dfe7a74926b823c20716d5e5e8)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:11.477856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86e7d5-a127-42a5-8a40-1e43036616ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:11.478513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86e7d5-a127-42a5-8a40-1e43036616ac admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:11.478792 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86e7d5-a127-42a5-8a40-1e43036616ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:11.478960 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66c05f-8bc0-4c55-946b-7415f631b5b3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:11.479053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86e7d5-a127-42a5-8a40-1e43036616ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:11.479819 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86e7d5-a127-42a5-8a40-1e43036616ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:11.481388 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86e7d5-a127-42a5-8a40-1e43036616ac admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:11.492552 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1077/2177] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:11.497773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86e7d5-a127-42a5-8a40-1e43036616ac admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:11.499744 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-3e86e7d5-a127-42a5-8a40-1e43036616ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:11.561223 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86e7d5-a127-42a5-8a40-1e43036616ac admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:11.565308 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7714651-8dad-40ef-8d79-207b4cb2d901 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:11.566646 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714651-8dad-40ef-8d79-207b4cb2d901 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:11.567147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714651-8dad-40ef-8d79-207b4cb2d901 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:11.567607 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7714651-8dad-40ef-8d79-207b4cb2d901 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:11.569439 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b7714651-8dad-40ef-8d79-207b4cb2d901 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:11.627881 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7714651-8dad-40ef-8d79-207b4cb2d901 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:11.629785 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7714651-8dad-40ef-8d79-207b4cb2d901 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:11.633788 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6a66c05f-8bc0-4c55-946b-7415f631b5b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e5d68dfe7a74926b823c20716d5e5e8'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:11.634491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6a66c05f-8bc0-4c55-946b-7415f631b5b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e5d68dfe7a74926b823c20716d5e5e8'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:11.635128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6a66c05f-8bc0-4c55-946b-7415f631b5b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e5d68dfe7a74926b823c20716d5e5e8'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:11.639017 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1078/2178] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:35:11.639828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7714651-8dad-40ef-8d79-207b4cb2d901 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:11.652344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7714651-8dad-40ef-8d79-207b4cb2d901 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:11.654439 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6a66c05f-8bc0-4c55-946b-7415f631b5b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e5d68dfe7a74926b823c20716d5e5e8'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:11.657561 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8167ba8-d2c0-4b2c-9bc8-a40197697948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:11.663517 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8167ba8-d2c0-4b2c-9bc8-a40197697948 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:11.663517 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8167ba8-d2c0-4b2c-9bc8-a40197697948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:11.663517 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8167ba8-d2c0-4b2c-9bc8-a40197697948 admin admin] PATH_INFO: `/v3/projects/0a5c698c057f4124ac50e464d23c8ce8/users/fe40a14261cb42b19b2c9208e796aa72/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:11.663795 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6a66c05f-8bc0-4c55-946b-7415f631b5b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e5d68dfe7a74926b823c20716d5e5e8'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:11.675743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8167ba8-d2c0-4b2c-9bc8-a40197697948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a5c698c057f4124ac50e464d23c8ce8, user_id=fe40a14261cb42b19b2c9208e796aa72, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:11.678604 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8167ba8-d2c0-4b2c-9bc8-a40197697948 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:11.757638 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1101/2179] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:35:11 2022] DELETE /identity/v3/users/0e5d68dfe7a74926b823c20716d5e5e8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:11.762120 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791cf9d-1235-4d8e-aef2-5119dfb93e01 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:11.762510 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791cf9d-1235-4d8e-aef2-5119dfb93e01 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:11.762909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791cf9d-1235-4d8e-aef2-5119dfb93e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:11.769534 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1079/2180] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:11 2022] PUT /identity/v3/projects/0a5c698c057f4124ac50e464d23c8ce8/users/fe40a14261cb42b19b2c9208e796aa72/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:11.780163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dc4b7-6d92-4c44-8a81-ec74aa6c509c None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:11.780445 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dc4b7-6d92-4c44-8a81-ec74aa6c509c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:11.780721 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03dc4b7-6d92-4c44-8a81-ec74aa6c509c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:11.781201 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-e791cf9d-1235-4d8e-aef2-5119dfb93e01 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:11.782451 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e791cf9d-1235-4d8e-aef2-5119dfb93e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:11.808754 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-c03dc4b7-6d92-4c44-8a81-ec74aa6c509c None None] MFA Rules not processed for user `fe40a14261cb42b19b2c9208e796aa72`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:11.809979 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c03dc4b7-6d92-4c44-8a81-ec74aa6c509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:11.844499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1102/2181] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:11.854460 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791cf9d-1235-4d8e-aef2-5119dfb93e01 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:11.855867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e791cf9d-1235-4d8e-aef2-5119dfb93e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:11.883478 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1080/2182] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:11.884656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dc4b7-6d92-4c44-8a81-ec74aa6c509c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:11.886118 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c03dc4b7-6d92-4c44-8a81-ec74aa6c509c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:11.901232 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03dc4b7-6d92-4c44-8a81-ec74aa6c509c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:11.907832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f04443-cf76-4697-8165-00c6472bf9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:11.908494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f04443-cf76-4697-8165-00c6472bf9d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:11.908771 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f04443-cf76-4697-8165-00c6472bf9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:11.909041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f04443-cf76-4697-8165-00c6472bf9d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:11.909940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f04443-cf76-4697-8165-00c6472bf9d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:11.911917 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f04443-cf76-4697-8165-00c6472bf9d7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:11.920880 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791cf9d-1235-4d8e-aef2-5119dfb93e01 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:11.924702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe130ce0-e7b9-48d4-ad5f-dbbb0f04eb28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:11.928931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe130ce0-e7b9-48d4-ad5f-dbbb0f04eb28 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:11.928931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe130ce0-e7b9-48d4-ad5f-dbbb0f04eb28 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:11.928931 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe130ce0-e7b9-48d4-ad5f-dbbb0f04eb28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:11.936100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe130ce0-e7b9-48d4-ad5f-dbbb0f04eb28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:11.937635 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe130ce0-e7b9-48d4-ad5f-dbbb0f04eb28 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:11.950548 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1103/2183] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:35:12.021253 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1081/2184] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:11 2022] POST /identity/v3/projects => generated 363 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:12.023142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe130ce0-e7b9-48d4-ad5f-dbbb0f04eb28 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:12.034127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe130ce0-e7b9-48d4-ad5f-dbbb0f04eb28 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:12.107371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cb525-3b6d-4466-8b5a-beac08e31545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:12.108162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cb525-3b6d-4466-8b5a-beac08e31545 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:12.108448 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cb525-3b6d-4466-8b5a-beac08e31545 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:12.108726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cb525-3b6d-4466-8b5a-beac08e31545 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:12.109442 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cb525-3b6d-4466-8b5a-beac08e31545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:12.111554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cb525-3b6d-4466-8b5a-beac08e31545 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:12.227994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1104/2185] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:12 2022] POST /identity/v3/users => generated 288 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:12.235059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f04443-cf76-4697-8165-00c6472bf9d7 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:12.258219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f04443-cf76-4697-8165-00c6472bf9d7 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:12.279551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792dba9-970b-4b45-b4be-769d8283718f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:12.285987 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792dba9-970b-4b45-b4be-769d8283718f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:12.286537 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792dba9-970b-4b45-b4be-769d8283718f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:12.287379 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792dba9-970b-4b45-b4be-769d8283718f admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:12.288630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792dba9-970b-4b45-b4be-769d8283718f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:12.294799 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792dba9-970b-4b45-b4be-769d8283718f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:12.322732 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1082/2186] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:35:12.327535 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cb525-3b6d-4466-8b5a-beac08e31545 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:12.337918 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cb525-3b6d-4466-8b5a-beac08e31545 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:12.342548 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8e2f8-2217-4779-9dcc-df49b98844d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:12.343450 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e2f8-2217-4779-9dcc-df49b98844d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:12.343726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e2f8-2217-4779-9dcc-df49b98844d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:12.343993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8e2f8-2217-4779-9dcc-df49b98844d3 admin admin] PATH_INFO: `/v3/projects/5e1567b5b8c84e53960da09ab183306e/users/e4671937f88744a6880d9e1a5cf3286b/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:12.360361 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8e2f8-2217-4779-9dcc-df49b98844d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e1567b5b8c84e53960da09ab183306e, user_id=e4671937f88744a6880d9e1a5cf3286b, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:12.364206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8e2f8-2217-4779-9dcc-df49b98844d3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:12.437561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1105/2187] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:12 2022] PUT /identity/v3/projects/5e1567b5b8c84e53960da09ab183306e/users/e4671937f88744a6880d9e1a5cf3286b/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:12.443930 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792dba9-970b-4b45-b4be-769d8283718f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:12.454066 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792dba9-970b-4b45-b4be-769d8283718f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:12.514016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af321a0a-9a63-43ad-9aa2-11b7b62c1218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:12.514855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af321a0a-9a63-43ad-9aa2-11b7b62c1218 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:12.515144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af321a0a-9a63-43ad-9aa2-11b7b62c1218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:12.515466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af321a0a-9a63-43ad-9aa2-11b7b62c1218 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:12.516216 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af321a0a-9a63-43ad-9aa2-11b7b62c1218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:12.517803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af321a0a-9a63-43ad-9aa2-11b7b62c1218 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:12.530759 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8e2f8-2217-4779-9dcc-df49b98844d3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:12.535513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1083/2188] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:12.535696 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-8cd8e2f8-2217-4779-9dcc-df49b98844d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:12.538773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af321a0a-9a63-43ad-9aa2-11b7b62c1218 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:12.554412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af321a0a-9a63-43ad-9aa2-11b7b62c1218 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:12.556661 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8e2f8-2217-4779-9dcc-df49b98844d3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:12.561050 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2418cfa-ecc1-4194-ad2f-0c6064044c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:12.566643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2418cfa-ecc1-4194-ad2f-0c6064044c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:12.566643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2418cfa-ecc1-4194-ad2f-0c6064044c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:12.566643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2418cfa-ecc1-4194-ad2f-0c6064044c71 admin admin] PATH_INFO: `/v3/projects/5e1567b5b8c84e53960da09ab183306e/users/e4671937f88744a6880d9e1a5cf3286b/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:12.567185 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1e4145-6a75-4e62-924b-778e1fa4f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:12.567447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2418cfa-ecc1-4194-ad2f-0c6064044c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e1567b5b8c84e53960da09ab183306e, user_id=e4671937f88744a6880d9e1a5cf3286b, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:12.567552 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e4145-6a75-4e62-924b-778e1fa4f22a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:12.567940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e4145-6a75-4e62-924b-778e1fa4f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:12.568283 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1e4145-6a75-4e62-924b-778e1fa4f22a admin admin] PATH_INFO: `/v3/projects/113ad0793bbb4cd9b50324091e80c2e2` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:12.569731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2418cfa-ecc1-4194-ad2f-0c6064044c71 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:12.569899 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e4145-6a75-4e62-924b-778e1fa4f22a admin admin] RBAC: Authorizing `identity:delete_project(project_id=113ad0793bbb4cd9b50324091e80c2e2)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:12.572474 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1e4145-6a75-4e62-924b-778e1fa4f22a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:12.580761 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1084/2189] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:12 2022] PUT /identity/v3/projects/5e1567b5b8c84e53960da09ab183306e/users/e4671937f88744a6880d9e1a5cf3286b/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:12.591073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5eebe-69b7-4937-8d25-0782ad2501c4 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:12.591728 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5eebe-69b7-4937-8d25-0782ad2501c4 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:12.592136 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5eebe-69b7-4937-8d25-0782ad2501c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:12.621242 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-64c5eebe-69b7-4937-8d25-0782ad2501c4 None None] MFA Rules not processed for user `e4671937f88744a6880d9e1a5cf3286b`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:12.622470 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-64c5eebe-69b7-4937-8d25-0782ad2501c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:12.673994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-3f1e4145-6a75-4e62-924b-778e1fa4f22a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '113ad0793bbb4cd9b50324091e80c2e2', 'request_id': 'req-3f1e4145-6a75-4e62-924b-778e1fa4f22a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:12.696587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1085/2190] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:12 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:12.706978 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5eebe-69b7-4937-8d25-0782ad2501c4 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:12.708338 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-64c5eebe-69b7-4937-8d25-0782ad2501c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:12.728141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-3f1e4145-6a75-4e62-924b-778e1fa4f22a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '113ad0793bbb4cd9b50324091e80c2e2', 'request_id': 'req-3f1e4145-6a75-4e62-924b-778e1fa4f22a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:12.733996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-3f1e4145-6a75-4e62-924b-778e1fa4f22a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '113ad0793bbb4cd9b50324091e80c2e2', 'request_id': 'req-3f1e4145-6a75-4e62-924b-778e1fa4f22a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:12.745633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-3f1e4145-6a75-4e62-924b-778e1fa4f22a admin admin] The token cache is being invalidate because project 113ad0793bbb4cd9b50324091e80c2e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:12.745918 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-3f1e4145-6a75-4e62-924b-778e1fa4f22a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:12.746563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-3f1e4145-6a75-4e62-924b-778e1fa4f22a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:12.748553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1106/2191] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:12 2022] DELETE /identity/v3/projects/113ad0793bbb4cd9b50324091e80c2e2 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:12.754699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d38eb-a036-454c-848c-e808c362f6b0 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:12.754986 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d38eb-a036-454c-848c-e808c362f6b0 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:12.755321 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d38eb-a036-454c-848c-e808c362f6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:12.766047 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5eebe-69b7-4937-8d25-0782ad2501c4 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:12.773702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c87d38eb-a036-454c-848c-e808c362f6b0 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:12.775179 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c87d38eb-a036-454c-848c-e808c362f6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:12.816731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474611a-c63d-426e-b166-98d535918f6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:12.817392 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474611a-c63d-426e-b166-98d535918f6e service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:12.817677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474611a-c63d-426e-b166-98d535918f6e service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:12.817956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474611a-c63d-426e-b166-98d535918f6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:12.819863 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d474611a-c63d-426e-b166-98d535918f6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:12.842987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1107/2192] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:12.854241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58258a-7e2a-4c18-8819-b6a5d02f8170 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:12.854241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58258a-7e2a-4c18-8819-b6a5d02f8170 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:12.854241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58258a-7e2a-4c18-8819-b6a5d02f8170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:12.871801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-ba58258a-7e2a-4c18-8819-b6a5d02f8170 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:12.873032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ba58258a-7e2a-4c18-8819-b6a5d02f8170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:12.882202 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1108/2193] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:12.885125 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474611a-c63d-426e-b166-98d535918f6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:12.886290 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58258a-7e2a-4c18-8819-b6a5d02f8170 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:12.886518 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474611a-c63d-426e-b166-98d535918f6e service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:12.895202 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58258a-7e2a-4c18-8819-b6a5d02f8170 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:12.896350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1086/2194] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:35:12.900370 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a71338-dbfe-45f8-bdcb-13af73383fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:12.901019 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a71338-dbfe-45f8-bdcb-13af73383fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:12.901298 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a71338-dbfe-45f8-bdcb-13af73383fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:12.902949 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a71338-dbfe-45f8-bdcb-13af73383fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:12.902949 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a71338-dbfe-45f8-bdcb-13af73383fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:35:12.902949 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a71338-dbfe-45f8-bdcb-13af73383fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:12.904199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a71338-dbfe-45f8-bdcb-13af73383fa4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:12.920135 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1109/2195] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:35:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:35:12.921968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474611a-c63d-426e-b166-98d535918f6e service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:12.933060 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474611a-c63d-426e-b166-98d535918f6e service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:12.937542 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90245630-4fc9-450a-93a5-d290c11f1677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:12.938217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90245630-4fc9-450a-93a5-d290c11f1677 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:12.938497 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90245630-4fc9-450a-93a5-d290c11f1677 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:12.938843 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90245630-4fc9-450a-93a5-d290c11f1677 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:12.939608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90245630-4fc9-450a-93a5-d290c11f1677 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:12.941693 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90245630-4fc9-450a-93a5-d290c11f1677 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:13.085705 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1087/2196] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:12 2022] POST /identity/v3/projects => generated 371 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:35:13.089754 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a71338-dbfe-45f8-bdcb-13af73383fa4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:13.101108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a71338-dbfe-45f8-bdcb-13af73383fa4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:13.160910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462e617-1494-4df3-b00d-8335af16b2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:13.161389 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462e617-1494-4df3-b00d-8335af16b2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:13.161671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462e617-1494-4df3-b00d-8335af16b2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:13.161944 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462e617-1494-4df3-b00d-8335af16b2f7 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:13.162650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462e617-1494-4df3-b00d-8335af16b2f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:13.164577 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462e617-1494-4df3-b00d-8335af16b2f7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:13.264466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90245630-4fc9-450a-93a5-d290c11f1677 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:13.266251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-90245630-4fc9-450a-93a5-d290c11f1677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:13.281652 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1110/2197] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:13 2022] POST /identity/v3/users => generated 286 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:13.283151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462e617-1494-4df3-b00d-8335af16b2f7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:13.295199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462e617-1494-4df3-b00d-8335af16b2f7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:13.300511 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58a8b1-ca65-47be-a5f8-ab51ee9240f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:13.302170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a8b1-ca65-47be-a5f8-ab51ee9240f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:13.303000 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a8b1-ca65-47be-a5f8-ab51ee9240f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:13.303000 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58a8b1-ca65-47be-a5f8-ab51ee9240f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:13.304418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58a8b1-ca65-47be-a5f8-ab51ee9240f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:13.306410 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58a8b1-ca65-47be-a5f8-ab51ee9240f2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:13.317310 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1111/2198] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:13.324212 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58a8b1-ca65-47be-a5f8-ab51ee9240f2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:13.338060 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58a8b1-ca65-47be-a5f8-ab51ee9240f2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:13.343988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825fe98-042e-4339-af67-9248e9915490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:13.344758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825fe98-042e-4339-af67-9248e9915490 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:13.345134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825fe98-042e-4339-af67-9248e9915490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:13.345761 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825fe98-042e-4339-af67-9248e9915490 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:13.346372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825fe98-042e-4339-af67-9248e9915490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:13.358129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825fe98-042e-4339-af67-9248e9915490 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:13.365957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1112/2199] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:13.367571 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825fe98-042e-4339-af67-9248e9915490 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:13.376847 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90245630-4fc9-450a-93a5-d290c11f1677 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:13.376847 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0e857-7416-42f1-961f-527f041b6d02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:13.377262 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0e857-7416-42f1-961f-527f041b6d02 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:13.378166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0e857-7416-42f1-961f-527f041b6d02 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:13.378166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0e857-7416-42f1-961f-527f041b6d02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:13.379704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825fe98-042e-4339-af67-9248e9915490 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:13.379833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-3bd0e857-7416-42f1-961f-527f041b6d02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:13.384774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd27f14-d152-4ac4-a2a2-89d196ff1721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:13.386118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd27f14-d152-4ac4-a2a2-89d196ff1721 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:13.386604 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd27f14-d152-4ac4-a2a2-89d196ff1721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:13.387035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd27f14-d152-4ac4-a2a2-89d196ff1721 admin admin] PATH_INFO: `/v3/projects/81158026ccaa4f9ab0467d73628313a2/users/b6ddf591e60847a1a02f15167411c9d7/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:13.408527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd27f14-d152-4ac4-a2a2-89d196ff1721 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81158026ccaa4f9ab0467d73628313a2, user_id=b6ddf591e60847a1a02f15167411c9d7, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:13.412116 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd27f14-d152-4ac4-a2a2-89d196ff1721 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:13.445267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0e857-7416-42f1-961f-527f041b6d02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:13.446807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0e857-7416-42f1-961f-527f041b6d02 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:13.462643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1088/2200] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:13 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:35:13.462643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0e857-7416-42f1-961f-527f041b6d02 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:13.462643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-3bd0e857-7416-42f1-961f-527f041b6d02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:13.473806 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0e857-7416-42f1-961f-527f041b6d02 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:13.478670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9771f-46f5-4f7b-9338-13728015ca93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:13.479686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9771f-46f5-4f7b-9338-13728015ca93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:13.480068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9771f-46f5-4f7b-9338-13728015ca93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:13.480441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba9771f-46f5-4f7b-9338-13728015ca93 admin admin] PATH_INFO: `/v3/users/fe40a14261cb42b19b2c9208e796aa72` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:13.481680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9771f-46f5-4f7b-9338-13728015ca93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe40a14261cb42b19b2c9208e796aa72)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:13.483629 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba9771f-46f5-4f7b-9338-13728015ca93 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:13.489722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1113/2201] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:13 2022] PUT /identity/v3/projects/81158026ccaa4f9ab0467d73628313a2/users/b6ddf591e60847a1a02f15167411c9d7/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:13.501217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04e16-e402-4f4e-8df6-587346a817f4 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:13.501508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04e16-e402-4f4e-8df6-587346a817f4 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:13.501784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04e16-e402-4f4e-8df6-587346a817f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:13.527934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-3ed04e16-e402-4f4e-8df6-587346a817f4 None None] MFA Rules not processed for user `b6ddf591e60847a1a02f15167411c9d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:13.529150 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3ed04e16-e402-4f4e-8df6-587346a817f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:13.596489 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1114/2202] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:13.605774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04e16-e402-4f4e-8df6-587346a817f4 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:13.607318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3ed04e16-e402-4f4e-8df6-587346a817f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:13.679505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04e16-e402-4f4e-8df6-587346a817f4 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:13.679505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba77e8-41f4-4608-8443-3004ac4baa3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:13.679505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba77e8-41f4-4608-8443-3004ac4baa3c service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:13.679505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba77e8-41f4-4608-8443-3004ac4baa3c service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:13.680318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba77e8-41f4-4608-8443-3004ac4baa3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:13.684874 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba77e8-41f4-4608-8443-3004ac4baa3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:13.686328 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba77e8-41f4-4608-8443-3004ac4baa3c service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:13.695749 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1115/2203] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:35:13.736022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-8ba9771f-46f5-4f7b-9338-13728015ca93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe40a14261cb42b19b2c9208e796aa72'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:13.736636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-8ba9771f-46f5-4f7b-9338-13728015ca93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe40a14261cb42b19b2c9208e796aa72'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:13.737312 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-8ba9771f-46f5-4f7b-9338-13728015ca93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe40a14261cb42b19b2c9208e796aa72'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:13.750589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-8ba9771f-46f5-4f7b-9338-13728015ca93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe40a14261cb42b19b2c9208e796aa72'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:13.758000 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-8ba9771f-46f5-4f7b-9338-13728015ca93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe40a14261cb42b19b2c9208e796aa72'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:13.809298 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1089/2204] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:35:13 2022] DELETE /identity/v3/users/fe40a14261cb42b19b2c9208e796aa72 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:13.814513 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb30c12-20a5-46cb-a6f5-7cc6e768b4b6 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:13.815322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb30c12-20a5-46cb-a6f5-7cc6e768b4b6 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:13.815864 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb30c12-20a5-46cb-a6f5-7cc6e768b4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:13.836013 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-9fb30c12-20a5-46cb-a6f5-7cc6e768b4b6 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:13.837204 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9fb30c12-20a5-46cb-a6f5-7cc6e768b4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:13.909621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1116/2205] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:13.919519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9771f-46f5-4f7b-9338-13728015ca93 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:13.920908 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8ba9771f-46f5-4f7b-9338-13728015ca93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:13.978185 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba9771f-46f5-4f7b-9338-13728015ca93 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:13.981814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e4696-1228-431d-9380-1dfa40162e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:13.982452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e4696-1228-431d-9380-1dfa40162e3a service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:13.982735 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e4696-1228-431d-9380-1dfa40162e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:13.983009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e4696-1228-431d-9380-1dfa40162e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:13.993339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e4696-1228-431d-9380-1dfa40162e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:13.994702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e4696-1228-431d-9380-1dfa40162e3a service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:14.011173 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1090/2206] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:35:14.463080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb30c12-20a5-46cb-a6f5-7cc6e768b4b6 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:14.465272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9fb30c12-20a5-46cb-a6f5-7cc6e768b4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:14.480171 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb30c12-20a5-46cb-a6f5-7cc6e768b4b6 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:14.485686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:14.486596 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:14.487087 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:14.487452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] PATH_INFO: `/v3/projects/0a5c698c057f4124ac50e464d23c8ce8` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:14.496890 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a5c698c057f4124ac50e464d23c8ce8)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:14.498988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:14.596078 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a5c698c057f4124ac50e464d23c8ce8', 'request_id': 'req-33cd6e36-409d-468c-8e46-312456da6dfc'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:14.648443 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a5c698c057f4124ac50e464d23c8ce8', 'request_id': 'req-33cd6e36-409d-468c-8e46-312456da6dfc'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:14.654543 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a5c698c057f4124ac50e464d23c8ce8', 'request_id': 'req-33cd6e36-409d-468c-8e46-312456da6dfc'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:14.667524 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] The token cache is being invalidate because project 0a5c698c057f4124ac50e464d23c8ce8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:14.667940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:14.671198 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:14.671198 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1117/2207] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:14 2022] DELETE /identity/v3/projects/0a5c698c057f4124ac50e464d23c8ce8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:14.674539 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e4696-1228-431d-9380-1dfa40162e3a service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:14.685087 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e4696-1228-431d-9380-1dfa40162e3a service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:14.749677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8b3641-d3e8-4913-8cd9-c65754221742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:14.750546 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b3641-d3e8-4913-8cd9-c65754221742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:14.750821 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b3641-d3e8-4913-8cd9-c65754221742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:14.751087 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8b3641-d3e8-4913-8cd9-c65754221742 admin admin] PATH_INFO: `/v3/users/e4671937f88744a6880d9e1a5cf3286b` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:14.754849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b3641-d3e8-4913-8cd9-c65754221742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4671937f88744a6880d9e1a5cf3286b)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:14.755383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8b3641-d3e8-4913-8cd9-c65754221742 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:14.965818 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-0a8b3641-d3e8-4913-8cd9-c65754221742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4671937f88744a6880d9e1a5cf3286b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:14.966323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-0a8b3641-d3e8-4913-8cd9-c65754221742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4671937f88744a6880d9e1a5cf3286b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:14.967029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-0a8b3641-d3e8-4913-8cd9-c65754221742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4671937f88744a6880d9e1a5cf3286b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:14.980085 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-0a8b3641-d3e8-4913-8cd9-c65754221742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4671937f88744a6880d9e1a5cf3286b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:14.986627 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-0a8b3641-d3e8-4913-8cd9-c65754221742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4671937f88744a6880d9e1a5cf3286b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:15.037736 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1091/2208] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:35:14 2022] DELETE /identity/v3/users/e4671937f88744a6880d9e1a5cf3286b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:15.421874 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:15.426718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:15.441264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd6e36-409d-468c-8e46-312456da6dfc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:15.500360 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d4711-b35e-4f22-a1e6-58dc2b38c234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:15.501783 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d4711-b35e-4f22-a1e6-58dc2b38c234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:15.502321 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d4711-b35e-4f22-a1e6-58dc2b38c234 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:15.502744 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d4711-b35e-4f22-a1e6-58dc2b38c234 admin admin] PATH_INFO: `/v3/projects/5e1567b5b8c84e53960da09ab183306e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:15.504720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d4711-b35e-4f22-a1e6-58dc2b38c234 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e1567b5b8c84e53960da09ab183306e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:15.506787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25d4711-b35e-4f22-a1e6-58dc2b38c234 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:15.615163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f25d4711-b35e-4f22-a1e6-58dc2b38c234 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e1567b5b8c84e53960da09ab183306e', 'request_id': 'req-f25d4711-b35e-4f22-a1e6-58dc2b38c234'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:15.665294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f25d4711-b35e-4f22-a1e6-58dc2b38c234 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e1567b5b8c84e53960da09ab183306e', 'request_id': 'req-f25d4711-b35e-4f22-a1e6-58dc2b38c234'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:15.671145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f25d4711-b35e-4f22-a1e6-58dc2b38c234 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e1567b5b8c84e53960da09ab183306e', 'request_id': 'req-f25d4711-b35e-4f22-a1e6-58dc2b38c234'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:15.682465 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f25d4711-b35e-4f22-a1e6-58dc2b38c234 admin admin] The token cache is being invalidate because project 5e1567b5b8c84e53960da09ab183306e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:15.682827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f25d4711-b35e-4f22-a1e6-58dc2b38c234 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:15.683571 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f25d4711-b35e-4f22-a1e6-58dc2b38c234 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:15.685172 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1118/2209] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:15 2022] DELETE /identity/v3/projects/5e1567b5b8c84e53960da09ab183306e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:15.690048 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38587e8a-68a5-418b-a105-60f7957877b7 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:15.690600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38587e8a-68a5-418b-a105-60f7957877b7 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:15.690600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38587e8a-68a5-418b-a105-60f7957877b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:15.711994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-38587e8a-68a5-418b-a105-60f7957877b7 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:15.713290 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-38587e8a-68a5-418b-a105-60f7957877b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:15.770921 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1092/2210] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:15.783787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f382c6-494f-4afc-98f7-bf34185ba11a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:15.784398 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f382c6-494f-4afc-98f7-bf34185ba11a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:15.784683 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f382c6-494f-4afc-98f7-bf34185ba11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:15.803543 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-29f382c6-494f-4afc-98f7-bf34185ba11a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:15.804661 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-29f382c6-494f-4afc-98f7-bf34185ba11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:15.812964 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1119/2211] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:15.817715 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38587e8a-68a5-418b-a105-60f7957877b7 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:15.827588 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38587e8a-68a5-418b-a105-60f7957877b7 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:15.832708 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2e68d-edfa-46cf-bd55-45d9eb326b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:15.833390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2e68d-edfa-46cf-bd55-45d9eb326b2e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:15.833667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2e68d-edfa-46cf-bd55-45d9eb326b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:15.833999 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2e68d-edfa-46cf-bd55-45d9eb326b2e admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:15.834730 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2e68d-edfa-46cf-bd55-45d9eb326b2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:35:15.835031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2e68d-edfa-46cf-bd55-45d9eb326b2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:15.836694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2e68d-edfa-46cf-bd55-45d9eb326b2e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:15.848963 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1093/2212] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:35:15.853090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f382c6-494f-4afc-98f7-bf34185ba11a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:15.862184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f382c6-494f-4afc-98f7-bf34185ba11a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:15.867639 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9ef61-88b8-4f25-9f8b-745fdb617fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:15.868464 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9ef61-88b8-4f25-9f8b-745fdb617fc7 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:15.874065 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9ef61-88b8-4f25-9f8b-745fdb617fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:15.874065 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a9ef61-88b8-4f25-9f8b-745fdb617fc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:15.874065 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9ef61-88b8-4f25-9f8b-745fdb617fc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:15.874065 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a9ef61-88b8-4f25-9f8b-745fdb617fc7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:15.990499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1120/2213] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:15 2022] POST /identity/v3/projects => generated 367 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:15.991835 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2e68d-edfa-46cf-bd55-45d9eb326b2e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:16.001996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2e68d-edfa-46cf-bd55-45d9eb326b2e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:16.061978 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db964c0d-16d5-4d74-add1-cceb05a10d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:16.062587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db964c0d-16d5-4d74-add1-cceb05a10d01 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:16.062789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db964c0d-16d5-4d74-add1-cceb05a10d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:16.063073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db964c0d-16d5-4d74-add1-cceb05a10d01 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:16.063979 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db964c0d-16d5-4d74-add1-cceb05a10d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:16.066751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db964c0d-16d5-4d74-add1-cceb05a10d01 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:16.166122 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1094/2214] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:15 2022] POST /identity/v3/users => generated 284 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:16.167384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9ef61-88b8-4f25-9f8b-745fdb617fc7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:16.178602 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a9ef61-88b8-4f25-9f8b-745fdb617fc7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:16.183621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c016f0d-1673-4fd0-a518-9e9dff6ef3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:16.184306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c016f0d-1673-4fd0-a518-9e9dff6ef3cb admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:16.184713 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c016f0d-1673-4fd0-a518-9e9dff6ef3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:16.185050 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c016f0d-1673-4fd0-a518-9e9dff6ef3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:16.185803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c016f0d-1673-4fd0-a518-9e9dff6ef3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:16.187547 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c016f0d-1673-4fd0-a518-9e9dff6ef3cb admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:16.199145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1121/2215] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:16.202958 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db964c0d-16d5-4d74-add1-cceb05a10d01 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:16.213753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db964c0d-16d5-4d74-add1-cceb05a10d01 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:16.218797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79daece6-ee5b-446c-b9ad-44232f48d984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:16.223096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daece6-ee5b-446c-b9ad-44232f48d984 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:16.223096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daece6-ee5b-446c-b9ad-44232f48d984 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:16.223096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79daece6-ee5b-446c-b9ad-44232f48d984 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:16.223096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79daece6-ee5b-446c-b9ad-44232f48d984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:16.223096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79daece6-ee5b-446c-b9ad-44232f48d984 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:16.233040 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1095/2216] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:16.237052 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c016f0d-1673-4fd0-a518-9e9dff6ef3cb admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:16.247546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c016f0d-1673-4fd0-a518-9e9dff6ef3cb admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:16.252267 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe9d3f-bfe0-4302-8cb8-39ef27ca9e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:16.253122 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe9d3f-bfe0-4302-8cb8-39ef27ca9e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:16.253403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe9d3f-bfe0-4302-8cb8-39ef27ca9e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:16.254273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe9d3f-bfe0-4302-8cb8-39ef27ca9e93 admin admin] PATH_INFO: `/v3/projects/88c34f57e6044ed9b4eabd8ecd4b1894/users/12e948daa3e34c43b6fabd222e3502eb/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:16.269171 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe9d3f-bfe0-4302-8cb8-39ef27ca9e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88c34f57e6044ed9b4eabd8ecd4b1894, user_id=12e948daa3e34c43b6fabd222e3502eb, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:16.271895 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe9d3f-bfe0-4302-8cb8-39ef27ca9e93 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:16.351316 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1122/2217] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:16 2022] PUT /identity/v3/projects/88c34f57e6044ed9b4eabd8ecd4b1894/users/12e948daa3e34c43b6fabd222e3502eb/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:16.360989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaddeb-9bf9-43cb-95d0-e4521b1e191b None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:16.361271 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaddeb-9bf9-43cb-95d0-e4521b1e191b None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:16.361547 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaddeb-9bf9-43cb-95d0-e4521b1e191b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:16.389121 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-fecaddeb-9bf9-43cb-95d0-e4521b1e191b None None] MFA Rules not processed for user `12e948daa3e34c43b6fabd222e3502eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:16.390362 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-fecaddeb-9bf9-43cb-95d0-e4521b1e191b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:16.454107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1096/2218] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:16.459497 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe9d3f-bfe0-4302-8cb8-39ef27ca9e93 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:16.542357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe9d3f-bfe0-4302-8cb8-39ef27ca9e93 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:16.547014 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09fefa-c2b8-47b0-9e82-79adff43df51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:16.547698 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09fefa-c2b8-47b0-9e82-79adff43df51 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:16.547978 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09fefa-c2b8-47b0-9e82-79adff43df51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:16.548251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09fefa-c2b8-47b0-9e82-79adff43df51 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:16.548977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09fefa-c2b8-47b0-9e82-79adff43df51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:16.551623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09fefa-c2b8-47b0-9e82-79adff43df51 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:16.618345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1123/2219] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:16 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:35:16.620852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaddeb-9bf9-43cb-95d0-e4521b1e191b None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:16.631544 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaddeb-9bf9-43cb-95d0-e4521b1e191b None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:16.691864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f05d7-7e05-4d69-8f28-08720109da6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:16.692640 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f05d7-7e05-4d69-8f28-08720109da6a admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:16.692843 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f05d7-7e05-4d69-8f28-08720109da6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:16.693110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f05d7-7e05-4d69-8f28-08720109da6a admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:16.693837 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f05d7-7e05-4d69-8f28-08720109da6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:16.698852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f05d7-7e05-4d69-8f28-08720109da6a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:16.771218 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1097/2220] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:16 2022] POST /identity/v3/users => generated 290 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:16.775442 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09fefa-c2b8-47b0-9e82-79adff43df51 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:16.786172 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09fefa-c2b8-47b0-9e82-79adff43df51 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:16.791340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a04576-84a6-4dba-a77f-f0e0ea86831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:16.792068 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04576-84a6-4dba-a77f-f0e0ea86831d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:16.792419 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04576-84a6-4dba-a77f-f0e0ea86831d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:16.792764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a04576-84a6-4dba-a77f-f0e0ea86831d admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:16.793591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a04576-84a6-4dba-a77f-f0e0ea86831d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:16.795301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a04576-84a6-4dba-a77f-f0e0ea86831d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:16.807930 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1124/2221] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:16.812110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f05d7-7e05-4d69-8f28-08720109da6a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:16.823350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f05d7-7e05-4d69-8f28-08720109da6a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:16.828075 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babb193-3e9b-49df-be21-f9c808237a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:16.828956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babb193-3e9b-49df-be21-f9c808237a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:16.829235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babb193-3e9b-49df-be21-f9c808237a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:16.829645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babb193-3e9b-49df-be21-f9c808237a48 admin admin] PATH_INFO: `/v3/projects/211b5846ab85452f85285f7462964d4d/users/c26f4724c66e47179b066cee281c494b/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:16.852793 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babb193-3e9b-49df-be21-f9c808237a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=211b5846ab85452f85285f7462964d4d, user_id=c26f4724c66e47179b066cee281c494b, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:16.855828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babb193-3e9b-49df-be21-f9c808237a48 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:16.940052 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1098/2222] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:16 2022] PUT /identity/v3/projects/211b5846ab85452f85285f7462964d4d/users/c26f4724c66e47179b066cee281c494b/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:16.944678 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a04576-84a6-4dba-a77f-f0e0ea86831d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:16.954598 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a04576-84a6-4dba-a77f-f0e0ea86831d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:17.010554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f540064-f6f3-438f-92b5-53608dc488b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:17.011253 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f540064-f6f3-438f-92b5-53608dc488b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:17.011523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f540064-f6f3-438f-92b5-53608dc488b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:17.011797 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f540064-f6f3-438f-92b5-53608dc488b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:17.012539 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f540064-f6f3-438f-92b5-53608dc488b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:17.014148 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f540064-f6f3-438f-92b5-53608dc488b3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:17.024857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1125/2223] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:17.029032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babb193-3e9b-49df-be21-f9c808237a48 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:17.039558 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babb193-3e9b-49df-be21-f9c808237a48 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:17.044394 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd781e-df43-4dbf-9765-ec5479123c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:17.045278 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd781e-df43-4dbf-9765-ec5479123c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:17.045568 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd781e-df43-4dbf-9765-ec5479123c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:17.045896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd781e-df43-4dbf-9765-ec5479123c22 admin admin] PATH_INFO: `/v3/projects/211b5846ab85452f85285f7462964d4d/users/c26f4724c66e47179b066cee281c494b/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:17.048031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd781e-df43-4dbf-9765-ec5479123c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=211b5846ab85452f85285f7462964d4d, user_id=c26f4724c66e47179b066cee281c494b, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:17.051420 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd781e-df43-4dbf-9765-ec5479123c22 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:17.062273 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1099/2224] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:17 2022] PUT /identity/v3/projects/211b5846ab85452f85285f7462964d4d/users/c26f4724c66e47179b066cee281c494b/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:17.073672 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6e753-766e-4bbe-8c8e-d7487710ea8a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:17.073996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6e753-766e-4bbe-8c8e-d7487710ea8a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:17.074280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6e753-766e-4bbe-8c8e-d7487710ea8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:17.103481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c3b6e753-766e-4bbe-8c8e-d7487710ea8a None None] MFA Rules not processed for user `c26f4724c66e47179b066cee281c494b`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:17.104698 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c3b6e753-766e-4bbe-8c8e-d7487710ea8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:17.189041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1126/2225] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:17 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:17.193623 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd781e-df43-4dbf-9765-ec5479123c22 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:17.195489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-8efd781e-df43-4dbf-9765-ec5479123c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:17.270295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd781e-df43-4dbf-9765-ec5479123c22 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:17.279264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c434380-837e-4a4b-bfd7-94573ee85c14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:17.279264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434380-837e-4a4b-bfd7-94573ee85c14 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:17.279264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434380-837e-4a4b-bfd7-94573ee85c14 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:17.279264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c434380-837e-4a4b-bfd7-94573ee85c14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:17.289651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c434380-837e-4a4b-bfd7-94573ee85c14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:17.291415 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c434380-837e-4a4b-bfd7-94573ee85c14 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:17.303319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1100/2226] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:17 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:35:17.493808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6e753-766e-4bbe-8c8e-d7487710ea8a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:17.503256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6e753-766e-4bbe-8c8e-d7487710ea8a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:17.507134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c3bb22-72c2-4afc-ad92-017803c897ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:17.507832 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3bb22-72c2-4afc-ad92-017803c897ae service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:17.508114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3bb22-72c2-4afc-ad92-017803c897ae service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:17.508411 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c3bb22-72c2-4afc-ad92-017803c897ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:17.565965 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3bb22-72c2-4afc-ad92-017803c897ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:17.567417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c3bb22-72c2-4afc-ad92-017803c897ae service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:17.576398 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1127/2227] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:35:24.224204 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c434380-837e-4a4b-bfd7-94573ee85c14 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:24.300331 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c434380-837e-4a4b-bfd7-94573ee85c14 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:24.305599 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afcc26-2a41-4813-97e5-6b0977a38d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:24.306535 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afcc26-2a41-4813-97e5-6b0977a38d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:24.306883 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afcc26-2a41-4813-97e5-6b0977a38d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:24.307220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afcc26-2a41-4813-97e5-6b0977a38d70 admin admin] PATH_INFO: `/v3/users/12e948daa3e34c43b6fabd222e3502eb` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:24.308609 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afcc26-2a41-4813-97e5-6b0977a38d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e948daa3e34c43b6fabd222e3502eb)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:24.310907 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afcc26-2a41-4813-97e5-6b0977a38d70 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:24.473343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-91afcc26-2a41-4813-97e5-6b0977a38d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e948daa3e34c43b6fabd222e3502eb'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:24.473989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-91afcc26-2a41-4813-97e5-6b0977a38d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e948daa3e34c43b6fabd222e3502eb'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:24.474635 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-91afcc26-2a41-4813-97e5-6b0977a38d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e948daa3e34c43b6fabd222e3502eb'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:24.485918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-91afcc26-2a41-4813-97e5-6b0977a38d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e948daa3e34c43b6fabd222e3502eb'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:24.492543 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-91afcc26-2a41-4813-97e5-6b0977a38d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e948daa3e34c43b6fabd222e3502eb'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:24.545062 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1101/2228] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:35:24 2022] DELETE /identity/v3/users/12e948daa3e34c43b6fabd222e3502eb => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:24.549559 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b88d5-d69c-43f5-b228-a2542d105b85 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:24.550087 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b88d5-d69c-43f5-b228-a2542d105b85 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:24.550213 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b88d5-d69c-43f5-b228-a2542d105b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:24.567201 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-b61b88d5-d69c-43f5-b228-a2542d105b85 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:24.568408 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b61b88d5-d69c-43f5-b228-a2542d105b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:24.627755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1128/2229] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:24.638158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afcc26-2a41-4813-97e5-6b0977a38d70 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:24.639566 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-91afcc26-2a41-4813-97e5-6b0977a38d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:24.703727 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afcc26-2a41-4813-97e5-6b0977a38d70 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:24.708902 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e730a38-cdd8-47e5-99e4-f6e80c166e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:24.709790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e730a38-cdd8-47e5-99e4-f6e80c166e9a service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:24.710078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e730a38-cdd8-47e5-99e4-f6e80c166e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:24.710410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e730a38-cdd8-47e5-99e4-f6e80c166e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:24.721815 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e730a38-cdd8-47e5-99e4-f6e80c166e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:24.724078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e730a38-cdd8-47e5-99e4-f6e80c166e9a service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:24.734705 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1102/2230] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:35:25.181184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b88d5-d69c-43f5-b228-a2542d105b85 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:25.182601 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b61b88d5-d69c-43f5-b228-a2542d105b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:25.197107 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b88d5-d69c-43f5-b228-a2542d105b85 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:25.202452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:25.203441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:25.203623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:25.203898 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] PATH_INFO: `/v3/projects/88c34f57e6044ed9b4eabd8ecd4b1894` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:25.205587 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88c34f57e6044ed9b4eabd8ecd4b1894)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:25.213439 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:25.310322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88c34f57e6044ed9b4eabd8ecd4b1894', 'request_id': 'req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.430508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88c34f57e6044ed9b4eabd8ecd4b1894', 'request_id': 'req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.432540 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e730a38-cdd8-47e5-99e4-f6e80c166e9a service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:25.433957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-3e730a38-cdd8-47e5-99e4-f6e80c166e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:25.437031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88c34f57e6044ed9b4eabd8ecd4b1894', 'request_id': 'req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.446606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e730a38-cdd8-47e5-99e4-f6e80c166e9a service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:25.448729 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] The token cache is being invalidate because project 88c34f57e6044ed9b4eabd8ecd4b1894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:25.449019 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.449671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.451197 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1129/2231] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:25 2022] DELETE /identity/v3/projects/88c34f57e6044ed9b4eabd8ecd4b1894 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:25.454933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:25.456216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:25.506926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214cb4d5-4fd2-4b28-8cbf-45700c1b79fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:25.507843 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cb4d5-4fd2-4b28-8cbf-45700c1b79fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:25.508123 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cb4d5-4fd2-4b28-8cbf-45700c1b79fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:25.508395 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214cb4d5-4fd2-4b28-8cbf-45700c1b79fa admin admin] PATH_INFO: `/v3/users/b6ddf591e60847a1a02f15167411c9d7` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:25.509716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cb4d5-4fd2-4b28-8cbf-45700c1b79fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6ddf591e60847a1a02f15167411c9d7)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:25.511663 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214cb4d5-4fd2-4b28-8cbf-45700c1b79fa admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:25.523632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e572ea-d8c2-4073-b0fa-95bc4c6450d2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:25.529310 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f90ce-00d1-443d-9626-d4b2cfb829fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:25.530207 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f90ce-00d1-443d-9626-d4b2cfb829fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:25.530488 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f90ce-00d1-443d-9626-d4b2cfb829fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:25.530764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f90ce-00d1-443d-9626-d4b2cfb829fb admin admin] PATH_INFO: `/v3/users/c26f4724c66e47179b066cee281c494b` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:25.532006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f90ce-00d1-443d-9626-d4b2cfb829fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c26f4724c66e47179b066cee281c494b)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:25.534016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f90ce-00d1-443d-9626-d4b2cfb829fb admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:25.785153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-979f90ce-00d1-443d-9626-d4b2cfb829fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c26f4724c66e47179b066cee281c494b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.786336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-979f90ce-00d1-443d-9626-d4b2cfb829fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c26f4724c66e47179b066cee281c494b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.787386 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-979f90ce-00d1-443d-9626-d4b2cfb829fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c26f4724c66e47179b066cee281c494b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.791590 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-214cb4d5-4fd2-4b28-8cbf-45700c1b79fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6ddf591e60847a1a02f15167411c9d7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.792353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-214cb4d5-4fd2-4b28-8cbf-45700c1b79fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6ddf591e60847a1a02f15167411c9d7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.793241 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-214cb4d5-4fd2-4b28-8cbf-45700c1b79fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6ddf591e60847a1a02f15167411c9d7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.801176 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-979f90ce-00d1-443d-9626-d4b2cfb829fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c26f4724c66e47179b066cee281c494b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.819718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-214cb4d5-4fd2-4b28-8cbf-45700c1b79fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6ddf591e60847a1a02f15167411c9d7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.819718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-214cb4d5-4fd2-4b28-8cbf-45700c1b79fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6ddf591e60847a1a02f15167411c9d7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.819960 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-979f90ce-00d1-443d-9626-d4b2cfb829fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c26f4724c66e47179b066cee281c494b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:25.883334 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1103/2232] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:35:25 2022] DELETE /identity/v3/users/b6ddf591e60847a1a02f15167411c9d7 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:25.887688 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29661b-1fc6-4ad9-8683-41530560317f None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:25.888050 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29661b-1fc6-4ad9-8683-41530560317f None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:25.888433 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29661b-1fc6-4ad9-8683-41530560317f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:25.906493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-7d29661b-1fc6-4ad9-8683-41530560317f None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:25.907852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7d29661b-1fc6-4ad9-8683-41530560317f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:25.954564 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1130/2233] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:35:25 2022] DELETE /identity/v3/users/c26f4724c66e47179b066cee281c494b => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:25.981674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1104/2234] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:25.993286 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f90ce-00d1-443d-9626-d4b2cfb829fb admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:25.995118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-979f90ce-00d1-443d-9626-d4b2cfb829fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:26.062694 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f90ce-00d1-443d-9626-d4b2cfb829fb admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:26.067107 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7417e-2106-47a4-8f29-1f000676ee6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:26.067784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7417e-2106-47a4-8f29-1f000676ee6f service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:26.068067 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7417e-2106-47a4-8f29-1f000676ee6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:26.068335 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7417e-2106-47a4-8f29-1f000676ee6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:26.130616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7417e-2106-47a4-8f29-1f000676ee6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:26.132182 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7417e-2106-47a4-8f29-1f000676ee6f service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:26.143501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1131/2235] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:35:26.519509 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29661b-1fc6-4ad9-8683-41530560317f None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:26.521658 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7d29661b-1fc6-4ad9-8683-41530560317f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:26.541778 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29661b-1fc6-4ad9-8683-41530560317f None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:26.547300 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5f86b-4593-420f-a98e-ded3684d623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:26.548361 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5f86b-4593-420f-a98e-ded3684d623c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:26.551493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5f86b-4593-420f-a98e-ded3684d623c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:26.551805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5f86b-4593-420f-a98e-ded3684d623c admin admin] PATH_INFO: `/v3/projects/211b5846ab85452f85285f7462964d4d` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:26.554839 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5f86b-4593-420f-a98e-ded3684d623c admin admin] RBAC: Authorizing `identity:delete_project(project_id=211b5846ab85452f85285f7462964d4d)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:26.558240 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5f86b-4593-420f-a98e-ded3684d623c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:26.703712 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-99c5f86b-4593-420f-a98e-ded3684d623c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '211b5846ab85452f85285f7462964d4d', 'request_id': 'req-99c5f86b-4593-420f-a98e-ded3684d623c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:26.710639 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-99c5f86b-4593-420f-a98e-ded3684d623c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '211b5846ab85452f85285f7462964d4d', 'request_id': 'req-99c5f86b-4593-420f-a98e-ded3684d623c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:26.714234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7417e-2106-47a4-8f29-1f000676ee6f service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:26.715742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d3e7417e-2106-47a4-8f29-1f000676ee6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:26.728304 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-99c5f86b-4593-420f-a98e-ded3684d623c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '211b5846ab85452f85285f7462964d4d', 'request_id': 'req-99c5f86b-4593-420f-a98e-ded3684d623c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:26.729230 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7417e-2106-47a4-8f29-1f000676ee6f service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:26.802852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf4505-73f3-4c7e-b062-8bba1b2493e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:26.804198 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf4505-73f3-4c7e-b062-8bba1b2493e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:26.804713 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf4505-73f3-4c7e-b062-8bba1b2493e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:26.805384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf4505-73f3-4c7e-b062-8bba1b2493e3 admin admin] PATH_INFO: `/v3/projects/81158026ccaa4f9ab0467d73628313a2` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:26.807095 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf4505-73f3-4c7e-b062-8bba1b2493e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81158026ccaa4f9ab0467d73628313a2)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:26.807371 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-99c5f86b-4593-420f-a98e-ded3684d623c admin admin] The token cache is being invalidate because project 211b5846ab85452f85285f7462964d4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:26.807687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-99c5f86b-4593-420f-a98e-ded3684d623c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:26.808511 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-99c5f86b-4593-420f-a98e-ded3684d623c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:26.809901 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf4505-73f3-4c7e-b062-8bba1b2493e3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:26.810230 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1105/2236] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:26 2022] DELETE /identity/v3/projects/211b5846ab85452f85285f7462964d4d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:26.815094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4594d-9b5f-4a34-9ad2-10ea106d801e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:26.815405 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4594d-9b5f-4a34-9ad2-10ea106d801e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:26.815738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a4594d-9b5f-4a34-9ad2-10ea106d801e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:26.837582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-59a4594d-9b5f-4a34-9ad2-10ea106d801e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:26.838789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-59a4594d-9b5f-4a34-9ad2-10ea106d801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:26.847101 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1106/2237] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:26.854848 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708af0a-54a4-46e5-a93f-8376a8bdbbb1 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:26.855193 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708af0a-54a4-46e5-a93f-8376a8bdbbb1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:26.861793 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d708af0a-54a4-46e5-a93f-8376a8bdbbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:26.875206 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-d708af0a-54a4-46e5-a93f-8376a8bdbbb1 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:26.878841 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d708af0a-54a4-46e5-a93f-8376a8bdbbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:26.886600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1107/2238] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:26.891150 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708af0a-54a4-46e5-a93f-8376a8bdbbb1 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:26.901160 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d708af0a-54a4-46e5-a93f-8376a8bdbbb1 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:26.908549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-93bf4505-73f3-4c7e-b062-8bba1b2493e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81158026ccaa4f9ab0467d73628313a2', 'request_id': 'req-93bf4505-73f3-4c7e-b062-8bba1b2493e3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:26.958699 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c836a-92ca-428f-b72c-499835849be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:26.959418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c836a-92ca-428f-b72c-499835849be3 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:26.959698 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c836a-92ca-428f-b72c-499835849be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:26.959968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c836a-92ca-428f-b72c-499835849be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:26.960702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c836a-92ca-428f-b72c-499835849be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:35:26.961002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c836a-92ca-428f-b72c-499835849be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:26.962578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c836a-92ca-428f-b72c-499835849be3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:26.975066 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1108/2239] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:35:26.979318 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c836a-92ca-428f-b72c-499835849be3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:26.985366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-93bf4505-73f3-4c7e-b062-8bba1b2493e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81158026ccaa4f9ab0467d73628313a2', 'request_id': 'req-93bf4505-73f3-4c7e-b062-8bba1b2493e3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:26.990871 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c836a-92ca-428f-b72c-499835849be3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:26.992512 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-93bf4505-73f3-4c7e-b062-8bba1b2493e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81158026ccaa4f9ab0467d73628313a2', 'request_id': 'req-93bf4505-73f3-4c7e-b062-8bba1b2493e3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:26.995967 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49e3e0-d98d-43ff-a040-9c77cd72e2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:26.996642 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49e3e0-d98d-43ff-a040-9c77cd72e2c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:26.996932 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49e3e0-d98d-43ff-a040-9c77cd72e2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:26.997209 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49e3e0-d98d-43ff-a040-9c77cd72e2c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:26.997950 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49e3e0-d98d-43ff-a040-9c77cd72e2c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:26.999833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e49e3e0-d98d-43ff-a040-9c77cd72e2c1 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.007131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-93bf4505-73f3-4c7e-b062-8bba1b2493e3 admin admin] The token cache is being invalidate because project 81158026ccaa4f9ab0467d73628313a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:27.007478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-93bf4505-73f3-4c7e-b062-8bba1b2493e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:27.008140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-93bf4505-73f3-4c7e-b062-8bba1b2493e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:27.009696 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1132/2240] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:26 2022] DELETE /identity/v3/projects/81158026ccaa4f9ab0467d73628313a2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:27.014490 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d58f0b-d072-48d1-8416-7096edc8b09b None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.014805 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d58f0b-d072-48d1-8416-7096edc8b09b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.015083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d58f0b-d072-48d1-8416-7096edc8b09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.033235 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-01d58f0b-d072-48d1-8416-7096edc8b09b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:27.034970 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-01d58f0b-d072-48d1-8416-7096edc8b09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:27.043061 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1133/2241] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:27.051621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fe656-bdae-49a5-83d1-9a8c33a66bc4 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.051904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fe656-bdae-49a5-83d1-9a8c33a66bc4 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.052187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838fe656-bdae-49a5-83d1-9a8c33a66bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.070741 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-838fe656-bdae-49a5-83d1-9a8c33a66bc4 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:27.072207 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-838fe656-bdae-49a5-83d1-9a8c33a66bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:27.080187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1134/2242] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:27.084545 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fe656-bdae-49a5-83d1-9a8c33a66bc4 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.093379 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838fe656-bdae-49a5-83d1-9a8c33a66bc4 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.098626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d48ea9-9e60-44f9-b2b7-66f42d02b05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.099209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d48ea9-9e60-44f9-b2b7-66f42d02b05b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.099514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d48ea9-9e60-44f9-b2b7-66f42d02b05b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.099785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d48ea9-9e60-44f9-b2b7-66f42d02b05b admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.100520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d48ea9-9e60-44f9-b2b7-66f42d02b05b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:35:27.100823 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d48ea9-9e60-44f9-b2b7-66f42d02b05b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.102414 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d48ea9-9e60-44f9-b2b7-66f42d02b05b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.115346 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1135/2243] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:35:27.119839 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d48ea9-9e60-44f9-b2b7-66f42d02b05b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.137684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d48ea9-9e60-44f9-b2b7-66f42d02b05b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.143779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749635e-fee5-4f2b-85ae-a700af1939c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.144513 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749635e-fee5-4f2b-85ae-a700af1939c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.144972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749635e-fee5-4f2b-85ae-a700af1939c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.145324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749635e-fee5-4f2b-85ae-a700af1939c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.146163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749635e-fee5-4f2b-85ae-a700af1939c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.148991 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749635e-fee5-4f2b-85ae-a700af1939c1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.149110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1109/2244] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:26 2022] POST /identity/v3/projects => generated 385 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:35:27.153285 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49e3e0-d98d-43ff-a040-9c77cd72e2c1 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.156216 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-1e49e3e0-d98d-43ff-a040-9c77cd72e2c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:27.227707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49e3e0-d98d-43ff-a040-9c77cd72e2c1 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.232540 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1136/2245] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:27 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:35:27.234800 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a504d5-253b-46ff-a70b-c879d8575c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.234800 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a504d5-253b-46ff-a70b-c879d8575c38 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.234800 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a504d5-253b-46ff-a70b-c879d8575c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.235081 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a504d5-253b-46ff-a70b-c879d8575c38 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.235765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a504d5-253b-46ff-a70b-c879d8575c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.238349 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749635e-fee5-4f2b-85ae-a700af1939c1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.238491 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a504d5-253b-46ff-a70b-c879d8575c38 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.299840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749635e-fee5-4f2b-85ae-a700af1939c1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.300679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1110/2246] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:27 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:27.304646 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a504d5-253b-46ff-a70b-c879d8575c38 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.305853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d1cfd-60b1-4344-9ada-dde4a2da7810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.306573 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1cfd-60b1-4344-9ada-dde4a2da7810 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.306853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1cfd-60b1-4344-9ada-dde4a2da7810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.307126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d1cfd-60b1-4344-9ada-dde4a2da7810 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.307852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d1cfd-60b1-4344-9ada-dde4a2da7810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.309870 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d1cfd-60b1-4344-9ada-dde4a2da7810 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.314411 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a504d5-253b-46ff-a70b-c879d8575c38 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.320234 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab96a4-a5da-46ac-b699-570230ab3908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.321094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab96a4-a5da-46ac-b699-570230ab3908 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.321266 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab96a4-a5da-46ac-b699-570230ab3908 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.321542 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab96a4-a5da-46ac-b699-570230ab3908 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.322323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab96a4-a5da-46ac-b699-570230ab3908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.324204 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faab96a4-a5da-46ac-b699-570230ab3908 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.335277 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1111/2247] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:35:27.339295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab96a4-a5da-46ac-b699-570230ab3908 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.349865 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab96a4-a5da-46ac-b699-570230ab3908 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.354603 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d822c2-7c9e-4497-8e5d-01f9e756aae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.355301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d822c2-7c9e-4497-8e5d-01f9e756aae1 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.355580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d822c2-7c9e-4497-8e5d-01f9e756aae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.355852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d822c2-7c9e-4497-8e5d-01f9e756aae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.356578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d822c2-7c9e-4497-8e5d-01f9e756aae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.358153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d822c2-7c9e-4497-8e5d-01f9e756aae1 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.369153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1112/2248] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:27.373095 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d822c2-7c9e-4497-8e5d-01f9e756aae1 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.383556 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d822c2-7c9e-4497-8e5d-01f9e756aae1 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.390088 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f8ed5-0d59-4091-ad60-d1429a4ce05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.391154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8ed5-0d59-4091-ad60-d1429a4ce05e admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.391610 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8ed5-0d59-4091-ad60-d1429a4ce05e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.392032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8ed5-0d59-4091-ad60-d1429a4ce05e admin admin] PATH_INFO: `/v3/projects/3972709f632a40db940c5d0a4fd7319f/users/6ea18c9d345a46f0ae14cccff13d2769/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.400364 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1137/2249] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:27 2022] POST /identity/v3/users => generated 290 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:35:27.404509 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d1cfd-60b1-4344-9ada-dde4a2da7810 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.413170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f8ed5-0d59-4091-ad60-d1429a4ce05e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3972709f632a40db940c5d0a4fd7319f, user_id=6ea18c9d345a46f0ae14cccff13d2769, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.415851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f8ed5-0d59-4091-ad60-d1429a4ce05e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.420321 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d1cfd-60b1-4344-9ada-dde4a2da7810 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.425768 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece264b-9f7f-452e-9a8a-f8fa75d7bc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.426607 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece264b-9f7f-452e-9a8a-f8fa75d7bc33 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.427024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece264b-9f7f-452e-9a8a-f8fa75d7bc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.427491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece264b-9f7f-452e-9a8a-f8fa75d7bc33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.428320 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece264b-9f7f-452e-9a8a-f8fa75d7bc33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.430114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ece264b-9f7f-452e-9a8a-f8fa75d7bc33 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.440760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1138/2250] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:27.444756 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece264b-9f7f-452e-9a8a-f8fa75d7bc33 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.455666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ece264b-9f7f-452e-9a8a-f8fa75d7bc33 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.460936 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c5968-2f79-4b39-8db0-e318d03dfc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.461583 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5968-2f79-4b39-8db0-e318d03dfc40 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.461865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5968-2f79-4b39-8db0-e318d03dfc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.462142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5968-2f79-4b39-8db0-e318d03dfc40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.462878 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c5968-2f79-4b39-8db0-e318d03dfc40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.464548 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c5968-2f79-4b39-8db0-e318d03dfc40 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.475952 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1139/2251] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:27.480152 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c5968-2f79-4b39-8db0-e318d03dfc40 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.490145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c5968-2f79-4b39-8db0-e318d03dfc40 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.494420 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1113/2252] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:27 2022] PUT /identity/v3/projects/3972709f632a40db940c5d0a4fd7319f/users/6ea18c9d345a46f0ae14cccff13d2769/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:27.504931 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31373e7b-85bd-4b7f-8483-62f33f14b351 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.505364 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31373e7b-85bd-4b7f-8483-62f33f14b351 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.505643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31373e7b-85bd-4b7f-8483-62f33f14b351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.535121 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-31373e7b-85bd-4b7f-8483-62f33f14b351 None None] MFA Rules not processed for user `6ea18c9d345a46f0ae14cccff13d2769`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:27.536394 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-31373e7b-85bd-4b7f-8483-62f33f14b351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:27.554998 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c95c88-d22f-4654-b9bf-adcf004ae68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.555981 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c95c88-d22f-4654-b9bf-adcf004ae68a admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.556367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c95c88-d22f-4654-b9bf-adcf004ae68a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.556537 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c95c88-d22f-4654-b9bf-adcf004ae68a admin admin] PATH_INFO: `/v3/projects/339d08e60b494bdbbcde5e0d99ed11bb/users/ff112ba8368d48b095d809f0ff560e12/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.571429 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c95c88-d22f-4654-b9bf-adcf004ae68a admin admin] RBAC: Authorizing `identity:create_grant(project_id=339d08e60b494bdbbcde5e0d99ed11bb, user_id=ff112ba8368d48b095d809f0ff560e12, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.574084 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c95c88-d22f-4654-b9bf-adcf004ae68a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.606105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1114/2253] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:27.610522 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31373e7b-85bd-4b7f-8483-62f33f14b351 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.620763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31373e7b-85bd-4b7f-8483-62f33f14b351 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.625400 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5959-9890-4bd3-85e0-9eba998855f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.626026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5959-9890-4bd3-85e0-9eba998855f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.626305 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5959-9890-4bd3-85e0-9eba998855f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.626577 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c5959-9890-4bd3-85e0-9eba998855f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.627336 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c5959-9890-4bd3-85e0-9eba998855f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.629532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c5959-9890-4bd3-85e0-9eba998855f7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.665811 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1140/2254] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:27 2022] PUT /identity/v3/projects/339d08e60b494bdbbcde5e0d99ed11bb/users/ff112ba8368d48b095d809f0ff560e12/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:35:27.670679 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533206d7-8636-4564-ad5d-33cae75197c0 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.670962 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533206d7-8636-4564-ad5d-33cae75197c0 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.671267 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533206d7-8636-4564-ad5d-33cae75197c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.687676 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-533206d7-8636-4564-ad5d-33cae75197c0 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:27.688852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-533206d7-8636-4564-ad5d-33cae75197c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:27.748860 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1115/2255] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:27 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:35:27.749082 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1141/2256] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:27.750406 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5959-9890-4bd3-85e0-9eba998855f7 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.756220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533206d7-8636-4564-ad5d-33cae75197c0 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.757590 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-533206d7-8636-4564-ad5d-33cae75197c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:27.810155 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c5959-9890-4bd3-85e0-9eba998855f7 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.813536 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533206d7-8636-4564-ad5d-33cae75197c0 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.814850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e8b9f-19eb-4609-8f97-319a84e6f07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.815538 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e8b9f-19eb-4609-8f97-319a84e6f07f admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.816310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e8b9f-19eb-4609-8f97-319a84e6f07f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.816579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e8b9f-19eb-4609-8f97-319a84e6f07f admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.817288 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e8b9f-19eb-4609-8f97-319a84e6f07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.819248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025e8b9f-19eb-4609-8f97-319a84e6f07f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.861139 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f299f1-8d98-400a-93e9-caf1c49a21a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.861702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f299f1-8d98-400a-93e9-caf1c49a21a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.861980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f299f1-8d98-400a-93e9-caf1c49a21a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.862253 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f299f1-8d98-400a-93e9-caf1c49a21a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.871523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f299f1-8d98-400a-93e9-caf1c49a21a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.872942 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f299f1-8d98-400a-93e9-caf1c49a21a5 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.882727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1142/2257] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:35:27.900201 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1116/2258] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:27 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:27.904330 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f299f1-8d98-400a-93e9-caf1c49a21a5 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.914173 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f299f1-8d98-400a-93e9-caf1c49a21a5 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.918817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf6853-d5b2-485e-8683-0c501de7effc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.919498 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf6853-d5b2-485e-8683-0c501de7effc admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.919779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf6853-d5b2-485e-8683-0c501de7effc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.920054 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf6853-d5b2-485e-8683-0c501de7effc admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.920800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf6853-d5b2-485e-8683-0c501de7effc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.922782 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf6853-d5b2-485e-8683-0c501de7effc admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:27.932604 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1143/2259] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:27.936506 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e8b9f-19eb-4609-8f97-319a84e6f07f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:27.947401 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e8b9f-19eb-4609-8f97-319a84e6f07f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:27.952235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dc3eb-752e-4752-b1e2-b0f33c89f08b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:27.953113 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc3eb-752e-4752-b1e2-b0f33c89f08b admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:27.956864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc3eb-752e-4752-b1e2-b0f33c89f08b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:27.956864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dc3eb-752e-4752-b1e2-b0f33c89f08b admin admin] PATH_INFO: `/v3/projects/3a566220d9b1427088517540994e2d9d/users/e5ca88a5ad1d453b80d2681b0aeb429f/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:27.970750 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dc3eb-752e-4752-b1e2-b0f33c89f08b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a566220d9b1427088517540994e2d9d, user_id=e5ca88a5ad1d453b80d2681b0aeb429f, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:27.973616 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dc3eb-752e-4752-b1e2-b0f33c89f08b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:28.094407 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1117/2260] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:27 2022] PUT /identity/v3/projects/3a566220d9b1427088517540994e2d9d/users/e5ca88a5ad1d453b80d2681b0aeb429f/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:28.098580 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf6853-d5b2-485e-8683-0c501de7effc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:28.108581 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf6853-d5b2-485e-8683-0c501de7effc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:28.166118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03a2b2-2b28-4a66-b6dc-b8d4b69a0364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:28.166793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a2b2-2b28-4a66-b6dc-b8d4b69a0364 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:28.167071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a2b2-2b28-4a66-b6dc-b8d4b69a0364 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:28.167407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03a2b2-2b28-4a66-b6dc-b8d4b69a0364 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:28.168152 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03a2b2-2b28-4a66-b6dc-b8d4b69a0364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:28.169820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03a2b2-2b28-4a66-b6dc-b8d4b69a0364 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:28.180895 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1144/2261] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:28.185086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dc3eb-752e-4752-b1e2-b0f33c89f08b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:28.195690 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dc3eb-752e-4752-b1e2-b0f33c89f08b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:28.200560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986e2c8-52cd-44f8-b7b5-5dca55fd6243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:28.201564 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986e2c8-52cd-44f8-b7b5-5dca55fd6243 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:28.201851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986e2c8-52cd-44f8-b7b5-5dca55fd6243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:28.202128 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986e2c8-52cd-44f8-b7b5-5dca55fd6243 admin admin] PATH_INFO: `/v3/projects/3a566220d9b1427088517540994e2d9d/users/e5ca88a5ad1d453b80d2681b0aeb429f/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:28.204194 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986e2c8-52cd-44f8-b7b5-5dca55fd6243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a566220d9b1427088517540994e2d9d, user_id=e5ca88a5ad1d453b80d2681b0aeb429f, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:28.207411 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986e2c8-52cd-44f8-b7b5-5dca55fd6243 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:28.217937 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1118/2262] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:28 2022] PUT /identity/v3/projects/3a566220d9b1427088517540994e2d9d/users/e5ca88a5ad1d453b80d2681b0aeb429f/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:28.242228 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00327110-08c7-4c64-a473-eb851b621f4f None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:28.242228 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00327110-08c7-4c64-a473-eb851b621f4f None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:28.242228 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00327110-08c7-4c64-a473-eb851b621f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:28.282831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-00327110-08c7-4c64-a473-eb851b621f4f None None] MFA Rules not processed for user `e5ca88a5ad1d453b80d2681b0aeb429f`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:28.283613 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-00327110-08c7-4c64-a473-eb851b621f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:28.359061 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1145/2263] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:28 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:28.370440 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986e2c8-52cd-44f8-b7b5-5dca55fd6243 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:28.373510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d986e2c8-52cd-44f8-b7b5-5dca55fd6243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:28.458036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986e2c8-52cd-44f8-b7b5-5dca55fd6243 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:28.464624 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1d862-8f2b-440f-b754-0fdcb6e1d7da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:28.465292 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1d862-8f2b-440f-b754-0fdcb6e1d7da service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:28.465730 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1d862-8f2b-440f-b754-0fdcb6e1d7da service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:28.466014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1d862-8f2b-440f-b754-0fdcb6e1d7da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:28.539705 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1d862-8f2b-440f-b754-0fdcb6e1d7da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:28.541094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1d862-8f2b-440f-b754-0fdcb6e1d7da service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:28.558752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1119/2264] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:35:29.708005 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00327110-08c7-4c64-a473-eb851b621f4f None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:29.711258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-00327110-08c7-4c64-a473-eb851b621f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:29.797917 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00327110-08c7-4c64-a473-eb851b621f4f None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:29.805126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75df8c5-5d5a-4095-8cdd-24e0640e09c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:29.806565 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75df8c5-5d5a-4095-8cdd-24e0640e09c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:29.807124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75df8c5-5d5a-4095-8cdd-24e0640e09c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:29.808122 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75df8c5-5d5a-4095-8cdd-24e0640e09c9 admin admin] PATH_INFO: `/v3/users/4ce54110926447e9827e44b1f3367c78` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:29.819368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75df8c5-5d5a-4095-8cdd-24e0640e09c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ce54110926447e9827e44b1f3367c78)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:29.819368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75df8c5-5d5a-4095-8cdd-24e0640e09c9 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:30.049542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c75df8c5-5d5a-4095-8cdd-24e0640e09c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ce54110926447e9827e44b1f3367c78'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:30.050821 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c75df8c5-5d5a-4095-8cdd-24e0640e09c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ce54110926447e9827e44b1f3367c78'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:30.053303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c75df8c5-5d5a-4095-8cdd-24e0640e09c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ce54110926447e9827e44b1f3367c78'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:30.083645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c75df8c5-5d5a-4095-8cdd-24e0640e09c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ce54110926447e9827e44b1f3367c78'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:30.102127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c75df8c5-5d5a-4095-8cdd-24e0640e09c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ce54110926447e9827e44b1f3367c78'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:30.219695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1146/2265] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:35:29 2022] DELETE /identity/v3/users/4ce54110926447e9827e44b1f3367c78 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:30.572953 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1d862-8f2b-440f-b754-0fdcb6e1d7da service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:30.619910 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1d862-8f2b-440f-b754-0fdcb6e1d7da service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:30.699969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:30.703391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:30.703391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:30.703391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] PATH_INFO: `/v3/projects/f7619382cbc9402a98fad6966ab48508` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:30.703391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7619382cbc9402a98fad6966ab48508)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:30.704553 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:30.808850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7619382cbc9402a98fad6966ab48508', 'request_id': 'req-5b04f4d4-61eb-479c-bffe-7630c90f9080'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:30.815367 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7619382cbc9402a98fad6966ab48508', 'request_id': 'req-5b04f4d4-61eb-479c-bffe-7630c90f9080'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:30.822221 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7619382cbc9402a98fad6966ab48508', 'request_id': 'req-5b04f4d4-61eb-479c-bffe-7630c90f9080'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:30.887870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] The token cache is being invalidate because project f7619382cbc9402a98fad6966ab48508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:30.888476 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:30.888970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:30.890628 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1120/2266] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:30 2022] DELETE /identity/v3/projects/f7619382cbc9402a98fad6966ab48508 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:30.894826 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75df8c5-5d5a-4095-8cdd-24e0640e09c9 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:30.896285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c75df8c5-5d5a-4095-8cdd-24e0640e09c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:30.911175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75df8c5-5d5a-4095-8cdd-24e0640e09c9 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:30.983037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a03a1f6-643a-4486-b281-cdefc27eb856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:30.984045 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03a1f6-643a-4486-b281-cdefc27eb856 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:30.984434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03a1f6-643a-4486-b281-cdefc27eb856 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:30.984766 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03a1f6-643a-4486-b281-cdefc27eb856 admin admin] PATH_INFO: `/v3/users/81b98f8b8e234c5ea69f4492545ebd5f` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:30.986877 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03a1f6-643a-4486-b281-cdefc27eb856 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81b98f8b8e234c5ea69f4492545ebd5f)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:30.989756 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a03a1f6-643a-4486-b281-cdefc27eb856 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:31.354724 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9a03a1f6-643a-4486-b281-cdefc27eb856 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81b98f8b8e234c5ea69f4492545ebd5f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:31.355276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9a03a1f6-643a-4486-b281-cdefc27eb856 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81b98f8b8e234c5ea69f4492545ebd5f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:31.355884 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9a03a1f6-643a-4486-b281-cdefc27eb856 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81b98f8b8e234c5ea69f4492545ebd5f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:31.368634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9a03a1f6-643a-4486-b281-cdefc27eb856 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81b98f8b8e234c5ea69f4492545ebd5f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:31.377292 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9a03a1f6-643a-4486-b281-cdefc27eb856 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81b98f8b8e234c5ea69f4492545ebd5f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:31.434651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1147/2267] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:35:30 2022] DELETE /identity/v3/users/81b98f8b8e234c5ea69f4492545ebd5f => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:31.714607 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:31.716421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:31.731621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b04f4d4-61eb-479c-bffe-7630c90f9080 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:31.807587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19369eab-848d-4d5a-8a23-2e4ee89dfa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:31.808455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19369eab-848d-4d5a-8a23-2e4ee89dfa05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:31.808740 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19369eab-848d-4d5a-8a23-2e4ee89dfa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:31.809017 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19369eab-848d-4d5a-8a23-2e4ee89dfa05 admin admin] PATH_INFO: `/v3/projects/04ae863db02049989222dd2c3f71f658` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:31.810255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19369eab-848d-4d5a-8a23-2e4ee89dfa05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ae863db02049989222dd2c3f71f658)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:31.812233 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19369eab-848d-4d5a-8a23-2e4ee89dfa05 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:31.910251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-19369eab-848d-4d5a-8a23-2e4ee89dfa05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ae863db02049989222dd2c3f71f658', 'request_id': 'req-19369eab-848d-4d5a-8a23-2e4ee89dfa05'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:31.917170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-19369eab-848d-4d5a-8a23-2e4ee89dfa05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ae863db02049989222dd2c3f71f658', 'request_id': 'req-19369eab-848d-4d5a-8a23-2e4ee89dfa05'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:31.923878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-19369eab-848d-4d5a-8a23-2e4ee89dfa05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ae863db02049989222dd2c3f71f658', 'request_id': 'req-19369eab-848d-4d5a-8a23-2e4ee89dfa05'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:32.025275 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-19369eab-848d-4d5a-8a23-2e4ee89dfa05 admin admin] The token cache is being invalidate because project 04ae863db02049989222dd2c3f71f658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:35:32.025645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-19369eab-848d-4d5a-8a23-2e4ee89dfa05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:32.026276 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-19369eab-848d-4d5a-8a23-2e4ee89dfa05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:35:32.027920 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1121/2268] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:35:31 2022] DELETE /identity/v3/projects/04ae863db02049989222dd2c3f71f658 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:32.035064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff4cc5-49fb-41eb-aee7-e2a3301e2fb6 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:32.035675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff4cc5-49fb-41eb-aee7-e2a3301e2fb6 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:32.035675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff4cc5-49fb-41eb-aee7-e2a3301e2fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:32.061926 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-f3ff4cc5-49fb-41eb-aee7-e2a3301e2fb6 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:32.063064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f3ff4cc5-49fb-41eb-aee7-e2a3301e2fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:32.160197 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1148/2269] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:32.168871 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5eabe-f48a-4dc1-8513-9808d777b433 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:32.168871 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5eabe-f48a-4dc1-8513-9808d777b433 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:32.168871 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5eabe-f48a-4dc1-8513-9808d777b433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:32.188590 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-4cd5eabe-f48a-4dc1-8513-9808d777b433 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:32.189837 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4cd5eabe-f48a-4dc1-8513-9808d777b433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:32.202135 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1122/2270] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:32.204760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff4cc5-49fb-41eb-aee7-e2a3301e2fb6 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:32.225286 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff4cc5-49fb-41eb-aee7-e2a3301e2fb6 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:32.232610 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c808640-ebf0-494b-9685-789907198ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:32.233301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c808640-ebf0-494b-9685-789907198ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:32.233587 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c808640-ebf0-494b-9685-789907198ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:32.233865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c808640-ebf0-494b-9685-789907198ed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:32.234626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c808640-ebf0-494b-9685-789907198ed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:35:32.235726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c808640-ebf0-494b-9685-789907198ed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:32.237868 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c808640-ebf0-494b-9685-789907198ed1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:32.258430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1149/2271] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:35:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:35:32.262957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5eabe-f48a-4dc1-8513-9808d777b433 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:32.279918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5eabe-f48a-4dc1-8513-9808d777b433 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:32.289529 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab78972-8708-4134-ac22-2f935020ba7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:32.290203 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab78972-8708-4134-ac22-2f935020ba7d admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:32.290833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab78972-8708-4134-ac22-2f935020ba7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:32.290833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab78972-8708-4134-ac22-2f935020ba7d admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:32.291479 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab78972-8708-4134-ac22-2f935020ba7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:32.293417 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab78972-8708-4134-ac22-2f935020ba7d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:32.399118 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1123/2272] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:32 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:32.403521 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c808640-ebf0-494b-9685-789907198ed1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:32.414502 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c808640-ebf0-494b-9685-789907198ed1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:32.479780 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cc752-d828-48c1-919c-0fcb51ca93a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:32.480456 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cc752-d828-48c1-919c-0fcb51ca93a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:32.480738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cc752-d828-48c1-919c-0fcb51ca93a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:32.481013 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33cc752-d828-48c1-919c-0fcb51ca93a4 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:32.481720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cc752-d828-48c1-919c-0fcb51ca93a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:32.483708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33cc752-d828-48c1-919c-0fcb51ca93a4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:32.594106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1150/2273] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:32 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:32.595469 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab78972-8708-4134-ac22-2f935020ba7d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:32.605834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab78972-8708-4134-ac22-2f935020ba7d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:32.610603 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992afc8-3f65-4098-b48b-1c8148843799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:32.611377 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992afc8-3f65-4098-b48b-1c8148843799 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:32.611732 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992afc8-3f65-4098-b48b-1c8148843799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:32.612098 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992afc8-3f65-4098-b48b-1c8148843799 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:32.612968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992afc8-3f65-4098-b48b-1c8148843799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:32.614623 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992afc8-3f65-4098-b48b-1c8148843799 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:32.625467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1124/2274] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:32.630219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cc752-d828-48c1-919c-0fcb51ca93a4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:32.641066 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33cc752-d828-48c1-919c-0fcb51ca93a4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:32.648427 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7096a5a-e7d9-48e3-8924-7398021680d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:32.649343 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7096a5a-e7d9-48e3-8924-7398021680d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:32.649957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7096a5a-e7d9-48e3-8924-7398021680d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:32.650566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7096a5a-e7d9-48e3-8924-7398021680d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:32.652345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7096a5a-e7d9-48e3-8924-7398021680d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:32.655475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7096a5a-e7d9-48e3-8924-7398021680d4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:32.673994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1151/2275] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:35:32.678516 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992afc8-3f65-4098-b48b-1c8148843799 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:32.693809 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992afc8-3f65-4098-b48b-1c8148843799 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:32.712578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd838ac9-1124-4f92-bf09-6f331b720f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:32.712578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd838ac9-1124-4f92-bf09-6f331b720f48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:32.712578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd838ac9-1124-4f92-bf09-6f331b720f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:32.712578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd838ac9-1124-4f92-bf09-6f331b720f48 admin admin] PATH_INFO: `/v3/projects/f079fba01c664eccb7bf42ff18799296/users/ca58b989229d48d0bff06947d1108aa5/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:32.735858 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd838ac9-1124-4f92-bf09-6f331b720f48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f079fba01c664eccb7bf42ff18799296, user_id=ca58b989229d48d0bff06947d1108aa5, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:32.742129 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd838ac9-1124-4f92-bf09-6f331b720f48 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:32.824844 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1125/2276] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:32 2022] PUT /identity/v3/projects/f079fba01c664eccb7bf42ff18799296/users/ca58b989229d48d0bff06947d1108aa5/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:32.840317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fee1-b0a7-4420-a5af-63e851faa3f7 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:32.840653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fee1-b0a7-4420-a5af-63e851faa3f7 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:32.841303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41fee1-b0a7-4420-a5af-63e851faa3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:32.881928 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-0a41fee1-b0a7-4420-a5af-63e851faa3f7 None None] MFA Rules not processed for user `ca58b989229d48d0bff06947d1108aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:32.883763 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-0a41fee1-b0a7-4420-a5af-63e851faa3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:32.976783 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1152/2277] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:32.990666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd838ac9-1124-4f92-bf09-6f331b720f48 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:32.993763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-cd838ac9-1124-4f92-bf09-6f331b720f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:33.071837 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd838ac9-1124-4f92-bf09-6f331b720f48 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:33.076899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f63b03-957c-4815-b5b6-df3624a3e221 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3df18302cd84e6eae6a1a60b0a8b2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:33.077538 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f63b03-957c-4815-b5b6-df3624a3e221 service glance] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:33.077791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f63b03-957c-4815-b5b6-df3624a3e221 service glance] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:33.078077 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f63b03-957c-4815-b5b6-df3624a3e221 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:33.106680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f63b03-957c-4815-b5b6-df3624a3e221 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:33.111496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f63b03-957c-4815-b5b6-df3624a3e221 service glance] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:33.137103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1126/2278] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:32 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:35:34.825214 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36721ba0-7848-4093-861c-4e012dfba016 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:34.825781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36721ba0-7848-4093-861c-4e012dfba016 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:34.825781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36721ba0-7848-4093-861c-4e012dfba016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:34.875921 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-36721ba0-7848-4093-861c-4e012dfba016 None None] MFA Rules not processed for user `ff112ba8368d48b095d809f0ff560e12`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:34.875921 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-36721ba0-7848-4093-861c-4e012dfba016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:34.958904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1153/2279] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:34.959054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f63b03-957c-4815-b5b6-df3624a3e221 service glance] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:34.959054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f2f63b03-957c-4815-b5b6-df3624a3e221 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:35.040882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f63b03-957c-4815-b5b6-df3624a3e221 service glance] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:35.046258 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9530dd-7c78-4358-96b3-69fcb6f9bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:35.047381 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9530dd-7c78-4358-96b3-69fcb6f9bbbf admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:35.047885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9530dd-7c78-4358-96b3-69fcb6f9bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:35.048470 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9530dd-7c78-4358-96b3-69fcb6f9bbbf admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:35.049368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9530dd-7c78-4358-96b3-69fcb6f9bbbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:35.052288 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9530dd-7c78-4358-96b3-69fcb6f9bbbf admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:35.157908 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1127/2280] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:35:34 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:35.162452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36721ba0-7848-4093-861c-4e012dfba016 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:35.173508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36721ba0-7848-4093-861c-4e012dfba016 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:35.229422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af417870-87db-47d3-8422-50bc2fd9342c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:35.230127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af417870-87db-47d3-8422-50bc2fd9342c admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:35.230408 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af417870-87db-47d3-8422-50bc2fd9342c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:35.230680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af417870-87db-47d3-8422-50bc2fd9342c admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:35.231435 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af417870-87db-47d3-8422-50bc2fd9342c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:35.233533 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af417870-87db-47d3-8422-50bc2fd9342c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:35.304582 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1154/2281] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:35:35 2022] POST /identity/v3/users => generated 295 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:35:35.304731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9530dd-7c78-4358-96b3-69fcb6f9bbbf admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:35.315809 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9530dd-7c78-4358-96b3-69fcb6f9bbbf admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:35.320643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cb83d-1057-408f-98d9-c5b28b4a4389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:35.321305 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cb83d-1057-408f-98d9-c5b28b4a4389 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:35.321585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cb83d-1057-408f-98d9-c5b28b4a4389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:35.321859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371cb83d-1057-408f-98d9-c5b28b4a4389 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:35.322626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cb83d-1057-408f-98d9-c5b28b4a4389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:35.324283 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371cb83d-1057-408f-98d9-c5b28b4a4389 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:35.337148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1128/2282] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:35.341352 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af417870-87db-47d3-8422-50bc2fd9342c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:35.355452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af417870-87db-47d3-8422-50bc2fd9342c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:35.357499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b38e65-596d-4062-9726-48e0539355c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:35.358373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b38e65-596d-4062-9726-48e0539355c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:35.358762 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b38e65-596d-4062-9726-48e0539355c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:35.358922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b38e65-596d-4062-9726-48e0539355c8 admin admin] PATH_INFO: `/v3/projects/c15303e1dd6c416595aa6a5268512a63/users/e8bc74d044e94c1e94985a7e942daf24/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:35.375902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b38e65-596d-4062-9726-48e0539355c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15303e1dd6c416595aa6a5268512a63, user_id=e8bc74d044e94c1e94985a7e942daf24, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:35.380194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b38e65-596d-4062-9726-48e0539355c8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:35.431287 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1155/2283] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:35 2022] PUT /identity/v3/projects/c15303e1dd6c416595aa6a5268512a63/users/e8bc74d044e94c1e94985a7e942daf24/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:35.435128 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cb83d-1057-408f-98d9-c5b28b4a4389 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:35.447349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371cb83d-1057-408f-98d9-c5b28b4a4389 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:35.510189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454981a-873f-40e6-8489-e2cbb10e4eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:35.511014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454981a-873f-40e6-8489-e2cbb10e4eee admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:35.511402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454981a-873f-40e6-8489-e2cbb10e4eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:35.511687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454981a-873f-40e6-8489-e2cbb10e4eee admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:35.512560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454981a-873f-40e6-8489-e2cbb10e4eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:35.514262 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454981a-873f-40e6-8489-e2cbb10e4eee admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:35.529490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1129/2284] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:35:35.530955 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b38e65-596d-4062-9726-48e0539355c8 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:35.541494 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b38e65-596d-4062-9726-48e0539355c8 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:35.546127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ace079-6262-4869-ac67-c1e49f2b09eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:35.546994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ace079-6262-4869-ac67-c1e49f2b09eb admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:35.547324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ace079-6262-4869-ac67-c1e49f2b09eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:35.547601 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ace079-6262-4869-ac67-c1e49f2b09eb admin admin] PATH_INFO: `/v3/projects/c15303e1dd6c416595aa6a5268512a63/users/e8bc74d044e94c1e94985a7e942daf24/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:35.549558 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ace079-6262-4869-ac67-c1e49f2b09eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15303e1dd6c416595aa6a5268512a63, user_id=e8bc74d044e94c1e94985a7e942daf24, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:35.552675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ace079-6262-4869-ac67-c1e49f2b09eb admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:35.563831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1156/2285] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:35:35 2022] PUT /identity/v3/projects/c15303e1dd6c416595aa6a5268512a63/users/e8bc74d044e94c1e94985a7e942daf24/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:35:42.308466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d61013-d61c-4755-abf2-765ba6a85a6e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:42.309113 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d61013-d61c-4755-abf2-765ba6a85a6e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:42.309515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d61013-d61c-4755-abf2-765ba6a85a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:42.338847 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-71d61013-d61c-4755-abf2-765ba6a85a6e None None] MFA Rules not processed for user `560fd9efb8a04f449acaf2f3987ce81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:42.340403 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-71d61013-d61c-4755-abf2-765ba6a85a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:42.418106 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1130/2286] 10.222.0.35 () {58 vars in 1009 bytes} [Sat Feb 12 04:35:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:42.477599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ace079-6262-4869-ac67-c1e49f2b09eb admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:42.479958 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-43ace079-6262-4869-ac67-c1e49f2b09eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:42.588878 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ace079-6262-4869-ac67-c1e49f2b09eb admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:42.595826 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c652fe3-f03d-4531-87e6-a784b20a86c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b37a10e3b5e404db7aad72e1772a2de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:42.597686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c652fe3-f03d-4531-87e6-a784b20a86c2 service swift] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:42.598041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c652fe3-f03d-4531-87e6-a784b20a86c2 service swift] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:42.598390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c652fe3-f03d-4531-87e6-a784b20a86c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:42.610106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c652fe3-f03d-4531-87e6-a784b20a86c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:42.616899 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c652fe3-f03d-4531-87e6-a784b20a86c2 service swift] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:42.626540 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1157/2287] 10.222.0.35 () {60 vars in 1384 bytes} [Sat Feb 12 04:35:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:35:43.265781 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862bc2-dbd0-4cde-8321-1c4e6bf415ec None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:43.266074 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862bc2-dbd0-4cde-8321-1c4e6bf415ec None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:43.266343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862bc2-dbd0-4cde-8321-1c4e6bf415ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:43.348711 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-01862bc2-dbd0-4cde-8321-1c4e6bf415ec None None] MFA Rules not processed for user `e8bc74d044e94c1e94985a7e942daf24`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:43.349920 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-01862bc2-dbd0-4cde-8321-1c4e6bf415ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:43.561682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1131/2288] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:35:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:35:43.569855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c652fe3-f03d-4531-87e6-a784b20a86c2 service swift] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:43.573759 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-8c652fe3-f03d-4531-87e6-a784b20a86c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:43.728501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c652fe3-f03d-4531-87e6-a784b20a86c2 service swift] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:43.740234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3048bc6-aabb-4bc4-a7a3-143768781257 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:43.741016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3048bc6-aabb-4bc4-a7a3-143768781257 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:43.741520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3048bc6-aabb-4bc4-a7a3-143768781257 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:43.742167 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3048bc6-aabb-4bc4-a7a3-143768781257 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:43.811744 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3048bc6-aabb-4bc4-a7a3-143768781257 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:35:43.813345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3048bc6-aabb-4bc4-a7a3-143768781257 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:35:43.823596 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1158/2289] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:35:59.872923 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fa56b-ca39-42c3-adbc-1316ee096d50 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:59.873520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fa56b-ca39-42c3-adbc-1316ee096d50 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:59.873647 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8fa56b-ca39-42c3-adbc-1316ee096d50 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:59.875476 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1132/2290] 10.222.0.35 () {54 vars in 921 bytes} [Sat Feb 12 04:35:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:35:59.885661 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dce02-df2f-416d-a5cd-11325e5bb3f7 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:59.886203 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dce02-df2f-416d-a5cd-11325e5bb3f7 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:59.886203 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191dce02-df2f-416d-a5cd-11325e5bb3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:35:59.906116 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-191dce02-df2f-416d-a5cd-11325e5bb3f7 None None] MFA Rules not processed for user `362ab4aeb88746d8b8a14a238c877a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:35:59.907463 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-191dce02-df2f-416d-a5cd-11325e5bb3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:59.917190 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1159/2291] 10.222.0.35 () {58 vars in 1018 bytes} [Sat Feb 12 04:35:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:35:59.929379 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fa56b-ca39-42c3-adbc-1316ee096d50 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:35:59.931075 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4e8fa56b-ca39-42c3-adbc-1316ee096d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:35:59.988223 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8fa56b-ca39-42c3-adbc-1316ee096d50 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:35:59.992441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc97d6b-090a-42e8-95dd-8922c269415d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3df18302cd84e6eae6a1a60b0a8b2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:35:59.993082 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc97d6b-090a-42e8-95dd-8922c269415d service glance] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:35:59.994058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc97d6b-090a-42e8-95dd-8922c269415d service glance] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:35:59.994058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc97d6b-090a-42e8-95dd-8922c269415d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:36:00.004168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc97d6b-090a-42e8-95dd-8922c269415d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:36:00.005685 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc97d6b-090a-42e8-95dd-8922c269415d service glance] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:36:00.016532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1133/2292] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:35:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:36:00.197036 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d08742-061a-4b54-9935-014a0a713945 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:36:00.197318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d08742-061a-4b54-9935-014a0a713945 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:36:00.197588 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d08742-061a-4b54-9935-014a0a713945 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:36:00.199391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1160/2293] 10.222.0.35 () {54 vars in 921 bytes} [Sat Feb 12 04:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:36:00.205685 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1dc13-5785-4213-aa34-bbf00aff1cfc None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:36:00.205970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1dc13-5785-4213-aa34-bbf00aff1cfc None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:36:00.206241 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b1dc13-5785-4213-aa34-bbf00aff1cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:36:00.224432 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-18b1dc13-5785-4213-aa34-bbf00aff1cfc None None] MFA Rules not processed for user `d9c5541a29cf42f6ab394133baa05fae`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:36:00.225648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-18b1dc13-5785-4213-aa34-bbf00aff1cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:36:00.275731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1134/2294] 10.222.0.35 () {58 vars in 1018 bytes} [Sat Feb 12 04:36:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:36:00.287563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d08742-061a-4b54-9935-014a0a713945 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:36:00.289208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-58d08742-061a-4b54-9935-014a0a713945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:36:00.302578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d08742-061a-4b54-9935-014a0a713945 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:36:00.306032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e907b98-8455-4dcc-a3b8-5b45791d3059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:36:00.306651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907b98-8455-4dcc-a3b8-5b45791d3059 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:36:00.306952 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907b98-8455-4dcc-a3b8-5b45791d3059 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:36:00.307250 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e907b98-8455-4dcc-a3b8-5b45791d3059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:36:00.314033 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e907b98-8455-4dcc-a3b8-5b45791d3059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:36:00.315459 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e907b98-8455-4dcc-a3b8-5b45791d3059 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:36:00.322935 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1161/2295] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:36:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:36:00.411480 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf0399-2a96-493d-bbc8-fb71930e3538 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:36:00.411772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf0399-2a96-493d-bbc8-fb71930e3538 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:36:00.412043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf0399-2a96-493d-bbc8-fb71930e3538 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:36:00.413800 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1135/2296] 10.222.0.35 () {54 vars in 921 bytes} [Sat Feb 12 04:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:36:00.419369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8736aa-e0a8-41a2-9754-7a4f7d64e30a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:36:00.419657 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8736aa-e0a8-41a2-9754-7a4f7d64e30a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:36:00.419930 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8736aa-e0a8-41a2-9754-7a4f7d64e30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:36:00.437824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1c8736aa-e0a8-41a2-9754-7a4f7d64e30a None None] MFA Rules not processed for user `362ab4aeb88746d8b8a14a238c877a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:36:00.439000 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1c8736aa-e0a8-41a2-9754-7a4f7d64e30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:36:00.448025 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1162/2297] 10.222.0.35 () {58 vars in 1018 bytes} [Sat Feb 12 04:36:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:36:00.458610 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf0399-2a96-493d-bbc8-fb71930e3538 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:36:00.469301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bf0399-2a96-493d-bbc8-fb71930e3538 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:36:00.472947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb979ac-bbee-4d3a-8427-859ae676414f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:36:00.474234 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb979ac-bbee-4d3a-8427-859ae676414f service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:36:00.474520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb979ac-bbee-4d3a-8427-859ae676414f service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:36:00.474796 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb979ac-bbee-4d3a-8427-859ae676414f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:36:00.485132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb979ac-bbee-4d3a-8427-859ae676414f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:36:00.486546 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb979ac-bbee-4d3a-8427-859ae676414f service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:36:00.497527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1136/2298] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:36:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:36:41.519380 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8736aa-e0a8-41a2-9754-7a4f7d64e30a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:36:41.521355 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1c8736aa-e0a8-41a2-9754-7a4f7d64e30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:36:41.655600 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8736aa-e0a8-41a2-9754-7a4f7d64e30a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:36:41.660766 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c10c4-f289-4220-9031-5afa3a290b9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:36:41.661398 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c10c4-f289-4220-9031-5afa3a290b9b service placement] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:36:41.661682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c10c4-f289-4220-9031-5afa3a290b9b service placement] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:36:41.661957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c10c4-f289-4220-9031-5afa3a290b9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:36:41.663724 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-509c10c4-f289-4220-9031-5afa3a290b9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:36:41.674702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c10c4-f289-4220-9031-5afa3a290b9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:36:41.676941 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509c10c4-f289-4220-9031-5afa3a290b9b service placement] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:36:41.686407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1163/2299] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:36:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:38:30.130790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb979ac-bbee-4d3a-8427-859ae676414f service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:38:30.132210 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ddb979ac-bbee-4d3a-8427-859ae676414f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:38:30.176389 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb979ac-bbee-4d3a-8427-859ae676414f service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:38:30.180893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d7db4-7658-42ac-8ef1-4bce6427ecb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:38:30.181531 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d7db4-7658-42ac-8ef1-4bce6427ecb7 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:38:30.181806 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d7db4-7658-42ac-8ef1-4bce6427ecb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:38:30.182077 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d7db4-7658-42ac-8ef1-4bce6427ecb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:38:30.183873 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-373d7db4-7658-42ac-8ef1-4bce6427ecb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:38:30.217312 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d7db4-7658-42ac-8ef1-4bce6427ecb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:38:30.219382 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d7db4-7658-42ac-8ef1-4bce6427ecb7 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:38:30.240981 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1137/2300] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:38:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:38:31.444367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c10c4-f289-4220-9031-5afa3a290b9b service placement] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:38:31.453587 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509c10c4-f289-4220-9031-5afa3a290b9b service placement] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:38:31.457452 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f36de-633b-415a-b826-b4351cae6e0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:38:31.457756 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f36de-633b-415a-b826-b4351cae6e0c service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:38:31.458032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f36de-633b-415a-b826-b4351cae6e0c service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:38:31.458306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f36de-633b-415a-b826-b4351cae6e0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:38:31.460193 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-781f36de-633b-415a-b826-b4351cae6e0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:38:31.473271 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f36de-633b-415a-b826-b4351cae6e0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:38:31.474705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781f36de-633b-415a-b826-b4351cae6e0c service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:38:31.485936 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1164/2301] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:38:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:38:39.147010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d7db4-7658-42ac-8ef1-4bce6427ecb7 service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:38:39.149136 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-373d7db4-7658-42ac-8ef1-4bce6427ecb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:38:39.223727 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d7db4-7658-42ac-8ef1-4bce6427ecb7 service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:38:39.227390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa429d-54be-4891-b254-575523192d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:38:39.228000 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa429d-54be-4891-b254-575523192d7c service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:38:39.228282 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa429d-54be-4891-b254-575523192d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:38:39.228558 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa429d-54be-4891-b254-575523192d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:38:39.230313 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-87aa429d-54be-4891-b254-575523192d7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:38:39.287008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa429d-54be-4891-b254-575523192d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:38:39.288484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa429d-54be-4891-b254-575523192d7c service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:38:39.297377 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1138/2302] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:38:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:38:39.673716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f36de-633b-415a-b826-b4351cae6e0c service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:38:39.682854 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f36de-633b-415a-b826-b4351cae6e0c service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:38:39.686468 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f1934-4f12-4859-af08-83aa2b43b64d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:38:39.687088 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f1934-4f12-4859-af08-83aa2b43b64d service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:38:39.687403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f1934-4f12-4859-af08-83aa2b43b64d service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:38:39.687677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f1934-4f12-4859-af08-83aa2b43b64d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:38:39.689653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-743f1934-4f12-4859-af08-83aa2b43b64d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:38:39.746220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f1934-4f12-4859-af08-83aa2b43b64d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:38:39.747164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f1934-4f12-4859-af08-83aa2b43b64d service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:38:39.756362 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1165/2303] 10.222.0.35 () {60 vars in 1396 bytes} [Sat Feb 12 04:38:39 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:38:40.796834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa429d-54be-4891-b254-575523192d7c service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:38:40.807849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa429d-54be-4891-b254-575523192d7c service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:38:40.813701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425451d7-21bf-47f3-b2af-76370b5589bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:38:40.813701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425451d7-21bf-47f3-b2af-76370b5589bf service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:38:40.813701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425451d7-21bf-47f3-b2af-76370b5589bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:38:40.813701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425451d7-21bf-47f3-b2af-76370b5589bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:38:40.815515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-425451d7-21bf-47f3-b2af-76370b5589bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:38:40.873133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425451d7-21bf-47f3-b2af-76370b5589bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:38:40.874600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425451d7-21bf-47f3-b2af-76370b5589bf service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:38:40.883717 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1139/2304] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:38:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:39:42.929667 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f1934-4f12-4859-af08-83aa2b43b64d service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:39:42.940177 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f1934-4f12-4859-af08-83aa2b43b64d service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:39:42.944421 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ef8c7-c282-46da-98af-c714a89916e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:39:42.945084 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef8c7-c282-46da-98af-c714a89916e5 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:39:42.945363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef8c7-c282-46da-98af-c714a89916e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:39:42.945636 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5ef8c7-c282-46da-98af-c714a89916e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:39:42.947433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3b5ef8c7-c282-46da-98af-c714a89916e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:39:43.002689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ef8c7-c282-46da-98af-c714a89916e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:39:43.004128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5ef8c7-c282-46da-98af-c714a89916e5 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:39:43.013434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1166/2305] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:39:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:39:43.948712 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425451d7-21bf-47f3-b2af-76370b5589bf service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:39:43.958145 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425451d7-21bf-47f3-b2af-76370b5589bf service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:39:43.961909 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a746f-053f-4aef-ae9c-520d73c001d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:39:43.962546 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a746f-053f-4aef-ae9c-520d73c001d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:39:43.962836 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a746f-053f-4aef-ae9c-520d73c001d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:39:43.963108 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9a746f-053f-4aef-ae9c-520d73c001d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:39:43.964968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7e9a746f-053f-4aef-ae9c-520d73c001d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:39:43.975031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a746f-053f-4aef-ae9c-520d73c001d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:39:43.976469 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9a746f-053f-4aef-ae9c-520d73c001d5 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:39:43.984573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1140/2306] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:39:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:40:29.053288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ef8c7-c282-46da-98af-c714a89916e5 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:40:29.054903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3b5ef8c7-c282-46da-98af-c714a89916e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:40:29.065492 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5ef8c7-c282-46da-98af-c714a89916e5 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:40:29.069744 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ec8ca-fe9e-4060-a525-13638779df88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:40:29.070363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ec8ca-fe9e-4060-a525-13638779df88 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:40:29.070641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ec8ca-fe9e-4060-a525-13638779df88 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:40:29.070916 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073ec8ca-fe9e-4060-a525-13638779df88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:40:29.072634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-073ec8ca-fe9e-4060-a525-13638779df88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:40:29.128237 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ec8ca-fe9e-4060-a525-13638779df88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:40:29.129684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073ec8ca-fe9e-4060-a525-13638779df88 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:40:29.139633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1167/2307] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:40:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:40:33.374515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a746f-053f-4aef-ae9c-520d73c001d5 service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:40:33.383907 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9a746f-053f-4aef-ae9c-520d73c001d5 service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:40:33.387646 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31c0d7-1023-4684-8fa2-490b255d91b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:40:33.388554 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31c0d7-1023-4684-8fa2-490b255d91b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:40:33.388835 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31c0d7-1023-4684-8fa2-490b255d91b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:40:33.389105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31c0d7-1023-4684-8fa2-490b255d91b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:40:33.445461 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31c0d7-1023-4684-8fa2-490b255d91b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:40:33.446892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31c0d7-1023-4684-8fa2-490b255d91b5 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:40:33.460103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1141/2308] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:40:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:40:44.009025 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ec8ca-fe9e-4060-a525-13638779df88 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:40:44.017688 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073ec8ca-fe9e-4060-a525-13638779df88 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:40:44.022363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ffe352-6570-4c47-b88a-9c887b7f8a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:40:44.023257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffe352-6570-4c47-b88a-9c887b7f8a12 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:40:44.023716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffe352-6570-4c47-b88a-9c887b7f8a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:40:44.024157 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ffe352-6570-4c47-b88a-9c887b7f8a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:40:44.033305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffe352-6570-4c47-b88a-9c887b7f8a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:40:44.034750 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ffe352-6570-4c47-b88a-9c887b7f8a12 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:40:44.044746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1168/2309] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:40:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:41:45.509297 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794bad4-70ba-440a-85c7-7285097d9080 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:41:45.509745 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794bad4-70ba-440a-85c7-7285097d9080 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:41:45.509851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794bad4-70ba-440a-85c7-7285097d9080 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:41:45.511916 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1142/2310] 10.222.0.35 () {54 vars in 960 bytes} [Sat Feb 12 04:41:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:41:45.516835 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b62480-89e6-41e4-a906-f742fdfa976c None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:41:45.517266 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b62480-89e6-41e4-a906-f742fdfa976c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:41:45.517387 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b62480-89e6-41e4-a906-f742fdfa976c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:41:45.573299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-a1b62480-89e6-41e4-a906-f742fdfa976c None None] MFA Rules not processed for user `d48fd9b23a4946cc81a9ad7845d26623`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:41:45.574498 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a1b62480-89e6-41e4-a906-f742fdfa976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:41:45.582985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1169/2311] 10.222.0.35 () {58 vars in 1057 bytes} [Sat Feb 12 04:41:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:41:45.590703 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794bad4-70ba-440a-85c7-7285097d9080 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:41:45.604349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794bad4-70ba-440a-85c7-7285097d9080 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:41:45.609236 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f0146-0e2d-449d-a24a-1cbe5eb0dd1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:41:45.609857 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0146-0e2d-449d-a24a-1cbe5eb0dd1f service placement] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:41:45.610138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0146-0e2d-449d-a24a-1cbe5eb0dd1f service placement] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:41:45.610410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f0146-0e2d-449d-a24a-1cbe5eb0dd1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:41:45.620463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f0146-0e2d-449d-a24a-1cbe5eb0dd1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:41:45.622022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f0146-0e2d-449d-a24a-1cbe5eb0dd1f service placement] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:41:45.631617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1143/2312] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:41:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:41:59.868827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589f22e-69f9-4078-8a31-dd065721144e None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:41:59.869312 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589f22e-69f9-4078-8a31-dd065721144e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:41:59.869407 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b589f22e-69f9-4078-8a31-dd065721144e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:41:59.916760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-b589f22e-69f9-4078-8a31-dd065721144e None None] MFA Rules not processed for user `560fd9efb8a04f449acaf2f3987ce81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:41:59.917953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b589f22e-69f9-4078-8a31-dd065721144e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:41:59.934712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1170/2313] 10.222.0.35 () {58 vars in 967 bytes} [Sat Feb 12 04:41:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:42:00.089582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f0146-0e2d-449d-a24a-1cbe5eb0dd1f service placement] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:42:00.109769 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f0146-0e2d-449d-a24a-1cbe5eb0dd1f service placement] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:42:00.114626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48d3f0-05a9-47ab-b9f6-570c18142531 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b37a10e3b5e404db7aad72e1772a2de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:42:00.115267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48d3f0-05a9-47ab-b9f6-570c18142531 service swift] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:42:00.115551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48d3f0-05a9-47ab-b9f6-570c18142531 service swift] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:42:00.116324 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48d3f0-05a9-47ab-b9f6-570c18142531 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:42:00.124245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48d3f0-05a9-47ab-b9f6-570c18142531 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:42:00.125773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48d3f0-05a9-47ab-b9f6-570c18142531 service swift] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:42:00.134052 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1144/2314] 10.222.0.35 () {60 vars in 1384 bytes} [Sat Feb 12 04:42:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 04:42:02.284094 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589f22e-69f9-4078-8a31-dd065721144e None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:42:02.297610 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b589f22e-69f9-4078-8a31-dd065721144e None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:42:02.303605 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73f49ff-3383-4436-a54f-b26bf0b5d386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:42:02.304603 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f49ff-3383-4436-a54f-b26bf0b5d386 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:42:02.304964 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f49ff-3383-4436-a54f-b26bf0b5d386 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:42:02.305345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73f49ff-3383-4436-a54f-b26bf0b5d386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:42:02.307156 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c73f49ff-3383-4436-a54f-b26bf0b5d386 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:42:02.319835 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f49ff-3383-4436-a54f-b26bf0b5d386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:42:02.321426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73f49ff-3383-4436-a54f-b26bf0b5d386 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:42:02.331952 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1171/2315] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:42:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:42:02.508885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce307847-d456-4eb0-a110-be2f3b52301c None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:42:02.509483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce307847-d456-4eb0-a110-be2f3b52301c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:42:02.509483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce307847-d456-4eb0-a110-be2f3b52301c None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:42:02.511456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1145/2316] 10.222.0.35 () {54 vars in 912 bytes} [Sat Feb 12 04:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 04:42:02.517197 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba2b3-082e-4149-8917-28c89c71905e None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:42:02.517597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba2b3-082e-4149-8917-28c89c71905e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:42:02.517822 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baba2b3-082e-4149-8917-28c89c71905e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:42:02.536684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-8baba2b3-082e-4149-8917-28c89c71905e None None] MFA Rules not processed for user `d48fd9b23a4946cc81a9ad7845d26623`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:42:02.538546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-8baba2b3-082e-4149-8917-28c89c71905e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:42:02.547341 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1172/2317] 10.222.0.35 () {58 vars in 1009 bytes} [Sat Feb 12 04:42:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:42:02.577323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce307847-d456-4eb0-a110-be2f3b52301c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:42:02.584199 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce307847-d456-4eb0-a110-be2f3b52301c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:42:02.589734 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a82215-1e02-444d-9a58-f6267e8456f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:42:02.590370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a82215-1e02-444d-9a58-f6267e8456f6 service placement] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:42:02.590651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a82215-1e02-444d-9a58-f6267e8456f6 service placement] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:42:02.590928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a82215-1e02-444d-9a58-f6267e8456f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:42:02.600074 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a82215-1e02-444d-9a58-f6267e8456f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:42:02.603617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a82215-1e02-444d-9a58-f6267e8456f6 service placement] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:42:02.612060 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1146/2318] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:42:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:42:06.436812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb31ad-1cb1-4f8d-bf60-46c7867cd361 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:42:06.437302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb31ad-1cb1-4f8d-bf60-46c7867cd361 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:42:06.437449 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb31ad-1cb1-4f8d-bf60-46c7867cd361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:42:06.454952 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c4cb31ad-1cb1-4f8d-bf60-46c7867cd361 None None] MFA Rules not processed for user `46193f5323954ed6b3a5e52fa0b3f0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:42:06.456182 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c4cb31ad-1cb1-4f8d-bf60-46c7867cd361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:42:06.463143 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1173/2319] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:42:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:42:06.764130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a82215-1e02-444d-9a58-f6267e8456f6 service placement] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:42:06.773689 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a82215-1e02-444d-9a58-f6267e8456f6 service placement] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:42:06.777267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ac731-d802-4060-8938-16202627dfe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:42:06.777893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac731-d802-4060-8938-16202627dfe3 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:42:06.778179 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac731-d802-4060-8938-16202627dfe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:42:06.778452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ac731-d802-4060-8938-16202627dfe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:42:06.780224 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9c2ac731-d802-4060-8938-16202627dfe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:42:06.789580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ac731-d802-4060-8938-16202627dfe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:42:06.791045 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ac731-d802-4060-8938-16202627dfe3 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:42:06.798667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1147/2320] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:42:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:42:07.231630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb31ad-1cb1-4f8d-bf60-46c7867cd361 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:42:07.240246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb31ad-1cb1-4f8d-bf60-46c7867cd361 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:42:07.245374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dee2e-4c08-4514-9f0e-822bc2cbbf7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:42:07.246014 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dee2e-4c08-4514-9f0e-822bc2cbbf7e service placement] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:42:07.246295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dee2e-4c08-4514-9f0e-822bc2cbbf7e service placement] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:42:07.246564 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dee2e-4c08-4514-9f0e-822bc2cbbf7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:42:07.248350 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-777dee2e-4c08-4514-9f0e-822bc2cbbf7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:42:07.261067 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dee2e-4c08-4514-9f0e-822bc2cbbf7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:42:07.262686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dee2e-4c08-4514-9f0e-822bc2cbbf7e service placement] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:42:07.278695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1174/2321] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:42:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:42:14.708690 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ac731-d802-4060-8938-16202627dfe3 service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:42:14.721783 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ac731-d802-4060-8938-16202627dfe3 service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:42:14.728110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92289034-0202-40cf-97d7-49129847fd43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:42:14.728730 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289034-0202-40cf-97d7-49129847fd43 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:42:14.729008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289034-0202-40cf-97d7-49129847fd43 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:42:14.729278 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92289034-0202-40cf-97d7-49129847fd43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:42:14.731074 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-92289034-0202-40cf-97d7-49129847fd43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:42:14.743505 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92289034-0202-40cf-97d7-49129847fd43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:42:14.745036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92289034-0202-40cf-97d7-49129847fd43 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:42:14.755336 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1148/2322] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:42:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 04:43:39.790898 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dee2e-4c08-4514-9f0e-822bc2cbbf7e service placement] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:43:39.799941 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dee2e-4c08-4514-9f0e-822bc2cbbf7e service placement] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:43:39.803823 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db985b8-cfe4-4575-9bb0-58d055c34dfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:43:39.804448 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db985b8-cfe4-4575-9bb0-58d055c34dfd service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:43:39.804731 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db985b8-cfe4-4575-9bb0-58d055c34dfd service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:43:39.805006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db985b8-cfe4-4575-9bb0-58d055c34dfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:43:39.813187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db985b8-cfe4-4575-9bb0-58d055c34dfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:43:39.814598 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db985b8-cfe4-4575-9bb0-58d055c34dfd service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:43:39.842292 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1175/2323] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:43:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:43:40.495921 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92289034-0202-40cf-97d7-49129847fd43 service nova] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:43:40.505134 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92289034-0202-40cf-97d7-49129847fd43 service nova] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:43:40.509448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3978c2-020d-4e9e-bdbe-d8919aa7bbac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:43:40.510070 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3978c2-020d-4e9e-bdbe-d8919aa7bbac service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:43:40.510349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3978c2-020d-4e9e-bdbe-d8919aa7bbac service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:43:40.510622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3978c2-020d-4e9e-bdbe-d8919aa7bbac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:43:40.518961 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3978c2-020d-4e9e-bdbe-d8919aa7bbac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:43:40.520403 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3978c2-020d-4e9e-bdbe-d8919aa7bbac service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:43:40.529683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1149/2324] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:43:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:43:41.763664 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db985b8-cfe4-4575-9bb0-58d055c34dfd service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:43:41.776089 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db985b8-cfe4-4575-9bb0-58d055c34dfd service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:43:41.781523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d40d6-020a-45b2-bd95-40ad5edb9d15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:43:41.782145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d40d6-020a-45b2-bd95-40ad5edb9d15 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:43:41.782423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d40d6-020a-45b2-bd95-40ad5edb9d15 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:43:41.782696 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d40d6-020a-45b2-bd95-40ad5edb9d15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:43:41.790952 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d40d6-020a-45b2-bd95-40ad5edb9d15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:43:41.792557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d40d6-020a-45b2-bd95-40ad5edb9d15 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:43:41.801402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1176/2325] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:43:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:44:43.822655 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3978c2-020d-4e9e-bdbe-d8919aa7bbac service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:44:43.831068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3978c2-020d-4e9e-bdbe-d8919aa7bbac service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:44:43.834667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f500c-1ad6-494d-a929-80f3d97da3fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:44:43.835311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f500c-1ad6-494d-a929-80f3d97da3fe service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:44:43.835591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f500c-1ad6-494d-a929-80f3d97da3fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:44:43.835863 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f500c-1ad6-494d-a929-80f3d97da3fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:44:43.844180 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f500c-1ad6-494d-a929-80f3d97da3fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:44:43.845601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f500c-1ad6-494d-a929-80f3d97da3fe service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:44:43.872931 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1150/2326] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:44:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:44:48.229056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d40d6-020a-45b2-bd95-40ad5edb9d15 service nova] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:44:48.238831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d40d6-020a-45b2-bd95-40ad5edb9d15 service nova] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:44:48.242453 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307bb68-4fca-4044-be03-bf49460bc683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:44:48.243080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307bb68-4fca-4044-be03-bf49460bc683 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:44:48.243397 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307bb68-4fca-4044-be03-bf49460bc683 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:44:48.243672 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307bb68-4fca-4044-be03-bf49460bc683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:44:48.250745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307bb68-4fca-4044-be03-bf49460bc683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:44:48.252243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307bb68-4fca-4044-be03-bf49460bc683 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:44:48.260843 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1177/2327] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:44:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:45:30.212758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f500c-1ad6-494d-a929-80f3d97da3fe service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:45:30.221691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f500c-1ad6-494d-a929-80f3d97da3fe service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:45:30.225572 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef2b98-d419-4901-974e-e05cf8fb745b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:45:30.238158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef2b98-d419-4901-974e-e05cf8fb745b service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:45:30.238158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef2b98-d419-4901-974e-e05cf8fb745b service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:45:30.238158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef2b98-d419-4901-974e-e05cf8fb745b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:45:30.238158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef2b98-d419-4901-974e-e05cf8fb745b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:45:30.238158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef2b98-d419-4901-974e-e05cf8fb745b service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:45:30.263206 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1151/2328] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:45:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:45:33.438127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307bb68-4fca-4044-be03-bf49460bc683 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:45:33.447801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307bb68-4fca-4044-be03-bf49460bc683 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:45:33.451527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dca14-1dca-421b-8852-6b17d3db7067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:45:33.452157 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dca14-1dca-421b-8852-6b17d3db7067 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:45:33.452434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dca14-1dca-421b-8852-6b17d3db7067 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:45:33.452707 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118dca14-1dca-421b-8852-6b17d3db7067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:45:33.454563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-118dca14-1dca-421b-8852-6b17d3db7067 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:45:33.487165 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dca14-1dca-421b-8852-6b17d3db7067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:45:33.488677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118dca14-1dca-421b-8852-6b17d3db7067 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:45:33.507085 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1178/2329] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:45:33 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:45:43.810047 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef2b98-d419-4901-974e-e05cf8fb745b service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:45:43.819170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef2b98-d419-4901-974e-e05cf8fb745b service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:45:43.822815 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca6454-8549-4fa0-a54b-0b415c33645c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:45:43.823472 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca6454-8549-4fa0-a54b-0b415c33645c service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:45:43.823756 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca6454-8549-4fa0-a54b-0b415c33645c service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:45:43.824029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca6454-8549-4fa0-a54b-0b415c33645c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:45:43.825880 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-45ca6454-8549-4fa0-a54b-0b415c33645c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:45:43.903443 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca6454-8549-4fa0-a54b-0b415c33645c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:45:43.904865 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca6454-8549-4fa0-a54b-0b415c33645c service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:45:43.923000 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1152/2330] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:45:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:46:52.535700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dca14-1dca-421b-8852-6b17d3db7067 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:46:52.537238 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-118dca14-1dca-421b-8852-6b17d3db7067 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:46:52.661953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118dca14-1dca-421b-8852-6b17d3db7067 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:46:52.667016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539a5f6-0252-42c8-8625-b497b1f572b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:46:52.667690 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539a5f6-0252-42c8-8625-b497b1f572b9 service placement] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:46:52.667971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539a5f6-0252-42c8-8625-b497b1f572b9 service placement] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:46:52.668244 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5539a5f6-0252-42c8-8625-b497b1f572b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:46:52.670103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5539a5f6-0252-42c8-8625-b497b1f572b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:46:52.681162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539a5f6-0252-42c8-8625-b497b1f572b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:46:52.682716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5539a5f6-0252-42c8-8625-b497b1f572b9 service placement] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:46:52.692323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1179/2331] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:46:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:47:35.444990 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca6454-8549-4fa0-a54b-0b415c33645c service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:35.454384 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-45ca6454-8549-4fa0-a54b-0b415c33645c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:47:35.570138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca6454-8549-4fa0-a54b-0b415c33645c service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:35.574635 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e22494-4d92-457f-b1bc-97920b9dbafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:35.575515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e22494-4d92-457f-b1bc-97920b9dbafe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:35.575796 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e22494-4d92-457f-b1bc-97920b9dbafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:35.576063 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e22494-4d92-457f-b1bc-97920b9dbafe admin admin] PATH_INFO: `/v3/users/ca58b989229d48d0bff06947d1108aa5` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:35.577274 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e22494-4d92-457f-b1bc-97920b9dbafe admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca58b989229d48d0bff06947d1108aa5)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:35.579300 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e22494-4d92-457f-b1bc-97920b9dbafe admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:35.580588 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539a5f6-0252-42c8-8625-b497b1f572b9 service placement] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:35.632954 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5539a5f6-0252-42c8-8625-b497b1f572b9 service placement] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:35.636735 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd077b8-0380-47d2-ae16-3e414d59ba65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:35.637396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd077b8-0380-47d2-ae16-3e414d59ba65 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:35.637721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd077b8-0380-47d2-ae16-3e414d59ba65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:35.638026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd077b8-0380-47d2-ae16-3e414d59ba65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:35.705073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd077b8-0380-47d2-ae16-3e414d59ba65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:35.706495 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd077b8-0380-47d2-ae16-3e414d59ba65 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:35.717078 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1180/2332] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:47:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:47:35.739581 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-00e22494-4d92-457f-b1bc-97920b9dbafe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca58b989229d48d0bff06947d1108aa5'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:35.740328 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-00e22494-4d92-457f-b1bc-97920b9dbafe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca58b989229d48d0bff06947d1108aa5'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:35.741045 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-00e22494-4d92-457f-b1bc-97920b9dbafe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca58b989229d48d0bff06947d1108aa5'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:35.753071 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-00e22494-4d92-457f-b1bc-97920b9dbafe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca58b989229d48d0bff06947d1108aa5'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:35.759797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-00e22494-4d92-457f-b1bc-97920b9dbafe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca58b989229d48d0bff06947d1108aa5'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:35.839981 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1153/2333] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:47:35 2022] DELETE /identity/v3/users/ca58b989229d48d0bff06947d1108aa5 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:47:35.845076 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf80ae-0b8e-469d-b19c-572fe3e5ea46 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:35.845364 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf80ae-0b8e-469d-b19c-572fe3e5ea46 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:35.845640 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf80ae-0b8e-469d-b19c-572fe3e5ea46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:35.872509 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-b1bf80ae-0b8e-469d-b19c-572fe3e5ea46 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:47:35.873779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b1bf80ae-0b8e-469d-b19c-572fe3e5ea46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:47:35.932838 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1181/2334] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:47:35.942571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e22494-4d92-457f-b1bc-97920b9dbafe admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:35.944047 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-00e22494-4d92-457f-b1bc-97920b9dbafe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:47:36.005876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e22494-4d92-457f-b1bc-97920b9dbafe admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:36.009495 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316950a-5e6c-4447-98ac-48dad5f1de91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:36.010139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316950a-5e6c-4447-98ac-48dad5f1de91 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:36.010422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316950a-5e6c-4447-98ac-48dad5f1de91 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:36.010695 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316950a-5e6c-4447-98ac-48dad5f1de91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:36.020512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316950a-5e6c-4447-98ac-48dad5f1de91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:36.021922 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316950a-5e6c-4447-98ac-48dad5f1de91 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:36.031164 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1154/2335] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:47:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:47:36.468069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf80ae-0b8e-469d-b19c-572fe3e5ea46 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:36.469539 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b1bf80ae-0b8e-469d-b19c-572fe3e5ea46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:47:36.482449 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf80ae-0b8e-469d-b19c-572fe3e5ea46 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:36.487646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4de685-966c-47c4-a80a-bbdc9220aa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:36.488505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4de685-966c-47c4-a80a-bbdc9220aa97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:36.488787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4de685-966c-47c4-a80a-bbdc9220aa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:36.489607 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4de685-966c-47c4-a80a-bbdc9220aa97 admin admin] PATH_INFO: `/v3/projects/f079fba01c664eccb7bf42ff18799296` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:36.496146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4de685-966c-47c4-a80a-bbdc9220aa97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f079fba01c664eccb7bf42ff18799296)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:36.499273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4de685-966c-47c4-a80a-bbdc9220aa97 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:36.602942 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5e4de685-966c-47c4-a80a-bbdc9220aa97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f079fba01c664eccb7bf42ff18799296', 'request_id': 'req-5e4de685-966c-47c4-a80a-bbdc9220aa97'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:36.683756 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5e4de685-966c-47c4-a80a-bbdc9220aa97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f079fba01c664eccb7bf42ff18799296', 'request_id': 'req-5e4de685-966c-47c4-a80a-bbdc9220aa97'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:36.690054 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5e4de685-966c-47c4-a80a-bbdc9220aa97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f079fba01c664eccb7bf42ff18799296', 'request_id': 'req-5e4de685-966c-47c4-a80a-bbdc9220aa97'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:36.700788 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5e4de685-966c-47c4-a80a-bbdc9220aa97 admin admin] The token cache is being invalidate because project f079fba01c664eccb7bf42ff18799296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:47:36.701076 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5e4de685-966c-47c4-a80a-bbdc9220aa97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:36.701694 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5e4de685-966c-47c4-a80a-bbdc9220aa97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:36.703551 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1182/2336] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:47:36 2022] DELETE /identity/v3/projects/f079fba01c664eccb7bf42ff18799296 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:47:36.709170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ffc3-e827-4084-913b-f43a1575a4a2 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:36.709662 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ffc3-e827-4084-913b-f43a1575a4a2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:36.709784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0ffc3-e827-4084-913b-f43a1575a4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:36.745922 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-6cc0ffc3-e827-4084-913b-f43a1575a4a2 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:47:36.747106 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-6cc0ffc3-e827-4084-913b-f43a1575a4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:47:36.804499 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1155/2337] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:47:36.812377 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351538d4-e21b-4db8-bac0-969c7494300e None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:36.813218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351538d4-e21b-4db8-bac0-969c7494300e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:36.813529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351538d4-e21b-4db8-bac0-969c7494300e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:36.831858 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-351538d4-e21b-4db8-bac0-969c7494300e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:47:36.833158 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-351538d4-e21b-4db8-bac0-969c7494300e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:47:36.840956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1183/2338] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:47:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:47:36.845023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0ffc3-e827-4084-913b-f43a1575a4a2 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:36.854366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0ffc3-e827-4084-913b-f43a1575a4a2 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:36.858981 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcf089-06b9-4c3f-aceb-4e7c2a276c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:36.860192 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcf089-06b9-4c3f-aceb-4e7c2a276c11 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:36.860464 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcf089-06b9-4c3f-aceb-4e7c2a276c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:36.860740 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcf089-06b9-4c3f-aceb-4e7c2a276c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:36.861485 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcf089-06b9-4c3f-aceb-4e7c2a276c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:47:36.861787 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcf089-06b9-4c3f-aceb-4e7c2a276c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:36.863391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcf089-06b9-4c3f-aceb-4e7c2a276c11 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:36.876095 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1156/2339] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 04:47:36.880186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351538d4-e21b-4db8-bac0-969c7494300e None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:36.889374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351538d4-e21b-4db8-bac0-969c7494300e None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:36.894128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b903e8d-f742-4432-9676-056334ac2462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:36.894776 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903e8d-f742-4432-9676-056334ac2462 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:36.895051 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903e8d-f742-4432-9676-056334ac2462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:36.895366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903e8d-f742-4432-9676-056334ac2462 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:36.896096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b903e8d-f742-4432-9676-056334ac2462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:36.897988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b903e8d-f742-4432-9676-056334ac2462 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:36.996358 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1184/2340] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:47:36 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:47:37.000503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcf089-06b9-4c3f-aceb-4e7c2a276c11 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:37.010398 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcf089-06b9-4c3f-aceb-4e7c2a276c11 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:37.064342 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10601a5-a9fe-4b65-8caa-9b64633af3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:37.065003 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10601a5-a9fe-4b65-8caa-9b64633af3d9 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:37.065284 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10601a5-a9fe-4b65-8caa-9b64633af3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:37.065557 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10601a5-a9fe-4b65-8caa-9b64633af3d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:37.066254 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10601a5-a9fe-4b65-8caa-9b64633af3d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:37.068182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10601a5-a9fe-4b65-8caa-9b64633af3d9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:37.132310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1157/2341] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:47:36 2022] POST /identity/v3/users => generated 285 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:47:37.136497 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b903e8d-f742-4432-9676-056334ac2462 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:37.146898 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b903e8d-f742-4432-9676-056334ac2462 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:37.151709 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1885b24-1054-4910-9a5d-efad9a43f32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:37.152357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1885b24-1054-4910-9a5d-efad9a43f32c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:37.152638 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1885b24-1054-4910-9a5d-efad9a43f32c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:37.152913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1885b24-1054-4910-9a5d-efad9a43f32c admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:37.153655 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1885b24-1054-4910-9a5d-efad9a43f32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:37.155281 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1885b24-1054-4910-9a5d-efad9a43f32c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:37.166043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1185/2342] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 04:47:37.169766 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10601a5-a9fe-4b65-8caa-9b64633af3d9 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:37.180252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10601a5-a9fe-4b65-8caa-9b64633af3d9 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:37.184866 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797863a-ee83-4db4-b96e-005c86605d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:37.185514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797863a-ee83-4db4-b96e-005c86605d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:37.185796 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797863a-ee83-4db4-b96e-005c86605d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:37.186073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797863a-ee83-4db4-b96e-005c86605d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:37.186814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797863a-ee83-4db4-b96e-005c86605d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:37.188455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797863a-ee83-4db4-b96e-005c86605d84 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:37.197986 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1158/2343] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:47:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:47:37.202008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1885b24-1054-4910-9a5d-efad9a43f32c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:37.211860 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1885b24-1054-4910-9a5d-efad9a43f32c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:37.216413 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6317dc-0d0f-45f3-ba29-6da358451888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:37.217273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6317dc-0d0f-45f3-ba29-6da358451888 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:37.217553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6317dc-0d0f-45f3-ba29-6da358451888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:37.217836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6317dc-0d0f-45f3-ba29-6da358451888 admin admin] PATH_INFO: `/v3/projects/809ff4a18a4c4f82876616b8980d06d9/users/1a17aa1d801144dbb16c396228ee8d25/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:37.232917 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6317dc-0d0f-45f3-ba29-6da358451888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=809ff4a18a4c4f82876616b8980d06d9, user_id=1a17aa1d801144dbb16c396228ee8d25, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:37.236483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6317dc-0d0f-45f3-ba29-6da358451888 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:37.315961 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1186/2344] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:47:37 2022] PUT /identity/v3/projects/809ff4a18a4c4f82876616b8980d06d9/users/1a17aa1d801144dbb16c396228ee8d25/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:47:37.334212 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c70f8-4740-4290-a612-217001c3b290 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:37.334212 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c70f8-4740-4290-a612-217001c3b290 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:37.334212 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6c70f8-4740-4290-a612-217001c3b290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:37.357310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-4f6c70f8-4740-4290-a612-217001c3b290 None None] MFA Rules not processed for user `1a17aa1d801144dbb16c396228ee8d25`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:47:37.358518 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4f6c70f8-4740-4290-a612-217001c3b290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:47:37.421090 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1159/2345] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:47:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:47:37.432684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6317dc-0d0f-45f3-ba29-6da358451888 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:37.434347 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-6b6317dc-0d0f-45f3-ba29-6da358451888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:47:37.510494 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6317dc-0d0f-45f3-ba29-6da358451888 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:37.514223 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33f2bb-36b4-4482-a398-82e760d31ce1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3df18302cd84e6eae6a1a60b0a8b2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:37.514850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33f2bb-36b4-4482-a398-82e760d31ce1 service glance] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:37.515127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33f2bb-36b4-4482-a398-82e760d31ce1 service glance] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:37.515428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33f2bb-36b4-4482-a398-82e760d31ce1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:37.524357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33f2bb-36b4-4482-a398-82e760d31ce1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:37.525795 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33f2bb-36b4-4482-a398-82e760d31ce1 service glance] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:37.535482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1187/2346] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:47:37 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:47:49.339188 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c70f8-4740-4290-a612-217001c3b290 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:49.341621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4f6c70f8-4740-4290-a612-217001c3b290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:47:49.399738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6c70f8-4740-4290-a612-217001c3b290 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:49.403409 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c8b00-4a26-4d56-9b54-555670582eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:49.404054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c8b00-4a26-4d56-9b54-555670582eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:49.404345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c8b00-4a26-4d56-9b54-555670582eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:49.404620 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c8b00-4a26-4d56-9b54-555670582eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:49.406426 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-379c8b00-4a26-4d56-9b54-555670582eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:47:49.466930 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c8b00-4a26-4d56-9b54-555670582eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:49.468642 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379c8b00-4a26-4d56-9b54-555670582eb4 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:49.478554 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1160/2347] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:47:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:47:57.140775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33f2bb-36b4-4482-a398-82e760d31ce1 service glance] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:57.142334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-cf33f2bb-36b4-4482-a398-82e760d31ce1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:47:57.157559 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33f2bb-36b4-4482-a398-82e760d31ce1 service glance] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:57.162291 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e724764-00d5-41f7-8275-6562b502bf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:57.163141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e724764-00d5-41f7-8275-6562b502bf92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:57.163478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e724764-00d5-41f7-8275-6562b502bf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:57.163752 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e724764-00d5-41f7-8275-6562b502bf92 admin admin] PATH_INFO: `/v3/users/ff112ba8368d48b095d809f0ff560e12` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:57.164939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e724764-00d5-41f7-8275-6562b502bf92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff112ba8368d48b095d809f0ff560e12)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:57.166836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e724764-00d5-41f7-8275-6562b502bf92 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:57.359525 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-7e724764-00d5-41f7-8275-6562b502bf92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff112ba8368d48b095d809f0ff560e12'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:57.360093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-7e724764-00d5-41f7-8275-6562b502bf92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff112ba8368d48b095d809f0ff560e12'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:57.361207 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-7e724764-00d5-41f7-8275-6562b502bf92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff112ba8368d48b095d809f0ff560e12'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:57.372578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-7e724764-00d5-41f7-8275-6562b502bf92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff112ba8368d48b095d809f0ff560e12'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:57.379697 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-7e724764-00d5-41f7-8275-6562b502bf92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff112ba8368d48b095d809f0ff560e12'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:57.467711 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1188/2348] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:47:57 2022] DELETE /identity/v3/users/ff112ba8368d48b095d809f0ff560e12 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:47:57.704145 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c8b00-4a26-4d56-9b54-555670582eb4 service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:57.714026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c8b00-4a26-4d56-9b54-555670582eb4 service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:57.774306 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:57.775153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:57.775477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:57.775779 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] PATH_INFO: `/v3/projects/339d08e60b494bdbbcde5e0d99ed11bb` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:57.776974 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=339d08e60b494bdbbcde5e0d99ed11bb)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:57.778880 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:57.885510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '339d08e60b494bdbbcde5e0d99ed11bb', 'request_id': 'req-16aa62a3-0efe-4738-804e-cce32e2a8648'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:57.891491 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '339d08e60b494bdbbcde5e0d99ed11bb', 'request_id': 'req-16aa62a3-0efe-4738-804e-cce32e2a8648'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:57.896908 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '339d08e60b494bdbbcde5e0d99ed11bb', 'request_id': 'req-16aa62a3-0efe-4738-804e-cce32e2a8648'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:57.974010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] The token cache is being invalidate because project 339d08e60b494bdbbcde5e0d99ed11bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:47:57.974293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:57.974896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:57.976436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1161/2349] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:47:57 2022] DELETE /identity/v3/projects/339d08e60b494bdbbcde5e0d99ed11bb => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:47:57.980339 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e724764-00d5-41f7-8275-6562b502bf92 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:57.981718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-7e724764-00d5-41f7-8275-6562b502bf92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:47:57.995523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e724764-00d5-41f7-8275-6562b502bf92 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:58.050710 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11a97b-e96b-420b-b2df-96896aa51e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:58.051589 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11a97b-e96b-420b-b2df-96896aa51e1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:58.051871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11a97b-e96b-420b-b2df-96896aa51e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:58.052141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11a97b-e96b-420b-b2df-96896aa51e1d admin admin] PATH_INFO: `/v3/users/e8bc74d044e94c1e94985a7e942daf24` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:58.064589 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11a97b-e96b-420b-b2df-96896aa51e1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8bc74d044e94c1e94985a7e942daf24)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:58.066492 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a11a97b-e96b-420b-b2df-96896aa51e1d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:58.247058 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6a11a97b-e96b-420b-b2df-96896aa51e1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8bc74d044e94c1e94985a7e942daf24'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:58.254264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6a11a97b-e96b-420b-b2df-96896aa51e1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8bc74d044e94c1e94985a7e942daf24'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:58.254264 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6a11a97b-e96b-420b-b2df-96896aa51e1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8bc74d044e94c1e94985a7e942daf24'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:58.265121 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6a11a97b-e96b-420b-b2df-96896aa51e1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8bc74d044e94c1e94985a7e942daf24'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:58.274790 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6a11a97b-e96b-420b-b2df-96896aa51e1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8bc74d044e94c1e94985a7e942daf24'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:58.353913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1189/2350] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:47:57 2022] DELETE /identity/v3/users/e8bc74d044e94c1e94985a7e942daf24 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:47:58.602044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:47:58.605147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:47:58.617778 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa62a3-0efe-4738-804e-cce32e2a8648 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:47:58.682435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:47:58.682798 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:47:58.683079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:47:58.683382 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] PATH_INFO: `/v3/projects/c15303e1dd6c416595aa6a5268512a63` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:47:58.694494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15303e1dd6c416595aa6a5268512a63)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:47:58.696390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:47:58.810196 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15303e1dd6c416595aa6a5268512a63', 'request_id': 'req-f481395e-676b-433e-9e59-bdf1d7b01c8a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:58.817333 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15303e1dd6c416595aa6a5268512a63', 'request_id': 'req-f481395e-676b-433e-9e59-bdf1d7b01c8a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:58.822628 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15303e1dd6c416595aa6a5268512a63', 'request_id': 'req-f481395e-676b-433e-9e59-bdf1d7b01c8a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:58.879247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] The token cache is being invalidate because project c15303e1dd6c416595aa6a5268512a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:47:58.879560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:58.880178 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:47:58.881752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1162/2351] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:47:58 2022] DELETE /identity/v3/projects/c15303e1dd6c416595aa6a5268512a63 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:48:20.552606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11a97b-e96b-420b-b2df-96896aa51e1d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:48:20.554098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-6a11a97b-e96b-420b-b2df-96896aa51e1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:48:20.632191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a11a97b-e96b-420b-b2df-96896aa51e1d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:48:20.701074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568cd8b-2c44-42ed-b5ba-445a09f600a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:48:20.701725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568cd8b-2c44-42ed-b5ba-445a09f600a8 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:48:20.702007 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568cd8b-2c44-42ed-b5ba-445a09f600a8 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:48:20.702278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568cd8b-2c44-42ed-b5ba-445a09f600a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:48:20.704873 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3568cd8b-2c44-42ed-b5ba-445a09f600a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:48:20.716772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568cd8b-2c44-42ed-b5ba-445a09f600a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:48:20.718365 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568cd8b-2c44-42ed-b5ba-445a09f600a8 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:48:20.729193 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1190/2352] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:48:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:48:40.111650 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:48:40.113104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:48:40.198192 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481395e-676b-433e-9e59-bdf1d7b01c8a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:48:40.201979 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009f27c-e1a5-45dd-8795-e1539e582dbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:48:40.202565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009f27c-e1a5-45dd-8795-e1539e582dbe service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:48:40.202850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009f27c-e1a5-45dd-8795-e1539e582dbe service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:48:40.203132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009f27c-e1a5-45dd-8795-e1539e582dbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:48:40.205720 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d009f27c-e1a5-45dd-8795-e1539e582dbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:48:40.289148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009f27c-e1a5-45dd-8795-e1539e582dbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:48:40.290577 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009f27c-e1a5-45dd-8795-e1539e582dbe service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:48:40.309475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1163/2353] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:48:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:48:40.667673 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568cd8b-2c44-42ed-b5ba-445a09f600a8 service nova] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:48:40.688542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568cd8b-2c44-42ed-b5ba-445a09f600a8 service nova] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:48:40.692912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04718c9e-ac28-4bdf-83c6-53c69ad1102f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:48:40.693553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04718c9e-ac28-4bdf-83c6-53c69ad1102f service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:48:40.693828 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04718c9e-ac28-4bdf-83c6-53c69ad1102f service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:48:40.694097 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04718c9e-ac28-4bdf-83c6-53c69ad1102f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:48:40.695862 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-04718c9e-ac28-4bdf-83c6-53c69ad1102f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:48:40.767332 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04718c9e-ac28-4bdf-83c6-53c69ad1102f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:48:40.768745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04718c9e-ac28-4bdf-83c6-53c69ad1102f service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:48:40.777526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1191/2354] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:48:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:48:41.502571 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009f27c-e1a5-45dd-8795-e1539e582dbe service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:48:41.503991 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d009f27c-e1a5-45dd-8795-e1539e582dbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:48:41.547555 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009f27c-e1a5-45dd-8795-e1539e582dbe service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:48:41.553003 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8d6cd-5b54-45cb-a357-6f36b068982d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:48:41.553630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8d6cd-5b54-45cb-a357-6f36b068982d service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:48:41.553911 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8d6cd-5b54-45cb-a357-6f36b068982d service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:48:41.554186 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8d6cd-5b54-45cb-a357-6f36b068982d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:48:41.555917 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-cab8d6cd-5b54-45cb-a357-6f36b068982d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:48:41.636774 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8d6cd-5b54-45cb-a357-6f36b068982d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:48:41.638290 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8d6cd-5b54-45cb-a357-6f36b068982d service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:48:41.656395 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1164/2355] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:48:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:49:43.409201 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04718c9e-ac28-4bdf-83c6-53c69ad1102f service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:49:43.422134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04718c9e-ac28-4bdf-83c6-53c69ad1102f service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:49:43.427537 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8068a5e-9b99-40aa-9d96-2f1d4bd316af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:49:43.428163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068a5e-9b99-40aa-9d96-2f1d4bd316af service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:49:43.428446 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068a5e-9b99-40aa-9d96-2f1d4bd316af service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:49:43.428723 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8068a5e-9b99-40aa-9d96-2f1d4bd316af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:49:43.430474 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d8068a5e-9b99-40aa-9d96-2f1d4bd316af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:49:43.499807 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8068a5e-9b99-40aa-9d96-2f1d4bd316af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:49:43.501399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8068a5e-9b99-40aa-9d96-2f1d4bd316af service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:49:43.510653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1192/2356] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:49:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:49:49.216909 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8d6cd-5b54-45cb-a357-6f36b068982d service nova] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:49:49.218377 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-cab8d6cd-5b54-45cb-a357-6f36b068982d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:49:49.291747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8d6cd-5b54-45cb-a357-6f36b068982d service nova] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:49:49.296018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d17670-ec92-4c91-8744-0dd08c7e55f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:49:49.296666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d17670-ec92-4c91-8744-0dd08c7e55f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:49:49.296951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d17670-ec92-4c91-8744-0dd08c7e55f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:49:49.297255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d17670-ec92-4c91-8744-0dd08c7e55f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:49:49.299058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e4d17670-ec92-4c91-8744-0dd08c7e55f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:49:49.308284 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d17670-ec92-4c91-8744-0dd08c7e55f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:49:49.309686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d17670-ec92-4c91-8744-0dd08c7e55f3 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:49:49.317704 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1165/2357] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:49:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:50:28.830118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8068a5e-9b99-40aa-9d96-2f1d4bd316af service nova] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:50:28.831480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d8068a5e-9b99-40aa-9d96-2f1d4bd316af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:50:28.843114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8068a5e-9b99-40aa-9d96-2f1d4bd316af service nova] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:50:28.846699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb08e30-45d9-4bb0-9aad-7632c19d3577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:50:28.847483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb08e30-45d9-4bb0-9aad-7632c19d3577 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:50:28.847765 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb08e30-45d9-4bb0-9aad-7632c19d3577 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:50:28.848038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb08e30-45d9-4bb0-9aad-7632c19d3577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:50:28.849746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2cb08e30-45d9-4bb0-9aad-7632c19d3577 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:50:28.916987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb08e30-45d9-4bb0-9aad-7632c19d3577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:50:28.918456 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb08e30-45d9-4bb0-9aad-7632c19d3577 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:50:28.927242 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1193/2358] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:50:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:51:54.525258 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d17670-ec92-4c91-8744-0dd08c7e55f3 service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:51:54.527662 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e4d17670-ec92-4c91-8744-0dd08c7e55f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:51:54.595205 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d17670-ec92-4c91-8744-0dd08c7e55f3 service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:51:54.600226 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc912fc-fbba-4c82-9e20-013af8815ff5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:51:54.600859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc912fc-fbba-4c82-9e20-013af8815ff5 service placement] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:51:54.601137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc912fc-fbba-4c82-9e20-013af8815ff5 service placement] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:51:54.601407 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc912fc-fbba-4c82-9e20-013af8815ff5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:51:54.603171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ebc912fc-fbba-4c82-9e20-013af8815ff5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:51:54.614535 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc912fc-fbba-4c82-9e20-013af8815ff5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:51:54.616464 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc912fc-fbba-4c82-9e20-013af8815ff5 service placement] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:51:54.626519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1166/2359] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:51:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:52:35.189945 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb08e30-45d9-4bb0-9aad-7632c19d3577 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:52:35.199418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb08e30-45d9-4bb0-9aad-7632c19d3577 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:52:35.202995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f96549-7825-41e4-95e8-ceb249546393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:52:35.203653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f96549-7825-41e4-95e8-ceb249546393 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:52:35.203935 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f96549-7825-41e4-95e8-ceb249546393 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:52:35.204209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f96549-7825-41e4-95e8-ceb249546393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:52:35.205933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-84f96549-7825-41e4-95e8-ceb249546393 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:52:35.218990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f96549-7825-41e4-95e8-ceb249546393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:52:35.220436 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f96549-7825-41e4-95e8-ceb249546393 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:52:35.231840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1194/2360] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:52:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:52:36.993823 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc912fc-fbba-4c82-9e20-013af8815ff5 service placement] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:52:37.003410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc912fc-fbba-4c82-9e20-013af8815ff5 service placement] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:52:37.007009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5123fe7b-c857-4db6-b7e7-0edf2a136fec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:52:37.007674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123fe7b-c857-4db6-b7e7-0edf2a136fec service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:52:37.007948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123fe7b-c857-4db6-b7e7-0edf2a136fec service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:52:37.008217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5123fe7b-c857-4db6-b7e7-0edf2a136fec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:52:37.010263 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-5123fe7b-c857-4db6-b7e7-0edf2a136fec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:52:37.067252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123fe7b-c857-4db6-b7e7-0edf2a136fec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:52:37.068675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5123fe7b-c857-4db6-b7e7-0edf2a136fec service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:52:37.078296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1167/2361] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:52:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:53:34.747038 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f96549-7825-41e4-95e8-ceb249546393 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:34.749171 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-84f96549-7825-41e4-95e8-ceb249546393 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:34.837310 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f96549-7825-41e4-95e8-ceb249546393 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:34.841834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c4271-cb6b-4742-8aa3-404577269c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:34.842679 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c4271-cb6b-4742-8aa3-404577269c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:34.842981 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c4271-cb6b-4742-8aa3-404577269c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:34.843284 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c4271-cb6b-4742-8aa3-404577269c8a admin admin] PATH_INFO: `/v3/users/6ea18c9d345a46f0ae14cccff13d2769` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:34.844470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c4271-cb6b-4742-8aa3-404577269c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea18c9d345a46f0ae14cccff13d2769)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:34.846361 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c4271-cb6b-4742-8aa3-404577269c8a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:35.046534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-235c4271-cb6b-4742-8aa3-404577269c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea18c9d345a46f0ae14cccff13d2769'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:35.047175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-235c4271-cb6b-4742-8aa3-404577269c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea18c9d345a46f0ae14cccff13d2769'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:35.047833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-235c4271-cb6b-4742-8aa3-404577269c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea18c9d345a46f0ae14cccff13d2769'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:35.060033 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-235c4271-cb6b-4742-8aa3-404577269c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea18c9d345a46f0ae14cccff13d2769'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:35.066580 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-235c4271-cb6b-4742-8aa3-404577269c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea18c9d345a46f0ae14cccff13d2769'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:35.138736 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1195/2362] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:53:34 2022] DELETE /identity/v3/users/6ea18c9d345a46f0ae14cccff13d2769 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:53:35.143447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c30ea7-819a-4fa3-a666-e9a13447b9bf None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:35.143945 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c30ea7-819a-4fa3-a666-e9a13447b9bf None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:35.144054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c30ea7-819a-4fa3-a666-e9a13447b9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:35.160530 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-30c30ea7-819a-4fa3-a666-e9a13447b9bf None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:53:35.161730 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-30c30ea7-819a-4fa3-a666-e9a13447b9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:35.216926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1168/2363] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:53:35.226902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c4271-cb6b-4742-8aa3-404577269c8a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:35.228319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-235c4271-cb6b-4742-8aa3-404577269c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:35.283834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c4271-cb6b-4742-8aa3-404577269c8a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:35.287495 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8013c4f-337a-465a-8167-3b50fbe4ed58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:35.288153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8013c4f-337a-465a-8167-3b50fbe4ed58 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:35.288932 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8013c4f-337a-465a-8167-3b50fbe4ed58 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:35.289192 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8013c4f-337a-465a-8167-3b50fbe4ed58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:35.298185 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8013c4f-337a-465a-8167-3b50fbe4ed58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:35.299587 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8013c4f-337a-465a-8167-3b50fbe4ed58 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:35.309845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1196/2364] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:53:35.703852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c30ea7-819a-4fa3-a666-e9a13447b9bf None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:35.706146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-30c30ea7-819a-4fa3-a666-e9a13447b9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:35.718803 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c30ea7-819a-4fa3-a666-e9a13447b9bf None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:35.731167 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:35.732175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:35.732482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:35.732696 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] PATH_INFO: `/v3/projects/3972709f632a40db940c5d0a4fd7319f` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:35.733926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3972709f632a40db940c5d0a4fd7319f)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:35.735855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:35.977670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3972709f632a40db940c5d0a4fd7319f', 'request_id': 'req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:35.984020 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3972709f632a40db940c5d0a4fd7319f', 'request_id': 'req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:35.989511 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3972709f632a40db940c5d0a4fd7319f', 'request_id': 'req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:36.062405 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] The token cache is being invalidate because project 3972709f632a40db940c5d0a4fd7319f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:53:36.062644 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:36.063085 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:36.064746 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1169/2365] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:53:35 2022] DELETE /identity/v3/projects/3972709f632a40db940c5d0a4fd7319f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:53:36.073294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8013c4f-337a-465a-8167-3b50fbe4ed58 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:36.083072 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8013c4f-337a-465a-8167-3b50fbe4ed58 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:36.140601 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4422d5-1f5a-47cf-aa1f-4340711ea12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:36.141445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4422d5-1f5a-47cf-aa1f-4340711ea12c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:36.141730 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4422d5-1f5a-47cf-aa1f-4340711ea12c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:36.142008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4422d5-1f5a-47cf-aa1f-4340711ea12c admin admin] PATH_INFO: `/v3/users/e5ca88a5ad1d453b80d2681b0aeb429f` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:36.155991 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4422d5-1f5a-47cf-aa1f-4340711ea12c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5ca88a5ad1d453b80d2681b0aeb429f)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:36.157925 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4422d5-1f5a-47cf-aa1f-4340711ea12c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:36.318158 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1f4422d5-1f5a-47cf-aa1f-4340711ea12c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5ca88a5ad1d453b80d2681b0aeb429f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:36.318745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1f4422d5-1f5a-47cf-aa1f-4340711ea12c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5ca88a5ad1d453b80d2681b0aeb429f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:36.319429 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1f4422d5-1f5a-47cf-aa1f-4340711ea12c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5ca88a5ad1d453b80d2681b0aeb429f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:36.331064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1f4422d5-1f5a-47cf-aa1f-4340711ea12c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5ca88a5ad1d453b80d2681b0aeb429f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:36.338439 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1f4422d5-1f5a-47cf-aa1f-4340711ea12c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5ca88a5ad1d453b80d2681b0aeb429f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:36.420333 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1197/2366] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:53:36 2022] DELETE /identity/v3/users/e5ca88a5ad1d453b80d2681b0aeb429f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:53:36.878165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:36.880203 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:36.897271 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a0305-b085-4d5d-86b0-ee843ea8cf5a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:36.964393 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:36.965244 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:36.965527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:36.965802 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd admin admin] PATH_INFO: `/v3/projects/3a566220d9b1427088517540994e2d9d` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:36.976044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a566220d9b1427088517540994e2d9d)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:36.977984 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:37.087589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a566220d9b1427088517540994e2d9d', 'request_id': 'req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:37.094096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a566220d9b1427088517540994e2d9d', 'request_id': 'req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:37.099338 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a566220d9b1427088517540994e2d9d', 'request_id': 'req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:37.184631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd admin admin] The token cache is being invalidate because project 3a566220d9b1427088517540994e2d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:53:37.184905 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:37.185606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-79b9d6bb-5145-46ee-9d1c-97d746bbc7fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:37.187145 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1170/2367] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:53:36 2022] DELETE /identity/v3/projects/3a566220d9b1427088517540994e2d9d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:53:37.193017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db2c53-7b95-4d8f-a673-6b04aa6ff3e7 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:37.193535 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db2c53-7b95-4d8f-a673-6b04aa6ff3e7 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:37.193653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5db2c53-7b95-4d8f-a673-6b04aa6ff3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:37.223166 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-e5db2c53-7b95-4d8f-a673-6b04aa6ff3e7 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:53:37.224400 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e5db2c53-7b95-4d8f-a673-6b04aa6ff3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:37.281561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1198/2368] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:53:37.289861 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622d0d1-7098-4939-80ad-0b366ada75c1 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:37.290151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622d0d1-7098-4939-80ad-0b366ada75c1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:37.290432 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622d0d1-7098-4939-80ad-0b366ada75c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:37.308410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-9622d0d1-7098-4939-80ad-0b366ada75c1 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:53:37.309845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9622d0d1-7098-4939-80ad-0b366ada75c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:37.317947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1171/2369] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:53:37.322297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db2c53-7b95-4d8f-a673-6b04aa6ff3e7 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:37.332534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5db2c53-7b95-4d8f-a673-6b04aa6ff3e7 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:37.339380 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f88c2-f244-4a4a-be6f-c59e1e841eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:37.340079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f88c2-f244-4a4a-be6f-c59e1e841eff admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:37.340493 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f88c2-f244-4a4a-be6f-c59e1e841eff admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:37.340772 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74f88c2-f244-4a4a-be6f-c59e1e841eff admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:37.341512 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f88c2-f244-4a4a-be6f-c59e1e841eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:53:37.341812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f88c2-f244-4a4a-be6f-c59e1e841eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:37.343424 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74f88c2-f244-4a4a-be6f-c59e1e841eff admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:37.359206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1199/2370] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:53:37.360337 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622d0d1-7098-4939-80ad-0b366ada75c1 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:37.370801 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622d0d1-7098-4939-80ad-0b366ada75c1 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:37.375662 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c7bd4-7d1d-426e-a49a-7e58df15e009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:37.376310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c7bd4-7d1d-426e-a49a-7e58df15e009 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:37.376598 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c7bd4-7d1d-426e-a49a-7e58df15e009 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:37.376872 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08c7bd4-7d1d-426e-a49a-7e58df15e009 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:37.377622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c7bd4-7d1d-426e-a49a-7e58df15e009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:37.379578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08c7bd4-7d1d-426e-a49a-7e58df15e009 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:37.501853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1172/2371] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:53:37 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:53:37.505924 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f88c2-f244-4a4a-be6f-c59e1e841eff admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:37.516728 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74f88c2-f244-4a4a-be6f-c59e1e841eff admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:37.572705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bad40f-b594-42ff-b2ae-e35483cac789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:37.573372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bad40f-b594-42ff-b2ae-e35483cac789 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:37.573651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bad40f-b594-42ff-b2ae-e35483cac789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:37.573938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bad40f-b594-42ff-b2ae-e35483cac789 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:37.574630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bad40f-b594-42ff-b2ae-e35483cac789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:37.576653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bad40f-b594-42ff-b2ae-e35483cac789 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:37.653183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1200/2372] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:53:37 2022] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:53:37.657418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c7bd4-7d1d-426e-a49a-7e58df15e009 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:37.669576 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08c7bd4-7d1d-426e-a49a-7e58df15e009 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:37.674255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9c1f5-b2a3-4a58-b176-7171850ec3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:37.674937 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9c1f5-b2a3-4a58-b176-7171850ec3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:37.675247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9c1f5-b2a3-4a58-b176-7171850ec3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:37.675518 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9c1f5-b2a3-4a58-b176-7171850ec3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:37.676287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9c1f5-b2a3-4a58-b176-7171850ec3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:37.677888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9c1f5-b2a3-4a58-b176-7171850ec3f6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:37.688347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1173/2373] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:53:37.692390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bad40f-b594-42ff-b2ae-e35483cac789 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:37.703480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bad40f-b594-42ff-b2ae-e35483cac789 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:37.708035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050dd19-040a-4300-b413-5dea41bab3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:37.708704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050dd19-040a-4300-b413-5dea41bab3b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:37.709027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050dd19-040a-4300-b413-5dea41bab3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:37.709296 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050dd19-040a-4300-b413-5dea41bab3b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:37.710029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050dd19-040a-4300-b413-5dea41bab3b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:37.711715 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050dd19-040a-4300-b413-5dea41bab3b5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:37.721207 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1201/2374] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:53:37.725380 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9c1f5-b2a3-4a58-b176-7171850ec3f6 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:37.735038 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9c1f5-b2a3-4a58-b176-7171850ec3f6 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:37.739893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa8003-4d32-4ad2-a2de-d766335ea490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:37.740748 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa8003-4d32-4ad2-a2de-d766335ea490 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:37.741026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa8003-4d32-4ad2-a2de-d766335ea490 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:37.741295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa8003-4d32-4ad2-a2de-d766335ea490 admin admin] PATH_INFO: `/v3/projects/eee0f5d9339a4cf5a8764c9c1c489c95/users/7350c89a1af24f38a556adf793758fbf/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:37.758000 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa8003-4d32-4ad2-a2de-d766335ea490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee0f5d9339a4cf5a8764c9c1c489c95, user_id=7350c89a1af24f38a556adf793758fbf, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:37.760710 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa8003-4d32-4ad2-a2de-d766335ea490 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:37.879661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1174/2375] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:53:37 2022] PUT /identity/v3/projects/eee0f5d9339a4cf5a8764c9c1c489c95/users/7350c89a1af24f38a556adf793758fbf/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:53:37.942529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bb73-671e-4871-bbdd-b055f7b7e6d6 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:37.942529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bb73-671e-4871-bbdd-b055f7b7e6d6 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:37.942529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1bb73-671e-4871-bbdd-b055f7b7e6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:37.969658 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-82e1bb73-671e-4871-bbdd-b055f7b7e6d6 None None] MFA Rules not processed for user `7350c89a1af24f38a556adf793758fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:53:37.970878 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-82e1bb73-671e-4871-bbdd-b055f7b7e6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:38.035749 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1202/2376] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:53:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:53:38.046036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa8003-4d32-4ad2-a2de-d766335ea490 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:38.053972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-48aa8003-4d32-4ad2-a2de-d766335ea490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:38.103354 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa8003-4d32-4ad2-a2de-d766335ea490 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:38.107018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb4505-1d2f-47f3-88d8-381324bbc6af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:38.107734 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb4505-1d2f-47f3-88d8-381324bbc6af service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:38.108012 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb4505-1d2f-47f3-88d8-381324bbc6af service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:38.108282 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb4505-1d2f-47f3-88d8-381324bbc6af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:38.117456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb4505-1d2f-47f3-88d8-381324bbc6af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:38.118866 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb4505-1d2f-47f3-88d8-381324bbc6af service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:38.127590 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1175/2377] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:53:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:53:38.146684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1bb73-671e-4871-bbdd-b055f7b7e6d6 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:38.206665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1bb73-671e-4871-bbdd-b055f7b7e6d6 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:38.211203 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b950e1f-8c7d-45d1-999e-70111221e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:38.212086 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b950e1f-8c7d-45d1-999e-70111221e9ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:38.212367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b950e1f-8c7d-45d1-999e-70111221e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:38.212641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b950e1f-8c7d-45d1-999e-70111221e9ed admin admin] PATH_INFO: `/v3/users/7350c89a1af24f38a556adf793758fbf` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:38.213872 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b950e1f-8c7d-45d1-999e-70111221e9ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=7350c89a1af24f38a556adf793758fbf)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:38.215808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b950e1f-8c7d-45d1-999e-70111221e9ed admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:38.409315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6b950e1f-8c7d-45d1-999e-70111221e9ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7350c89a1af24f38a556adf793758fbf'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:38.409969 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6b950e1f-8c7d-45d1-999e-70111221e9ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7350c89a1af24f38a556adf793758fbf'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:38.410594 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6b950e1f-8c7d-45d1-999e-70111221e9ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7350c89a1af24f38a556adf793758fbf'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:38.422855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6b950e1f-8c7d-45d1-999e-70111221e9ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7350c89a1af24f38a556adf793758fbf'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:38.429625 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6b950e1f-8c7d-45d1-999e-70111221e9ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7350c89a1af24f38a556adf793758fbf'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:38.503962 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1203/2378] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:53:38 2022] DELETE /identity/v3/users/7350c89a1af24f38a556adf793758fbf => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:53:38.508588 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5033-ba30-424e-9e8c-48b25fd90c19 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:38.508897 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5033-ba30-424e-9e8c-48b25fd90c19 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:38.509173 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d5033-ba30-424e-9e8c-48b25fd90c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:38.526653 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-6e9d5033-ba30-424e-9e8c-48b25fd90c19 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:53:38.527902 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-6e9d5033-ba30-424e-9e8c-48b25fd90c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:38.584100 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1176/2379] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:53:38.594200 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b950e1f-8c7d-45d1-999e-70111221e9ed admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:38.595604 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-6b950e1f-8c7d-45d1-999e-70111221e9ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:38.651726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b950e1f-8c7d-45d1-999e-70111221e9ed admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:38.655365 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e378a-f87c-4f76-a7e6-775d0f17d697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:38.655996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e378a-f87c-4f76-a7e6-775d0f17d697 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:38.656277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e378a-f87c-4f76-a7e6-775d0f17d697 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:38.656551 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e378a-f87c-4f76-a7e6-775d0f17d697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:38.666206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e378a-f87c-4f76-a7e6-775d0f17d697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:38.667634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105e378a-f87c-4f76-a7e6-775d0f17d697 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:38.676825 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1204/2380] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:53:39.076686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d5033-ba30-424e-9e8c-48b25fd90c19 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:39.080421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-6e9d5033-ba30-424e-9e8c-48b25fd90c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:39.091749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d5033-ba30-424e-9e8c-48b25fd90c19 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:39.096634 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a53db-60f5-4db4-9ecc-c5d282645d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:39.097714 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a53db-60f5-4db4-9ecc-c5d282645d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:39.098089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a53db-60f5-4db4-9ecc-c5d282645d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:39.098463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a53db-60f5-4db4-9ecc-c5d282645d9c admin admin] PATH_INFO: `/v3/projects/eee0f5d9339a4cf5a8764c9c1c489c95` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:39.100181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a53db-60f5-4db4-9ecc-c5d282645d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee0f5d9339a4cf5a8764c9c1c489c95)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:39.102649 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a53db-60f5-4db4-9ecc-c5d282645d9c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:39.205101 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-977a53db-60f5-4db4-9ecc-c5d282645d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee0f5d9339a4cf5a8764c9c1c489c95', 'request_id': 'req-977a53db-60f5-4db4-9ecc-c5d282645d9c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:39.211671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-977a53db-60f5-4db4-9ecc-c5d282645d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee0f5d9339a4cf5a8764c9c1c489c95', 'request_id': 'req-977a53db-60f5-4db4-9ecc-c5d282645d9c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:39.217132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-977a53db-60f5-4db4-9ecc-c5d282645d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee0f5d9339a4cf5a8764c9c1c489c95', 'request_id': 'req-977a53db-60f5-4db4-9ecc-c5d282645d9c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:39.295587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-977a53db-60f5-4db4-9ecc-c5d282645d9c admin admin] The token cache is being invalidate because project eee0f5d9339a4cf5a8764c9c1c489c95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:53:39.298121 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-977a53db-60f5-4db4-9ecc-c5d282645d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:39.298121 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-977a53db-60f5-4db4-9ecc-c5d282645d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:39.298121 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1177/2381] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:53:39 2022] DELETE /identity/v3/projects/eee0f5d9339a4cf5a8764c9c1c489c95 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:53:39.302980 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb93215-2154-406e-b0ee-59129e447499 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:39.303502 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb93215-2154-406e-b0ee-59129e447499 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:39.303655 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb93215-2154-406e-b0ee-59129e447499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:39.322318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-dcb93215-2154-406e-b0ee-59129e447499 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:53:39.323532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-dcb93215-2154-406e-b0ee-59129e447499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:39.381929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1205/2382] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:53:39.390239 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f8f58-15df-4353-b7b3-006239a40228 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:39.391345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f8f58-15df-4353-b7b3-006239a40228 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:39.391345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f8f58-15df-4353-b7b3-006239a40228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:39.408721 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-618f8f58-15df-4353-b7b3-006239a40228 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:53:39.409915 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-618f8f58-15df-4353-b7b3-006239a40228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:39.417870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1178/2383] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 04:53:39.421967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb93215-2154-406e-b0ee-59129e447499 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:39.432448 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb93215-2154-406e-b0ee-59129e447499 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:39.437145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90276394-8c28-4276-8309-9e1613555c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:39.437790 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276394-8c28-4276-8309-9e1613555c7b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:39.438105 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276394-8c28-4276-8309-9e1613555c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:39.438374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90276394-8c28-4276-8309-9e1613555c7b admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:39.439136 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90276394-8c28-4276-8309-9e1613555c7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:53:39.439496 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90276394-8c28-4276-8309-9e1613555c7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:39.441075 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90276394-8c28-4276-8309-9e1613555c7b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:39.453269 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1206/2384] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:53:39.457554 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f8f58-15df-4353-b7b3-006239a40228 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:39.466728 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f8f58-15df-4353-b7b3-006239a40228 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:39.476399 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994dfb4-bb98-4d31-a647-938de48aa134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:39.476399 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994dfb4-bb98-4d31-a647-938de48aa134 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:39.476399 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994dfb4-bb98-4d31-a647-938de48aa134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:39.476399 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a994dfb4-bb98-4d31-a647-938de48aa134 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:39.476944 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994dfb4-bb98-4d31-a647-938de48aa134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:39.476944 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a994dfb4-bb98-4d31-a647-938de48aa134 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:39.588576 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1179/2385] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:53:39 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:53:39.592430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90276394-8c28-4276-8309-9e1613555c7b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:39.603055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90276394-8c28-4276-8309-9e1613555c7b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:39.659179 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0138f-a33d-42c0-a283-d31f827531c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:39.659866 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0138f-a33d-42c0-a283-d31f827531c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:39.660144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0138f-a33d-42c0-a283-d31f827531c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:39.660414 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0138f-a33d-42c0-a283-d31f827531c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:39.661113 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0138f-a33d-42c0-a283-d31f827531c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:39.663008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0138f-a33d-42c0-a283-d31f827531c1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:39.756555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1207/2386] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:53:39 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:53:39.760751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994dfb4-bb98-4d31-a647-938de48aa134 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:39.770757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a994dfb4-bb98-4d31-a647-938de48aa134 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:39.775340 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba36ac-7004-462f-829c-bcb55198b4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:39.775988 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba36ac-7004-462f-829c-bcb55198b4d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:39.776269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba36ac-7004-462f-829c-bcb55198b4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:39.776544 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba36ac-7004-462f-829c-bcb55198b4d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:39.777280 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba36ac-7004-462f-829c-bcb55198b4d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:39.778893 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba36ac-7004-462f-829c-bcb55198b4d6 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:39.789684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1180/2387] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:53:39.793668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0138f-a33d-42c0-a283-d31f827531c1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:39.804946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0138f-a33d-42c0-a283-d31f827531c1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:39.809612 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e114eb-c33f-44d2-979f-cf0daa8d7ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:39.810260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e114eb-c33f-44d2-979f-cf0daa8d7ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:39.810541 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e114eb-c33f-44d2-979f-cf0daa8d7ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:39.810814 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e114eb-c33f-44d2-979f-cf0daa8d7ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:39.811588 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e114eb-c33f-44d2-979f-cf0daa8d7ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:39.813301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e114eb-c33f-44d2-979f-cf0daa8d7ff7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:39.823500 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1208/2388] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:53:39.827035 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba36ac-7004-462f-829c-bcb55198b4d6 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:39.837452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba36ac-7004-462f-829c-bcb55198b4d6 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:39.842072 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98878ee-7e59-4b7b-812a-03a0b11b2ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:39.842919 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98878ee-7e59-4b7b-812a-03a0b11b2ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:39.843198 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98878ee-7e59-4b7b-812a-03a0b11b2ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:39.843512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98878ee-7e59-4b7b-812a-03a0b11b2ea9 admin admin] PATH_INFO: `/v3/projects/dd2ed8b9b5e84a90ac957cf47dc7f1b6/users/b4d4023b814944b5814f3537c41ac1af/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:39.859990 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98878ee-7e59-4b7b-812a-03a0b11b2ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd2ed8b9b5e84a90ac957cf47dc7f1b6, user_id=b4d4023b814944b5814f3537c41ac1af, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:39.862705 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98878ee-7e59-4b7b-812a-03a0b11b2ea9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:39.959565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1181/2389] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:53:39 2022] PUT /identity/v3/projects/dd2ed8b9b5e84a90ac957cf47dc7f1b6/users/b4d4023b814944b5814f3537c41ac1af/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 04:53:39.970243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95488063-5037-4958-a6bd-bdfa8bc32d49 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:39.970469 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95488063-5037-4958-a6bd-bdfa8bc32d49 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:39.970747 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95488063-5037-4958-a6bd-bdfa8bc32d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:40.000405 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-95488063-5037-4958-a6bd-bdfa8bc32d49 None None] MFA Rules not processed for user `b4d4023b814944b5814f3537c41ac1af`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:53:40.001615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-95488063-5037-4958-a6bd-bdfa8bc32d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:40.064198 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1209/2390] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:53:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:53:40.086888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98878ee-7e59-4b7b-812a-03a0b11b2ea9 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:40.088641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c98878ee-7e59-4b7b-812a-03a0b11b2ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:40.143110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98878ee-7e59-4b7b-812a-03a0b11b2ea9 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:40.146790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f00d2-a2b9-4344-85ec-75e1be3fc53b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:40.147449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f00d2-a2b9-4344-85ec-75e1be3fc53b service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:40.148250 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f00d2-a2b9-4344-85ec-75e1be3fc53b service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:40.148525 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f00d2-a2b9-4344-85ec-75e1be3fc53b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:40.157227 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f00d2-a2b9-4344-85ec-75e1be3fc53b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:40.159340 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f00d2-a2b9-4344-85ec-75e1be3fc53b service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:40.168101 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1182/2391] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:53:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:53:41.014426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95488063-5037-4958-a6bd-bdfa8bc32d49 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:41.023936 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95488063-5037-4958-a6bd-bdfa8bc32d49 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:41.027487 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a96e9-9b50-4cf0-bcf5-613771351bfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:41.028119 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a96e9-9b50-4cf0-bcf5-613771351bfb service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:41.028418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a96e9-9b50-4cf0-bcf5-613771351bfb service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:41.028666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a96e9-9b50-4cf0-bcf5-613771351bfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:41.031201 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ca0a96e9-9b50-4cf0-bcf5-613771351bfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:41.090642 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a96e9-9b50-4cf0-bcf5-613771351bfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:41.092218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a96e9-9b50-4cf0-bcf5-613771351bfb service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:41.101887 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1210/2392] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:53:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:53:41.145077 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f00d2-a2b9-4344-85ec-75e1be3fc53b service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:41.154336 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f00d2-a2b9-4344-85ec-75e1be3fc53b service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:41.158096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214371d-1f4c-496d-aa93-9b5295c6b63f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:41.158725 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214371d-1f4c-496d-aa93-9b5295c6b63f service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:41.159007 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214371d-1f4c-496d-aa93-9b5295c6b63f service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:41.159307 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214371d-1f4c-496d-aa93-9b5295c6b63f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:41.161115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d214371d-1f4c-496d-aa93-9b5295c6b63f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:41.227137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214371d-1f4c-496d-aa93-9b5295c6b63f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:41.228606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d214371d-1f4c-496d-aa93-9b5295c6b63f service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:41.247135 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1183/2393] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:53:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:53:42.013885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a96e9-9b50-4cf0-bcf5-613771351bfb service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:42.022237 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a96e9-9b50-4cf0-bcf5-613771351bfb service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:42.026496 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ae26d-33a4-44da-99ef-7e22fd44965a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:42.027126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ae26d-33a4-44da-99ef-7e22fd44965a service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:42.027438 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ae26d-33a4-44da-99ef-7e22fd44965a service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:42.027717 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559ae26d-33a4-44da-99ef-7e22fd44965a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:42.029457 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-559ae26d-33a4-44da-99ef-7e22fd44965a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:42.085046 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ae26d-33a4-44da-99ef-7e22fd44965a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:42.087311 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559ae26d-33a4-44da-99ef-7e22fd44965a service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:42.096141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1211/2394] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:53:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:53:44.756695 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214371d-1f4c-496d-aa93-9b5295c6b63f service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:44.758171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d214371d-1f4c-496d-aa93-9b5295c6b63f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:44.831858 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d214371d-1f4c-496d-aa93-9b5295c6b63f service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:44.837598 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eebd9-84fe-4984-bd02-01a034763ccf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:44.838242 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eebd9-84fe-4984-bd02-01a034763ccf service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:44.838530 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eebd9-84fe-4984-bd02-01a034763ccf service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:44.838852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63eebd9-84fe-4984-bd02-01a034763ccf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:44.840902 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e63eebd9-84fe-4984-bd02-01a034763ccf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:44.861969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63eebd9-84fe-4984-bd02-01a034763ccf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:44.861969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63eebd9-84fe-4984-bd02-01a034763ccf service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:44.869616 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1184/2395] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:53:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:53:48.707372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ae26d-33a4-44da-99ef-7e22fd44965a service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:48.708818 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-559ae26d-33a4-44da-99ef-7e22fd44965a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:48.765247 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559ae26d-33a4-44da-99ef-7e22fd44965a service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:48.768884 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8f9cb-e957-43a0-b22a-6e55262c25a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:48.769521 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f9cb-e957-43a0-b22a-6e55262c25a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:48.769795 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f9cb-e957-43a0-b22a-6e55262c25a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:48.770065 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f9cb-e957-43a0-b22a-6e55262c25a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:48.772066 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d1a8f9cb-e957-43a0-b22a-6e55262c25a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:48.838483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8f9cb-e957-43a0-b22a-6e55262c25a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:48.839953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8f9cb-e957-43a0-b22a-6e55262c25a3 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:48.849679 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1212/2396] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:53:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:53:52.505396 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eebd9-84fe-4984-bd02-01a034763ccf service nova] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:52.511274 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e63eebd9-84fe-4984-bd02-01a034763ccf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:52.521788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63eebd9-84fe-4984-bd02-01a034763ccf service nova] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:52.527548 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dd25ce-9340-42ed-bb3d-7426cbc779ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:52.528401 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd25ce-9340-42ed-bb3d-7426cbc779ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:52.528683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd25ce-9340-42ed-bb3d-7426cbc779ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:52.528955 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dd25ce-9340-42ed-bb3d-7426cbc779ad admin admin] PATH_INFO: `/v3/users/5e95a2f25a1b40af90995bdb6f871e3c` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:52.530256 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd25ce-9340-42ed-bb3d-7426cbc779ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e95a2f25a1b40af90995bdb6f871e3c)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:52.532190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dd25ce-9340-42ed-bb3d-7426cbc779ad admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:52.716149 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-68dd25ce-9340-42ed-bb3d-7426cbc779ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e95a2f25a1b40af90995bdb6f871e3c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:52.716898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-68dd25ce-9340-42ed-bb3d-7426cbc779ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e95a2f25a1b40af90995bdb6f871e3c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:52.717496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-68dd25ce-9340-42ed-bb3d-7426cbc779ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e95a2f25a1b40af90995bdb6f871e3c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:52.729449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-68dd25ce-9340-42ed-bb3d-7426cbc779ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e95a2f25a1b40af90995bdb6f871e3c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:52.736366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-68dd25ce-9340-42ed-bb3d-7426cbc779ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e95a2f25a1b40af90995bdb6f871e3c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:52.827643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1185/2397] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 04:53:52 2022] DELETE /identity/v3/users/5e95a2f25a1b40af90995bdb6f871e3c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:53:53.069071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8f9cb-e957-43a0-b22a-6e55262c25a3 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:53.080375 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8f9cb-e957-43a0-b22a-6e55262c25a3 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:53.137159 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65d214-8710-4649-8271-d5c55311601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:53.138017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65d214-8710-4649-8271-d5c55311601c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:53.138282 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65d214-8710-4649-8271-d5c55311601c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:53.138555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65d214-8710-4649-8271-d5c55311601c admin admin] PATH_INFO: `/v3/projects/be2efad4da384b669f8e000fc5c25830` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:53.139756 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65d214-8710-4649-8271-d5c55311601c admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2efad4da384b669f8e000fc5c25830)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:53.141681 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65d214-8710-4649-8271-d5c55311601c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:53.253183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5c65d214-8710-4649-8271-d5c55311601c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2efad4da384b669f8e000fc5c25830', 'request_id': 'req-5c65d214-8710-4649-8271-d5c55311601c'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:53.307375 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5c65d214-8710-4649-8271-d5c55311601c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2efad4da384b669f8e000fc5c25830', 'request_id': 'req-5c65d214-8710-4649-8271-d5c55311601c'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:53.313017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5c65d214-8710-4649-8271-d5c55311601c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2efad4da384b669f8e000fc5c25830', 'request_id': 'req-5c65d214-8710-4649-8271-d5c55311601c'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:53.324878 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5c65d214-8710-4649-8271-d5c55311601c admin admin] The token cache is being invalidate because project be2efad4da384b669f8e000fc5c25830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 04:53:53.325172 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5c65d214-8710-4649-8271-d5c55311601c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:53.325808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5c65d214-8710-4649-8271-d5c55311601c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 04:53:53.327386 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1213/2398] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 04:53:53 2022] DELETE /identity/v3/projects/be2efad4da384b669f8e000fc5c25830 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:53:53.333090 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746f008-d83f-4d53-b88e-38d2abc284b1 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:53.333380 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746f008-d83f-4d53-b88e-38d2abc284b1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:53.333657 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7746f008-d83f-4d53-b88e-38d2abc284b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:53.351591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-7746f008-d83f-4d53-b88e-38d2abc284b1 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:53:53.353125 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7746f008-d83f-4d53-b88e-38d2abc284b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:53.412826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1186/2399] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:53:53.421087 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36915495-1289-49cd-833a-d229b7987a02 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:53.421378 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36915495-1289-49cd-833a-d229b7987a02 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:53.421663 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36915495-1289-49cd-833a-d229b7987a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:53.440783 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-36915495-1289-49cd-833a-d229b7987a02 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:53:53.441996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-36915495-1289-49cd-833a-d229b7987a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:53.450507 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1214/2400] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:53:53.454542 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746f008-d83f-4d53-b88e-38d2abc284b1 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:53.465496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7746f008-d83f-4d53-b88e-38d2abc284b1 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:53.470068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfbd87-700a-49fe-af28-3343f17d6034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:53.470876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfbd87-700a-49fe-af28-3343f17d6034 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:53.471008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfbd87-700a-49fe-af28-3343f17d6034 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:53.471254 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfbd87-700a-49fe-af28-3343f17d6034 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:53.471993 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfbd87-700a-49fe-af28-3343f17d6034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 04:53:53.472298 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfbd87-700a-49fe-af28-3343f17d6034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:53.473877 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfbd87-700a-49fe-af28-3343f17d6034 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:53.487774 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1187/2401] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 04:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 04:53:53.494425 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36915495-1289-49cd-833a-d229b7987a02 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:53.503665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36915495-1289-49cd-833a-d229b7987a02 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:53.508275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c08a58-926d-430e-ab45-3e0ca0eb829f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:53.508977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08a58-926d-430e-ab45-3e0ca0eb829f admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:53.509261 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08a58-926d-430e-ab45-3e0ca0eb829f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:53.509535 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c08a58-926d-430e-ab45-3e0ca0eb829f admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:53.510237 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c08a58-926d-430e-ab45-3e0ca0eb829f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:53.512196 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c08a58-926d-430e-ab45-3e0ca0eb829f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:53.595680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1215/2402] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 04:53:53 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 04:53:53.599833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfbd87-700a-49fe-af28-3343f17d6034 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:53.610401 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfbd87-700a-49fe-af28-3343f17d6034 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:53.664215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed9fd-41e2-4417-8279-e59a7701373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:53.665608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed9fd-41e2-4417-8279-e59a7701373f admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:53.665885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed9fd-41e2-4417-8279-e59a7701373f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:53.666157 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed9fd-41e2-4417-8279-e59a7701373f admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:53.666865 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed9fd-41e2-4417-8279-e59a7701373f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:53.668866 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed9fd-41e2-4417-8279-e59a7701373f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:53.765648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1188/2403] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 04:53:53 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 04:53:53.769686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c08a58-926d-430e-ab45-3e0ca0eb829f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:53.780744 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c08a58-926d-430e-ab45-3e0ca0eb829f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:53.785342 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73713ef3-d66b-46e0-a702-587a23e010db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:53.785986 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73713ef3-d66b-46e0-a702-587a23e010db admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:53.786261 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73713ef3-d66b-46e0-a702-587a23e010db admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:53.786538 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73713ef3-d66b-46e0-a702-587a23e010db admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:53.787301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73713ef3-d66b-46e0-a702-587a23e010db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:53.788871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73713ef3-d66b-46e0-a702-587a23e010db admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:53.798849 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1216/2404] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:53:53.802578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed9fd-41e2-4417-8279-e59a7701373f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:53.812282 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed9fd-41e2-4417-8279-e59a7701373f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:53.817068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0cb1e-9976-4d88-932b-8474e733b349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:53.817738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0cb1e-9976-4d88-932b-8474e733b349 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:53.818017 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0cb1e-9976-4d88-932b-8474e733b349 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:53.818288 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0cb1e-9976-4d88-932b-8474e733b349 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:53.819046 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0cb1e-9976-4d88-932b-8474e733b349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:53.821191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0cb1e-9976-4d88-932b-8474e733b349 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:53.830688 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1189/2405] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 04:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 04:53:53.834553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73713ef3-d66b-46e0-a702-587a23e010db admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:53.845142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73713ef3-d66b-46e0-a702-587a23e010db admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:53.849764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c858493-e14c-4f67-8292-e6fbc648296c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:53.850623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c858493-e14c-4f67-8292-e6fbc648296c admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:53.850898 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c858493-e14c-4f67-8292-e6fbc648296c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:53.851168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c858493-e14c-4f67-8292-e6fbc648296c admin admin] PATH_INFO: `/v3/projects/22e3caeaad4246b09b371c7aca184f27/users/0596a225af1645498937367326e22e2d/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:53.865492 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c858493-e14c-4f67-8292-e6fbc648296c admin admin] RBAC: Authorizing `identity:create_grant(project_id=22e3caeaad4246b09b371c7aca184f27, user_id=0596a225af1645498937367326e22e2d, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:53.868246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c858493-e14c-4f67-8292-e6fbc648296c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:53.978971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1217/2406] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 04:53:53 2022] PUT /identity/v3/projects/22e3caeaad4246b09b371c7aca184f27/users/0596a225af1645498937367326e22e2d/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 04:53:53.989398 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6058ac1-5f0a-4569-9633-86a02eb9d9b1 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:53.989770 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6058ac1-5f0a-4569-9633-86a02eb9d9b1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:53.990046 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6058ac1-5f0a-4569-9633-86a02eb9d9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:54.016082 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-c6058ac1-5f0a-4569-9633-86a02eb9d9b1 None None] MFA Rules not processed for user `0596a225af1645498937367326e22e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 04:53:54.017200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c6058ac1-5f0a-4569-9633-86a02eb9d9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:54.079350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1190/2407] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 04:53:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 04:53:54.090472 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c858493-e14c-4f67-8292-e6fbc648296c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:53:54.092205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3c858493-e14c-4f67-8292-e6fbc648296c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:53:54.165508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c858493-e14c-4f67-8292-e6fbc648296c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:53:54.171071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5773e-5e97-4cf6-b1bc-7e0247d8ebb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:53:54.171738 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5773e-5e97-4cf6-b1bc-7e0247d8ebb7 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:53:54.172025 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5773e-5e97-4cf6-b1bc-7e0247d8ebb7 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:53:54.172305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b5773e-5e97-4cf6-b1bc-7e0247d8ebb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:53:54.181433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5773e-5e97-4cf6-b1bc-7e0247d8ebb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:53:54.183017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b5773e-5e97-4cf6-b1bc-7e0247d8ebb7 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:53:54.191996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1218/2408] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:53:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:54:42.907513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6058ac1-5f0a-4569-9633-86a02eb9d9b1 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:54:42.909010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c6058ac1-5f0a-4569-9633-86a02eb9d9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:54:42.965147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6058ac1-5f0a-4569-9633-86a02eb9d9b1 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:54:42.968706 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472168f6-5547-4649-bed4-e3069d74e3d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:54:42.969337 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472168f6-5547-4649-bed4-e3069d74e3d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:54:42.969617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472168f6-5547-4649-bed4-e3069d74e3d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:54:42.969891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472168f6-5547-4649-bed4-e3069d74e3d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:54:42.971677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-472168f6-5547-4649-bed4-e3069d74e3d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:54:43.028018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472168f6-5547-4649-bed4-e3069d74e3d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:54:43.029439 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472168f6-5547-4649-bed4-e3069d74e3d6 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:54:43.038412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1191/2409] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:54:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:54:55.208768 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5773e-5e97-4cf6-b1bc-7e0247d8ebb7 service nova] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:54:55.210326 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-98b5773e-5e97-4cf6-b1bc-7e0247d8ebb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:54:55.266342 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b5773e-5e97-4cf6-b1bc-7e0247d8ebb7 service nova] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:54:55.270012 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03500450-66f8-41e0-a381-650e1fb80925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:54:55.270651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03500450-66f8-41e0-a381-650e1fb80925 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:54:55.270935 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03500450-66f8-41e0-a381-650e1fb80925 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:54:55.271213 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03500450-66f8-41e0-a381-650e1fb80925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:54:55.273002 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-03500450-66f8-41e0-a381-650e1fb80925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:54:55.282857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03500450-66f8-41e0-a381-650e1fb80925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:54:55.284324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03500450-66f8-41e0-a381-650e1fb80925 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:54:55.292853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1219/2410] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:54:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:56:58.466719 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472168f6-5547-4649-bed4-e3069d74e3d6 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:56:58.468132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-472168f6-5547-4649-bed4-e3069d74e3d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:56:58.570025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472168f6-5547-4649-bed4-e3069d74e3d6 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:56:58.574935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b3eb4-ef7a-4103-affd-5c3a997ed716 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:56:58.575595 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b3eb4-ef7a-4103-affd-5c3a997ed716 service placement] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:56:58.575878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b3eb4-ef7a-4103-affd-5c3a997ed716 service placement] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:56:58.576154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755b3eb4-ef7a-4103-affd-5c3a997ed716 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:56:58.577904 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-755b3eb4-ef7a-4103-affd-5c3a997ed716 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:56:58.589382 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b3eb4-ef7a-4103-affd-5c3a997ed716 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:56:58.590932 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755b3eb4-ef7a-4103-affd-5c3a997ed716 service placement] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:56:58.601068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1192/2411] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:56:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:58:25.807147 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03500450-66f8-41e0-a381-650e1fb80925 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:58:25.808655 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-03500450-66f8-41e0-a381-650e1fb80925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:58:25.840813 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03500450-66f8-41e0-a381-650e1fb80925 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:58:25.844457 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929df55a-db65-42f6-96d3-3600ab076bd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:58:25.845081 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929df55a-db65-42f6-96d3-3600ab076bd8 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:58:25.845359 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929df55a-db65-42f6-96d3-3600ab076bd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:58:25.845632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929df55a-db65-42f6-96d3-3600ab076bd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:58:25.847677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-929df55a-db65-42f6-96d3-3600ab076bd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:58:25.875205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929df55a-db65-42f6-96d3-3600ab076bd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:58:25.876800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929df55a-db65-42f6-96d3-3600ab076bd8 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:58:25.889532 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1220/2412] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:58:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:58:25.931773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b3eb4-ef7a-4103-affd-5c3a997ed716 service placement] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:58:25.942509 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755b3eb4-ef7a-4103-affd-5c3a997ed716 service placement] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:58:25.946224 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4c8d0-711d-497a-affa-d109bb1c48f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:58:25.946856 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4c8d0-711d-497a-affa-d109bb1c48f6 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:58:25.947139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4c8d0-711d-497a-affa-d109bb1c48f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:58:25.947452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4c8d0-711d-497a-affa-d109bb1c48f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:58:25.949524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-abb4c8d0-711d-497a-affa-d109bb1c48f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:58:26.030112 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4c8d0-711d-497a-affa-d109bb1c48f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:58:26.031558 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4c8d0-711d-497a-affa-d109bb1c48f6 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:58:26.048937 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1193/2413] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:58:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:59:14.736508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929df55a-db65-42f6-96d3-3600ab076bd8 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:59:14.765584 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929df55a-db65-42f6-96d3-3600ab076bd8 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:59:14.769195 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b934407-1ad2-4ab9-a5ca-a4ae0fd07d6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:59:14.769818 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934407-1ad2-4ab9-a5ca-a4ae0fd07d6c service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:59:14.770099 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934407-1ad2-4ab9-a5ca-a4ae0fd07d6c service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:59:14.770376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b934407-1ad2-4ab9-a5ca-a4ae0fd07d6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:59:14.772326 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-7b934407-1ad2-4ab9-a5ca-a4ae0fd07d6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:59:14.828523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b934407-1ad2-4ab9-a5ca-a4ae0fd07d6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:59:14.829938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b934407-1ad2-4ab9-a5ca-a4ae0fd07d6c service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:59:14.839535 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1221/2414] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:59:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:59:14.902379 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4c8d0-711d-497a-affa-d109bb1c48f6 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:59:14.931377 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4c8d0-711d-497a-affa-d109bb1c48f6 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:59:14.934960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a3387-7671-4b96-9959-c3a6b7641d11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:59:14.935626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a3387-7671-4b96-9959-c3a6b7641d11 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:59:14.935907 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a3387-7671-4b96-9959-c3a6b7641d11 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:59:14.936176 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a3387-7671-4b96-9959-c3a6b7641d11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:59:14.937974 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-5b6a3387-7671-4b96-9959-c3a6b7641d11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:59:15.015249 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a3387-7671-4b96-9959-c3a6b7641d11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:59:15.016699 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6a3387-7671-4b96-9959-c3a6b7641d11 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:59:15.034697 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1194/2415] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:59:14 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:59:15.076071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b934407-1ad2-4ab9-a5ca-a4ae0fd07d6c service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:59:15.085047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b934407-1ad2-4ab9-a5ca-a4ae0fd07d6c service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:59:15.088679 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3b3a7-1531-46a5-973e-cd5107649560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:59:15.089304 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3b3a7-1531-46a5-973e-cd5107649560 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:59:15.089584 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3b3a7-1531-46a5-973e-cd5107649560 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:59:15.089914 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3b3a7-1531-46a5-973e-cd5107649560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:59:15.097995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3b3a7-1531-46a5-973e-cd5107649560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:59:15.100024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3b3a7-1531-46a5-973e-cd5107649560 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:59:15.108812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1222/2416] 10.222.0.35 () {60 vars in 1396 bytes} [Sat Feb 12 04:59:15 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3240 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:59:15.152248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a3387-7671-4b96-9959-c3a6b7641d11 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:59:15.152771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3b3a7-1531-46a5-973e-cd5107649560 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 04:59:15.160661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6a3387-7671-4b96-9959-c3a6b7641d11 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:59:15.165074 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a70174-754e-49b3-9c8f-7f0a59afbe81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:59:15.165710 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70174-754e-49b3-9c8f-7f0a59afbe81 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:59:15.165992 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70174-754e-49b3-9c8f-7f0a59afbe81 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:59:15.166265 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a70174-754e-49b3-9c8f-7f0a59afbe81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:59:15.168052 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e9a70174-754e-49b3-9c8f-7f0a59afbe81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:59:15.181504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3b3a7-1531-46a5-973e-cd5107649560 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 04:59:15.187405 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787013c-ac48-4411-9334-05a9c59c3b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 04:59:15.188048 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787013c-ac48-4411-9334-05a9c59c3b97 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 04:59:15.188328 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787013c-ac48-4411-9334-05a9c59c3b97 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 04:59:15.189042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787013c-ac48-4411-9334-05a9c59c3b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 04:59:15.190846 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1787013c-ac48-4411-9334-05a9c59c3b97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 04:59:15.248054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a70174-754e-49b3-9c8f-7f0a59afbe81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:59:15.249391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a70174-754e-49b3-9c8f-7f0a59afbe81 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:59:15.261290 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787013c-ac48-4411-9334-05a9c59c3b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 04:59:15.262892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787013c-ac48-4411-9334-05a9c59c3b97 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 04:59:15.267757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1195/2417] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:59:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 04:59:15.272066 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1223/2418] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 04:59:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:00:27.224983 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a70174-754e-49b3-9c8f-7f0a59afbe81 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:00:27.234266 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a70174-754e-49b3-9c8f-7f0a59afbe81 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:00:27.237916 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dafa89-9617-4388-84a6-f6b67b2db814 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:00:27.238552 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dafa89-9617-4388-84a6-f6b67b2db814 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:00:27.238833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dafa89-9617-4388-84a6-f6b67b2db814 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:00:27.239109 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dafa89-9617-4388-84a6-f6b67b2db814 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:00:27.248044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dafa89-9617-4388-84a6-f6b67b2db814 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:00:27.249458 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dafa89-9617-4388-84a6-f6b67b2db814 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:00:27.275549 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1196/2419] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:00:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:01:15.368620 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787013c-ac48-4411-9334-05a9c59c3b97 service nova] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:01:15.370163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1787013c-ac48-4411-9334-05a9c59c3b97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:01:15.499790 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787013c-ac48-4411-9334-05a9c59c3b97 service nova] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:01:15.505697 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fa883-ba66-4459-81c2-08d6653a0a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:01:15.508938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fa883-ba66-4459-81c2-08d6653a0a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:01:15.508938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fa883-ba66-4459-81c2-08d6653a0a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:01:15.508938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fa883-ba66-4459-81c2-08d6653a0a7d admin admin] PATH_INFO: `/v3/users/b4d4023b814944b5814f3537c41ac1af` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:01:15.508938 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fa883-ba66-4459-81c2-08d6653a0a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4d4023b814944b5814f3537c41ac1af)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:01:15.511547 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3fa883-ba66-4459-81c2-08d6653a0a7d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:01:15.689129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-bd3fa883-ba66-4459-81c2-08d6653a0a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4d4023b814944b5814f3537c41ac1af'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:01:15.689784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-bd3fa883-ba66-4459-81c2-08d6653a0a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4d4023b814944b5814f3537c41ac1af'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:01:15.690400 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-bd3fa883-ba66-4459-81c2-08d6653a0a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4d4023b814944b5814f3537c41ac1af'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:01:15.702301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-bd3fa883-ba66-4459-81c2-08d6653a0a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4d4023b814944b5814f3537c41ac1af'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:01:15.709784 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-bd3fa883-ba66-4459-81c2-08d6653a0a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4d4023b814944b5814f3537c41ac1af'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:01:15.784947 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1224/2420] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:01:15 2022] DELETE /identity/v3/users/b4d4023b814944b5814f3537c41ac1af => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:01:15.789381 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a0e5c-5c77-4b78-987a-3a4cd134946c None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:01:15.789913 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a0e5c-5c77-4b78-987a-3a4cd134946c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:01:15.789913 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a0e5c-5c77-4b78-987a-3a4cd134946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:01:15.816629 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-0f0a0e5c-5c77-4b78-987a-3a4cd134946c None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:01:15.822125 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0f0a0e5c-5c77-4b78-987a-3a4cd134946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:01:15.873818 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1197/2421] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:01:15.884095 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fa883-ba66-4459-81c2-08d6653a0a7d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:01:15.885481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-bd3fa883-ba66-4459-81c2-08d6653a0a7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:01:15.960256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fa883-ba66-4459-81c2-08d6653a0a7d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:01:15.964024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed8a5b-fa80-4f5a-81f9-17a4af1e0c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:01:15.964656 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed8a5b-fa80-4f5a-81f9-17a4af1e0c80 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:01:15.964935 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed8a5b-fa80-4f5a-81f9-17a4af1e0c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:01:15.965206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed8a5b-fa80-4f5a-81f9-17a4af1e0c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:01:15.974072 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed8a5b-fa80-4f5a-81f9-17a4af1e0c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:01:15.975800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ed8a5b-fa80-4f5a-81f9-17a4af1e0c80 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:01:15.984839 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1225/2422] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:01:16.358093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a0e5c-5c77-4b78-987a-3a4cd134946c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:01:16.359579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0f0a0e5c-5c77-4b78-987a-3a4cd134946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:01:16.375523 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a0e5c-5c77-4b78-987a-3a4cd134946c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:01:16.378122 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:01:16.379143 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:01:16.380438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:01:16.380438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] PATH_INFO: `/v3/projects/dd2ed8b9b5e84a90ac957cf47dc7f1b6` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:01:16.381062 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd2ed8b9b5e84a90ac957cf47dc7f1b6)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:01:16.383004 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:01:16.476499 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd2ed8b9b5e84a90ac957cf47dc7f1b6', 'request_id': 'req-73e0f57d-af78-4e29-8b82-2a0498b916a8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:01:16.482587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd2ed8b9b5e84a90ac957cf47dc7f1b6', 'request_id': 'req-73e0f57d-af78-4e29-8b82-2a0498b916a8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:01:16.487789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd2ed8b9b5e84a90ac957cf47dc7f1b6', 'request_id': 'req-73e0f57d-af78-4e29-8b82-2a0498b916a8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:01:16.532260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] The token cache is being invalidate because project dd2ed8b9b5e84a90ac957cf47dc7f1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:01:16.532549 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:01:16.533170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:01:16.534739 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1198/2423] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:01:16 2022] DELETE /identity/v3/projects/dd2ed8b9b5e84a90ac957cf47dc7f1b6 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:02:03.464798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed8a5b-fa80-4f5a-81f9-17a4af1e0c80 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:02:03.466172 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d2ed8a5b-fa80-4f5a-81f9-17a4af1e0c80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:02:03.534779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ed8a5b-fa80-4f5a-81f9-17a4af1e0c80 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:02:03.593300 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b17d10-219d-4787-8da6-c94eadda1b48 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:02:03.593940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b17d10-219d-4787-8da6-c94eadda1b48 service placement] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:02:03.594274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b17d10-219d-4787-8da6-c94eadda1b48 service placement] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:02:03.594543 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b17d10-219d-4787-8da6-c94eadda1b48 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:02:03.596339 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d2b17d10-219d-4787-8da6-c94eadda1b48 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:02:03.607636 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b17d10-219d-4787-8da6-c94eadda1b48 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:02:03.609200 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b17d10-219d-4787-8da6-c94eadda1b48 service placement] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:02:03.618936 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1226/2424] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:02:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:02:27.641932 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:02:27.643452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:02:27.709973 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0f57d-af78-4e29-8b82-2a0498b916a8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:02:27.714828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98bee4-f218-44d7-a543-3a9f0c3a3121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:02:27.715723 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98bee4-f218-44d7-a543-3a9f0c3a3121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:02:27.716009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98bee4-f218-44d7-a543-3a9f0c3a3121 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:02:27.716286 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98bee4-f218-44d7-a543-3a9f0c3a3121 admin admin] PATH_INFO: `/v3/users/1a17aa1d801144dbb16c396228ee8d25` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:02:27.717484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98bee4-f218-44d7-a543-3a9f0c3a3121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a17aa1d801144dbb16c396228ee8d25)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:02:27.719395 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb98bee4-f218-44d7-a543-3a9f0c3a3121 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:02:27.916337 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-eb98bee4-f218-44d7-a543-3a9f0c3a3121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a17aa1d801144dbb16c396228ee8d25'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:02:27.917042 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-eb98bee4-f218-44d7-a543-3a9f0c3a3121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a17aa1d801144dbb16c396228ee8d25'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:02:27.917645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-eb98bee4-f218-44d7-a543-3a9f0c3a3121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a17aa1d801144dbb16c396228ee8d25'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:02:27.929509 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-eb98bee4-f218-44d7-a543-3a9f0c3a3121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a17aa1d801144dbb16c396228ee8d25'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:02:27.936043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-eb98bee4-f218-44d7-a543-3a9f0c3a3121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a17aa1d801144dbb16c396228ee8d25'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:02:28.000268 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1199/2425] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:02:27 2022] DELETE /identity/v3/users/1a17aa1d801144dbb16c396228ee8d25 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:02:28.004695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348e277-5304-4a42-b5fe-f30f27a4e84b None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:02:28.005210 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348e277-5304-4a42-b5fe-f30f27a4e84b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:02:28.005316 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348e277-5304-4a42-b5fe-f30f27a4e84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:02:28.022715 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c348e277-5304-4a42-b5fe-f30f27a4e84b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:02:28.024199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c348e277-5304-4a42-b5fe-f30f27a4e84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:02:28.080271 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1227/2426] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:02:28.090228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98bee4-f218-44d7-a543-3a9f0c3a3121 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:02:28.091700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-eb98bee4-f218-44d7-a543-3a9f0c3a3121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:02:28.146654 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb98bee4-f218-44d7-a543-3a9f0c3a3121 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:02:28.150355 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb4fa9-3bae-45e5-aad1-0858ff7605b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:02:28.151005 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb4fa9-3bae-45e5-aad1-0858ff7605b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:02:28.151302 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb4fa9-3bae-45e5-aad1-0858ff7605b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:02:28.151583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb4fa9-3bae-45e5-aad1-0858ff7605b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:02:28.160368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb4fa9-3bae-45e5-aad1-0858ff7605b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:02:28.161776 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb4fa9-3bae-45e5-aad1-0858ff7605b9 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:02:28.171633 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1200/2427] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:02:28.585714 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348e277-5304-4a42-b5fe-f30f27a4e84b None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:02:28.591044 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c348e277-5304-4a42-b5fe-f30f27a4e84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:02:28.599753 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c348e277-5304-4a42-b5fe-f30f27a4e84b None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:02:28.605792 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:02:28.606637 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:02:28.606949 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:02:28.607177 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] PATH_INFO: `/v3/projects/809ff4a18a4c4f82876616b8980d06d9` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:02:28.608412 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=809ff4a18a4c4f82876616b8980d06d9)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:02:28.610940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:02:28.737310 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '809ff4a18a4c4f82876616b8980d06d9', 'request_id': 'req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:02:28.789869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '809ff4a18a4c4f82876616b8980d06d9', 'request_id': 'req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:02:28.795428 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '809ff4a18a4c4f82876616b8980d06d9', 'request_id': 'req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:02:28.806540 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] The token cache is being invalidate because project 809ff4a18a4c4f82876616b8980d06d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:02:28.806828 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:02:28.807564 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:02:28.809103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1228/2428] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:02:28 2022] DELETE /identity/v3/projects/809ff4a18a4c4f82876616b8980d06d9 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:04:27.689519 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb4fa9-3bae-45e5-aad1-0858ff7605b9 service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:04:27.689948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4ebb4fa9-3bae-45e5-aad1-0858ff7605b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:04:27.754248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb4fa9-3bae-45e5-aad1-0858ff7605b9 service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:04:27.799773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ddf50-efe6-4795-8465-978ddd4a873b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:04:27.800401 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ddf50-efe6-4795-8465-978ddd4a873b service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:04:27.800679 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ddf50-efe6-4795-8465-978ddd4a873b service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:04:27.800952 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98ddf50-efe6-4795-8465-978ddd4a873b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:04:27.802691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b98ddf50-efe6-4795-8465-978ddd4a873b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:04:27.879836 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ddf50-efe6-4795-8465-978ddd4a873b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:04:27.881791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98ddf50-efe6-4795-8465-978ddd4a873b service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:04:27.892513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1201/2429] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:04:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:04:27.900210 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:04:27.901591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:04:27.913382 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7dffc-becb-48b3-97dd-4b7879f21d9e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:04:27.916979 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0d9fb-8edd-439e-ba83-7894e9dcdf18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:04:27.917607 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0d9fb-8edd-439e-ba83-7894e9dcdf18 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:04:27.917888 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0d9fb-8edd-439e-ba83-7894e9dcdf18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:04:27.918169 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0d9fb-8edd-439e-ba83-7894e9dcdf18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:04:27.919977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-59d0d9fb-8edd-439e-ba83-7894e9dcdf18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:04:27.997955 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0d9fb-8edd-439e-ba83-7894e9dcdf18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:04:27.999393 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0d9fb-8edd-439e-ba83-7894e9dcdf18 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:04:28.017414 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1229/2430] 10.222.0.35 () {60 vars in 1396 bytes} [Sat Feb 12 05:04:27 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:04:28.061960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ddf50-efe6-4795-8465-978ddd4a873b service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:04:28.063438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b98ddf50-efe6-4795-8465-978ddd4a873b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:04:28.077934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98ddf50-efe6-4795-8465-978ddd4a873b service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:04:28.083877 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21135f4-d1bc-46fe-823f-97bbdeba9bf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:04:28.085181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21135f4-d1bc-46fe-823f-97bbdeba9bf9 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:04:28.085743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21135f4-d1bc-46fe-823f-97bbdeba9bf9 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:04:28.086032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21135f4-d1bc-46fe-823f-97bbdeba9bf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:04:28.087851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c21135f4-d1bc-46fe-823f-97bbdeba9bf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:04:28.147606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21135f4-d1bc-46fe-823f-97bbdeba9bf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:04:28.149178 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21135f4-d1bc-46fe-823f-97bbdeba9bf9 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:04:28.158175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1202/2431] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:04:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:04:28.182450 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0d9fb-8edd-439e-ba83-7894e9dcdf18 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:04:28.195000 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0d9fb-8edd-439e-ba83-7894e9dcdf18 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:04:28.200458 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d2656-30ce-409e-8d9d-56ae7b448a59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:04:28.201110 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d2656-30ce-409e-8d9d-56ae7b448a59 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:04:28.201390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d2656-30ce-409e-8d9d-56ae7b448a59 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:04:28.201671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d2656-30ce-409e-8d9d-56ae7b448a59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:04:28.203430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-fd0d2656-30ce-409e-8d9d-56ae7b448a59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:04:28.259666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d2656-30ce-409e-8d9d-56ae7b448a59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:04:28.261171 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d2656-30ce-409e-8d9d-56ae7b448a59 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:04:28.269945 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1230/2432] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:04:28 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:05:16.015605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21135f4-d1bc-46fe-823f-97bbdeba9bf9 service nova] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:16.017778 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c21135f4-d1bc-46fe-823f-97bbdeba9bf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:16.080447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21135f4-d1bc-46fe-823f-97bbdeba9bf9 service nova] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:16.084141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74833a-dc3c-404b-b960-24f1fdaefc6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:16.084774 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74833a-dc3c-404b-b960-24f1fdaefc6d service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:16.085052 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74833a-dc3c-404b-b960-24f1fdaefc6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:16.085378 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74833a-dc3c-404b-b960-24f1fdaefc6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:16.087073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-1b74833a-dc3c-404b-b960-24f1fdaefc6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:16.148828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74833a-dc3c-404b-b960-24f1fdaefc6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:16.150242 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74833a-dc3c-404b-b960-24f1fdaefc6d service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:16.159991 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1203/2433] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:05:19.504698 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958837a-f388-4569-bca5-3d9b21267ea1 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:19.506364 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958837a-f388-4569-bca5-3d9b21267ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:19.506522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958837a-f388-4569-bca5-3d9b21267ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:19.544256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-9958837a-f388-4569-bca5-3d9b21267ea1 None None] MFA Rules not processed for user `b030acfe033d4d6d8cca6f79d02594a7`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:05:19.545754 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9958837a-f388-4569-bca5-3d9b21267ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:19.554269 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1231/2434] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:05:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:05:20.063494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74833a-dc3c-404b-b960-24f1fdaefc6d service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:20.072022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74833a-dc3c-404b-b960-24f1fdaefc6d service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:20.075931 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ec579-1ac0-408a-a859-3a5ea8d787ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:20.076559 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ec579-1ac0-408a-a859-3a5ea8d787ea service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:20.076833 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ec579-1ac0-408a-a859-3a5ea8d787ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:20.077107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ec579-1ac0-408a-a859-3a5ea8d787ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:20.078815 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-db4ec579-1ac0-408a-a859-3a5ea8d787ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:20.088023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ec579-1ac0-408a-a859-3a5ea8d787ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:20.089483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ec579-1ac0-408a-a859-3a5ea8d787ea service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:20.097429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1204/2435] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:05:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:05:20.141085 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958837a-f388-4569-bca5-3d9b21267ea1 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:20.142510 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9958837a-f388-4569-bca5-3d9b21267ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:20.157048 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958837a-f388-4569-bca5-3d9b21267ea1 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:20.162146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680ab1d-1003-4f53-ac61-972d637dfdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:20.162640 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680ab1d-1003-4f53-ac61-972d637dfdf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:20.163090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680ab1d-1003-4f53-ac61-972d637dfdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:20.163432 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680ab1d-1003-4f53-ac61-972d637dfdf3 admin admin] PATH_INFO: `/v3/users/46193f5323954ed6b3a5e52fa0b3f0dc` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:20.164721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680ab1d-1003-4f53-ac61-972d637dfdf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46193f5323954ed6b3a5e52fa0b3f0dc)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:20.167190 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5680ab1d-1003-4f53-ac61-972d637dfdf3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:20.344086 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5680ab1d-1003-4f53-ac61-972d637dfdf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46193f5323954ed6b3a5e52fa0b3f0dc'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:05:20.344733 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5680ab1d-1003-4f53-ac61-972d637dfdf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46193f5323954ed6b3a5e52fa0b3f0dc'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:05:20.345354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5680ab1d-1003-4f53-ac61-972d637dfdf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46193f5323954ed6b3a5e52fa0b3f0dc'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:05:20.357736 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5680ab1d-1003-4f53-ac61-972d637dfdf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46193f5323954ed6b3a5e52fa0b3f0dc'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:05:20.364387 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-5680ab1d-1003-4f53-ac61-972d637dfdf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46193f5323954ed6b3a5e52fa0b3f0dc'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:05:20.438617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1232/2436] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:05:20 2022] DELETE /identity/v3/users/46193f5323954ed6b3a5e52fa0b3f0dc => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:05:20.517781 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ec579-1ac0-408a-a859-3a5ea8d787ea service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:20.519166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-db4ec579-1ac0-408a-a859-3a5ea8d787ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:20.590983 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ec579-1ac0-408a-a859-3a5ea8d787ea service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:20.653226 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ed792-af84-46cf-b7e1-c7557105e48d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:20.653865 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ed792-af84-46cf-b7e1-c7557105e48d service placement] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:20.654143 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ed792-af84-46cf-b7e1-c7557105e48d service placement] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:20.654412 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ed792-af84-46cf-b7e1-c7557105e48d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:20.656188 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e81ed792-af84-46cf-b7e1-c7557105e48d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:20.668115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ed792-af84-46cf-b7e1-c7557105e48d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:20.669738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ed792-af84-46cf-b7e1-c7557105e48d service placement] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:20.679369 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1205/2437] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:05:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:05:20.703930 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680ab1d-1003-4f53-ac61-972d637dfdf3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:20.709536 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5680ab1d-1003-4f53-ac61-972d637dfdf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:20.774977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680ab1d-1003-4f53-ac61-972d637dfdf3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:20.780241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6e648-2fd7-436f-9a06-fba27e833fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:20.781091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6e648-2fd7-436f-9a06-fba27e833fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:20.781370 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6e648-2fd7-436f-9a06-fba27e833fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:20.781642 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6e648-2fd7-436f-9a06-fba27e833fec admin admin] PATH_INFO: `/v3/projects/8a8defa94eb34a91a83ff931804a4f31` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:20.782851 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6e648-2fd7-436f-9a06-fba27e833fec admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a8defa94eb34a91a83ff931804a4f31)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:20.784855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6e648-2fd7-436f-9a06-fba27e833fec admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:20.928145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-94b6e648-2fd7-436f-9a06-fba27e833fec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a8defa94eb34a91a83ff931804a4f31', 'request_id': 'req-94b6e648-2fd7-436f-9a06-fba27e833fec'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:05:21.003252 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-94b6e648-2fd7-436f-9a06-fba27e833fec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a8defa94eb34a91a83ff931804a4f31', 'request_id': 'req-94b6e648-2fd7-436f-9a06-fba27e833fec'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:05:21.009368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-94b6e648-2fd7-436f-9a06-fba27e833fec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a8defa94eb34a91a83ff931804a4f31', 'request_id': 'req-94b6e648-2fd7-436f-9a06-fba27e833fec'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:05:21.021481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-94b6e648-2fd7-436f-9a06-fba27e833fec admin admin] The token cache is being invalidate because project 8a8defa94eb34a91a83ff931804a4f31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:05:21.021768 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-94b6e648-2fd7-436f-9a06-fba27e833fec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:05:21.022406 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-94b6e648-2fd7-436f-9a06-fba27e833fec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:05:21.023986 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1233/2438] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:05:20 2022] DELETE /identity/v3/projects/8a8defa94eb34a91a83ff931804a4f31 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:05:21.035686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e43c85-76e1-46cd-b585-81f49244cea0 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:21.036049 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e43c85-76e1-46cd-b585-81f49244cea0 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:21.036400 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e43c85-76e1-46cd-b585-81f49244cea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:21.088744 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-22e43c85-76e1-46cd-b585-81f49244cea0 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:05:21.090254 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-22e43c85-76e1-46cd-b585-81f49244cea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:21.155484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1206/2439] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:05:21.163534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adae164-1d74-4bad-a617-d8149c0a6081 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:21.163825 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adae164-1d74-4bad-a617-d8149c0a6081 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:21.164096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adae164-1d74-4bad-a617-d8149c0a6081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:21.184247 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-9adae164-1d74-4bad-a617-d8149c0a6081 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:05:21.185571 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9adae164-1d74-4bad-a617-d8149c0a6081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:21.194001 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1234/2440] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:05:21.198222 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e43c85-76e1-46cd-b585-81f49244cea0 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:21.207988 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e43c85-76e1-46cd-b585-81f49244cea0 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:21.212751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d922c75-ae98-4b17-82af-1ec65aac597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:21.216515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d922c75-ae98-4b17-82af-1ec65aac597a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:21.216515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d922c75-ae98-4b17-82af-1ec65aac597a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:21.216515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d922c75-ae98-4b17-82af-1ec65aac597a admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:21.216515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d922c75-ae98-4b17-82af-1ec65aac597a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:05:21.216515 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d922c75-ae98-4b17-82af-1ec65aac597a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:21.217017 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d922c75-ae98-4b17-82af-1ec65aac597a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:21.228570 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1207/2441] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:05:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 05:05:21.233792 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adae164-1d74-4bad-a617-d8149c0a6081 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:21.242983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adae164-1d74-4bad-a617-d8149c0a6081 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:21.248700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ce76f-678b-4dd1-821b-cf7379b4a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:21.249336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ce76f-678b-4dd1-821b-cf7379b4a93d admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:21.249611 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ce76f-678b-4dd1-821b-cf7379b4a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:21.249887 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ce76f-678b-4dd1-821b-cf7379b4a93d admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:21.250587 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ce76f-678b-4dd1-821b-cf7379b4a93d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:21.252676 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ce76f-678b-4dd1-821b-cf7379b4a93d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:21.348840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1235/2442] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:05:21 2022] POST /identity/v3/projects => generated 365 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:05:21.352996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d922c75-ae98-4b17-82af-1ec65aac597a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:21.363668 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d922c75-ae98-4b17-82af-1ec65aac597a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:21.418611 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafbfbc-bce9-4aa4-9850-a7d2ba6d3b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:21.419312 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafbfbc-bce9-4aa4-9850-a7d2ba6d3b41 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:21.419605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafbfbc-bce9-4aa4-9850-a7d2ba6d3b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:21.419877 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafbfbc-bce9-4aa4-9850-a7d2ba6d3b41 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:21.420593 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafbfbc-bce9-4aa4-9850-a7d2ba6d3b41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:21.422494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafbfbc-bce9-4aa4-9850-a7d2ba6d3b41 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:21.531077 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1208/2443] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:05:21 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:05:21.535113 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ce76f-678b-4dd1-821b-cf7379b4a93d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:21.546089 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ce76f-678b-4dd1-821b-cf7379b4a93d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:21.550708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2aac5-a899-42cc-8318-c5dbc8bf91d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:21.551392 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2aac5-a899-42cc-8318-c5dbc8bf91d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:21.552145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2aac5-a899-42cc-8318-c5dbc8bf91d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:21.552145 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a2aac5-a899-42cc-8318-c5dbc8bf91d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:21.552701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2aac5-a899-42cc-8318-c5dbc8bf91d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:21.554289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a2aac5-a899-42cc-8318-c5dbc8bf91d7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:21.564299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1236/2444] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:05:21.568237 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafbfbc-bce9-4aa4-9850-a7d2ba6d3b41 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:21.578489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafbfbc-bce9-4aa4-9850-a7d2ba6d3b41 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:21.583540 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73f9d04-c0e2-4bbf-beed-67ddf207018a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:21.584213 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f9d04-c0e2-4bbf-beed-67ddf207018a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:21.584511 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f9d04-c0e2-4bbf-beed-67ddf207018a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:21.584845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73f9d04-c0e2-4bbf-beed-67ddf207018a admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:21.585534 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f9d04-c0e2-4bbf-beed-67ddf207018a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:21.587136 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73f9d04-c0e2-4bbf-beed-67ddf207018a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:21.600918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1209/2445] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:05:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:05:21.605429 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2aac5-a899-42cc-8318-c5dbc8bf91d7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:21.616449 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a2aac5-a899-42cc-8318-c5dbc8bf91d7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:21.622106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d47bc-5466-4c3b-93cc-88520b5b8165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:21.623066 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d47bc-5466-4c3b-93cc-88520b5b8165 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:21.623451 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d47bc-5466-4c3b-93cc-88520b5b8165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:21.623801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426d47bc-5466-4c3b-93cc-88520b5b8165 admin admin] PATH_INFO: `/v3/projects/8756423791284069939de89805ef0bbc/users/c85e9591d8b44711ba74ddb1807c832d/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:21.640556 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d47bc-5466-4c3b-93cc-88520b5b8165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8756423791284069939de89805ef0bbc, user_id=c85e9591d8b44711ba74ddb1807c832d, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:21.643216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426d47bc-5466-4c3b-93cc-88520b5b8165 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:21.719020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1237/2446] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:05:21 2022] PUT /identity/v3/projects/8756423791284069939de89805ef0bbc/users/c85e9591d8b44711ba74ddb1807c832d/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:05:21.734384 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe96f4-b178-4c0b-91ea-f5d5b73fbb70 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:21.734662 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe96f4-b178-4c0b-91ea-f5d5b73fbb70 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:21.734935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe96f4-b178-4c0b-91ea-f5d5b73fbb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:21.761826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-9bfe96f4-b178-4c0b-91ea-f5d5b73fbb70 None None] MFA Rules not processed for user `c85e9591d8b44711ba74ddb1807c832d`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:05:21.762946 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9bfe96f4-b178-4c0b-91ea-f5d5b73fbb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:21.825828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1210/2447] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:05:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:05:21.830184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d47bc-5466-4c3b-93cc-88520b5b8165 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:21.891431 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426d47bc-5466-4c3b-93cc-88520b5b8165 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:21.896779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed247db-e4d3-4185-94ee-818f89b7dc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:21.897732 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed247db-e4d3-4185-94ee-818f89b7dc45 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:21.898126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed247db-e4d3-4185-94ee-818f89b7dc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:21.898404 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed247db-e4d3-4185-94ee-818f89b7dc45 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:21.899206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed247db-e4d3-4185-94ee-818f89b7dc45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:21.901491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed247db-e4d3-4185-94ee-818f89b7dc45 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:22.016093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1238/2448] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:05:21 2022] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:05:22.019014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe96f4-b178-4c0b-91ea-f5d5b73fbb70 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:22.030815 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe96f4-b178-4c0b-91ea-f5d5b73fbb70 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:22.087131 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a22eb-ae49-40bc-843b-d8cad31ca650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:22.087828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a22eb-ae49-40bc-843b-d8cad31ca650 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:22.088141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a22eb-ae49-40bc-843b-d8cad31ca650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:22.088740 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a22eb-ae49-40bc-843b-d8cad31ca650 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:22.089445 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a22eb-ae49-40bc-843b-d8cad31ca650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:22.091394 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a22eb-ae49-40bc-843b-d8cad31ca650 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:22.188105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1211/2449] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:05:22 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:05:22.191906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed247db-e4d3-4185-94ee-818f89b7dc45 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:22.202311 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed247db-e4d3-4185-94ee-818f89b7dc45 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:22.206945 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cc82e-632f-4170-bf5d-d71b41222a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:22.207624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cc82e-632f-4170-bf5d-d71b41222a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:22.207905 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cc82e-632f-4170-bf5d-d71b41222a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:22.208177 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31cc82e-632f-4170-bf5d-d71b41222a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:22.209072 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cc82e-632f-4170-bf5d-d71b41222a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:22.210668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31cc82e-632f-4170-bf5d-d71b41222a72 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:22.221673 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1239/2450] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:05:22.225678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a22eb-ae49-40bc-843b-d8cad31ca650 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:22.236977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a22eb-ae49-40bc-843b-d8cad31ca650 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:22.241700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377896b8-8808-4c93-9910-b64983203554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:22.242601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377896b8-8808-4c93-9910-b64983203554 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:22.242883 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377896b8-8808-4c93-9910-b64983203554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:22.243316 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377896b8-8808-4c93-9910-b64983203554 admin admin] PATH_INFO: `/v3/projects/51edd939540c41d5b89e952e1ea633ed/users/b2cfe5707a3445fa9a03ec3e9be60848/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:22.258152 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377896b8-8808-4c93-9910-b64983203554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51edd939540c41d5b89e952e1ea633ed, user_id=b2cfe5707a3445fa9a03ec3e9be60848, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:22.260894 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377896b8-8808-4c93-9910-b64983203554 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:22.325387 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1212/2451] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:05:22 2022] PUT /identity/v3/projects/51edd939540c41d5b89e952e1ea633ed/users/b2cfe5707a3445fa9a03ec3e9be60848/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:05:22.329278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cc82e-632f-4170-bf5d-d71b41222a72 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:22.339939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31cc82e-632f-4170-bf5d-d71b41222a72 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:22.397009 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3105ac4-8c8b-4b5e-a071-bf709a64bb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:22.397668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105ac4-8c8b-4b5e-a071-bf709a64bb5a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:22.397945 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105ac4-8c8b-4b5e-a071-bf709a64bb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:22.398216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3105ac4-8c8b-4b5e-a071-bf709a64bb5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:22.398945 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3105ac4-8c8b-4b5e-a071-bf709a64bb5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:22.400642 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3105ac4-8c8b-4b5e-a071-bf709a64bb5a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:22.410004 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1240/2452] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:05:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:05:22.414198 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377896b8-8808-4c93-9910-b64983203554 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:22.424433 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377896b8-8808-4c93-9910-b64983203554 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:22.430391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adafad3-9293-448b-9328-e2fcfdb3638c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:22.435219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adafad3-9293-448b-9328-e2fcfdb3638c admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:22.435219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adafad3-9293-448b-9328-e2fcfdb3638c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:22.435219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adafad3-9293-448b-9328-e2fcfdb3638c admin admin] PATH_INFO: `/v3/projects/51edd939540c41d5b89e952e1ea633ed/users/b2cfe5707a3445fa9a03ec3e9be60848/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:22.435219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adafad3-9293-448b-9328-e2fcfdb3638c admin admin] RBAC: Authorizing `identity:create_grant(project_id=51edd939540c41d5b89e952e1ea633ed, user_id=b2cfe5707a3445fa9a03ec3e9be60848, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:22.437727 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adafad3-9293-448b-9328-e2fcfdb3638c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:22.449623 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1213/2453] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:05:22 2022] PUT /identity/v3/projects/51edd939540c41d5b89e952e1ea633ed/users/b2cfe5707a3445fa9a03ec3e9be60848/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:05:22.459940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6ed97-aeba-4393-a15d-b39e5826973d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:22.460233 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6ed97-aeba-4393-a15d-b39e5826973d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:22.460514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6ed97-aeba-4393-a15d-b39e5826973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:22.487863 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c9e6ed97-aeba-4393-a15d-b39e5826973d None None] MFA Rules not processed for user `b2cfe5707a3445fa9a03ec3e9be60848`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:05:22.489140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c9e6ed97-aeba-4393-a15d-b39e5826973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:22.558885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1241/2454] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:05:22 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:05:22.568923 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adafad3-9293-448b-9328-e2fcfdb3638c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:22.570794 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9adafad3-9293-448b-9328-e2fcfdb3638c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:22.633451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adafad3-9293-448b-9328-e2fcfdb3638c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:22.638772 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aafba-494a-4c85-8359-e8e696dc9b35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:22.639252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aafba-494a-4c85-8359-e8e696dc9b35 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:22.639585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aafba-494a-4c85-8359-e8e696dc9b35 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:22.639866 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58aafba-494a-4c85-8359-e8e696dc9b35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:22.651900 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58aafba-494a-4c85-8359-e8e696dc9b35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:22.653426 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58aafba-494a-4c85-8359-e8e696dc9b35 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:22.664852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1214/2455] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:05:22 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:05:22.937865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6ed97-aeba-4393-a15d-b39e5826973d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:22.949338 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6ed97-aeba-4393-a15d-b39e5826973d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:22.953140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee6323-6fbd-4ef3-8eb7-27149afa8e3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:22.957434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee6323-6fbd-4ef3-8eb7-27149afa8e3d service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:22.957434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee6323-6fbd-4ef3-8eb7-27149afa8e3d service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:22.957434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee6323-6fbd-4ef3-8eb7-27149afa8e3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:23.025194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee6323-6fbd-4ef3-8eb7-27149afa8e3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:23.026685 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee6323-6fbd-4ef3-8eb7-27149afa8e3d service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:23.036174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1242/2456] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:05:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:05:23.677130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aafba-494a-4c85-8359-e8e696dc9b35 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:23.678671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e58aafba-494a-4c85-8359-e8e696dc9b35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:23.735492 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58aafba-494a-4c85-8359-e8e696dc9b35 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:23.739036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96038a-abb9-49e6-9fc2-9fcb45115864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:23.739692 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96038a-abb9-49e6-9fc2-9fcb45115864 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:23.739969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96038a-abb9-49e6-9fc2-9fcb45115864 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:23.740236 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96038a-abb9-49e6-9fc2-9fcb45115864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:23.741986 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4b96038a-abb9-49e6-9fc2-9fcb45115864 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:23.751021 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96038a-abb9-49e6-9fc2-9fcb45115864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:23.753082 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96038a-abb9-49e6-9fc2-9fcb45115864 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:23.761164 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1215/2457] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:05:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:05:24.577632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee6323-6fbd-4ef3-8eb7-27149afa8e3d service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:24.580267 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-33ee6323-6fbd-4ef3-8eb7-27149afa8e3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:24.674404 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee6323-6fbd-4ef3-8eb7-27149afa8e3d service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:24.680412 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac088bde-28c1-4d81-8f90-a62c2f8dbf19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:24.681054 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac088bde-28c1-4d81-8f90-a62c2f8dbf19 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:24.681333 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac088bde-28c1-4d81-8f90-a62c2f8dbf19 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:24.681607 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac088bde-28c1-4d81-8f90-a62c2f8dbf19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:24.683561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ac088bde-28c1-4d81-8f90-a62c2f8dbf19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:24.698779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac088bde-28c1-4d81-8f90-a62c2f8dbf19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:24.700504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac088bde-28c1-4d81-8f90-a62c2f8dbf19 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:24.714021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1243/2458] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:05:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:05:27.586943 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96038a-abb9-49e6-9fc2-9fcb45115864 service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:27.596639 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96038a-abb9-49e6-9fc2-9fcb45115864 service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:27.600667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0e690-c3ee-4924-9b4a-d173b504ef68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:27.601426 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0e690-c3ee-4924-9b4a-d173b504ef68 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:27.601707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0e690-c3ee-4924-9b4a-d173b504ef68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:27.601978 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d0e690-c3ee-4924-9b4a-d173b504ef68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:27.603851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-23d0e690-c3ee-4924-9b4a-d173b504ef68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:27.678367 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0e690-c3ee-4924-9b4a-d173b504ef68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:27.680032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d0e690-c3ee-4924-9b4a-d173b504ef68 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:27.698357 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1216/2459] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:05:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:05:29.380244 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac088bde-28c1-4d81-8f90-a62c2f8dbf19 service nova] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:29.392088 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac088bde-28c1-4d81-8f90-a62c2f8dbf19 service nova] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:29.397626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0b870a-620a-4037-a6bb-b2b671305884 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:29.398255 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b870a-620a-4037-a6bb-b2b671305884 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:29.398534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b870a-620a-4037-a6bb-b2b671305884 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:29.398809 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0b870a-620a-4037-a6bb-b2b671305884 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:29.401276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-4a0b870a-620a-4037-a6bb-b2b671305884 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:29.413160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b870a-620a-4037-a6bb-b2b671305884 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:29.414723 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0b870a-620a-4037-a6bb-b2b671305884 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:29.425287 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1244/2460] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:05:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:05:32.710891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0e690-c3ee-4924-9b4a-d173b504ef68 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:05:32.723845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d0e690-c3ee-4924-9b4a-d173b504ef68 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:05:32.729756 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ddaad-d78c-4494-96dd-8aad3fe04d64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:05:32.730387 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ddaad-d78c-4494-96dd-8aad3fe04d64 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:05:32.731130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ddaad-d78c-4494-96dd-8aad3fe04d64 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:05:32.731130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ddaad-d78c-4494-96dd-8aad3fe04d64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:05:32.732752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0a0ddaad-d78c-4494-96dd-8aad3fe04d64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:05:32.746153 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ddaad-d78c-4494-96dd-8aad3fe04d64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:05:32.747737 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ddaad-d78c-4494-96dd-8aad3fe04d64 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:05:32.758510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1217/2461] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:05:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:06:30.161664 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412ad8-80bb-496a-ab9c-42e98a66589b None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:30.162234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412ad8-80bb-496a-ab9c-42e98a66589b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:30.162234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412ad8-80bb-496a-ab9c-42e98a66589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:30.189645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-60412ad8-80bb-496a-ab9c-42e98a66589b None None] MFA Rules not processed for user `9d263d17f5844d95a75a9b0ba4fb2455`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:06:30.193507 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-60412ad8-80bb-496a-ab9c-42e98a66589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:30.202809 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1245/2462] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:06:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:06:31.384433 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ddaad-d78c-4494-96dd-8aad3fe04d64 service nova] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:31.385934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0a0ddaad-d78c-4494-96dd-8aad3fe04d64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:31.425081 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60412ad8-80bb-496a-ab9c-42e98a66589b None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:31.426792 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-60412ad8-80bb-496a-ab9c-42e98a66589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:31.481008 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ddaad-d78c-4494-96dd-8aad3fe04d64 service nova] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:31.486969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34932-cfdd-47ec-bb0c-6200f337eb1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3df18302cd84e6eae6a1a60b0a8b2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:31.487859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34932-cfdd-47ec-bb0c-6200f337eb1b service glance] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:31.489912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34932-cfdd-47ec-bb0c-6200f337eb1b service glance] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:31.489912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b34932-cfdd-47ec-bb0c-6200f337eb1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:31.490832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-41b34932-cfdd-47ec-bb0c-6200f337eb1b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:31.497446 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60412ad8-80bb-496a-ab9c-42e98a66589b None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:31.505151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-41b34932-cfdd-47ec-bb0c-6200f337eb1b service glance] Could not find project: f079fba01c664eccb7bf42ff18799296.: keystone.exception.ProjectNotFound: Could not find project: f079fba01c664eccb7bf42ff18799296. Feb 12 05:06:31.507571 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a720e-e446-49ca-85f1-c3c4a3b0759d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3df18302cd84e6eae6a1a60b0a8b2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:31.507751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a720e-e446-49ca-85f1-c3c4a3b0759d service glance] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:31.508091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a720e-e446-49ca-85f1-c3c4a3b0759d service glance] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:31.508368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a720e-e446-49ca-85f1-c3c4a3b0759d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:31.508588 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1218/2463] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:06:31 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 125 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 12 05:06:31.511017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-490a720e-e446-49ca-85f1-c3c4a3b0759d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:31.525932 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: WARNING keystone.server.flask.application [None req-490a720e-e446-49ca-85f1-c3c4a3b0759d service glance] Could not find project: 339d08e60b494bdbbcde5e0d99ed11bb.: keystone.exception.ProjectNotFound: Could not find project: 339d08e60b494bdbbcde5e0d99ed11bb. Feb 12 05:06:31.536158 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1246/2464] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:06:31 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Feb 12 05:06:31.552787 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34932-cfdd-47ec-bb0c-6200f337eb1b service glance] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:31.563156 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b34932-cfdd-47ec-bb0c-6200f337eb1b service glance] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:31.567145 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d485a-28fb-47e4-8bb1-0d403aa935d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3df18302cd84e6eae6a1a60b0a8b2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:31.568090 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d485a-28fb-47e4-8bb1-0d403aa935d1 service glance] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:31.568366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d485a-28fb-47e4-8bb1-0d403aa935d1 service glance] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:31.568634 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d485a-28fb-47e4-8bb1-0d403aa935d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:31.570448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-078d485a-28fb-47e4-8bb1-0d403aa935d1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:31.584660 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: WARNING keystone.server.flask.application [None req-078d485a-28fb-47e4-8bb1-0d403aa935d1 service glance] Could not find project: 809ff4a18a4c4f82876616b8980d06d9.: keystone.exception.ProjectNotFound: Could not find project: 809ff4a18a4c4f82876616b8980d06d9. Feb 12 05:06:31.585858 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1219/2465] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:06:31 2022] GET /identity/v3/auth/tokens => generated 113 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Feb 12 05:06:39.974517 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a720e-e446-49ca-85f1-c3c4a3b0759d service glance] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:40.039150 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a720e-e446-49ca-85f1-c3c4a3b0759d service glance] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:40.044522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8fcda-9990-4bb3-9475-a653022683c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:40.045427 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8fcda-9990-4bb3-9475-a653022683c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:40.045705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8fcda-9990-4bb3-9475-a653022683c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:40.045978 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda8fcda-9990-4bb3-9475-a653022683c5 admin admin] PATH_INFO: `/v3/users/c85e9591d8b44711ba74ddb1807c832d` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:40.047181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8fcda-9990-4bb3-9475-a653022683c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85e9591d8b44711ba74ddb1807c832d)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:40.049191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda8fcda-9990-4bb3-9475-a653022683c5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:40.244426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-cda8fcda-9990-4bb3-9475-a653022683c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85e9591d8b44711ba74ddb1807c832d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:40.245073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-cda8fcda-9990-4bb3-9475-a653022683c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85e9591d8b44711ba74ddb1807c832d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:40.245675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-cda8fcda-9990-4bb3-9475-a653022683c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85e9591d8b44711ba74ddb1807c832d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:40.258093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-cda8fcda-9990-4bb3-9475-a653022683c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85e9591d8b44711ba74ddb1807c832d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:40.265641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-cda8fcda-9990-4bb3-9475-a653022683c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85e9591d8b44711ba74ddb1807c832d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:40.328701 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1247/2466] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:06:39 2022] DELETE /identity/v3/users/c85e9591d8b44711ba74ddb1807c832d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:06:40.333197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff90d-73ed-498f-b1a4-ae9873925b3a None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:40.333733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff90d-73ed-498f-b1a4-ae9873925b3a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:40.333733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ff90d-73ed-498f-b1a4-ae9873925b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:40.353994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-e13ff90d-73ed-498f-b1a4-ae9873925b3a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:06:40.356920 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e13ff90d-73ed-498f-b1a4-ae9873925b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:40.426158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1220/2467] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:06:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:06:40.435837 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8fcda-9990-4bb3-9475-a653022683c5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:40.437293 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-cda8fcda-9990-4bb3-9475-a653022683c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:40.494773 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda8fcda-9990-4bb3-9475-a653022683c5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:40.498999 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15c24e-f86b-41c4-944f-b6aa0b8463d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:40.500084 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15c24e-f86b-41c4-944f-b6aa0b8463d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:40.500366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15c24e-f86b-41c4-944f-b6aa0b8463d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:40.500641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15c24e-f86b-41c4-944f-b6aa0b8463d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:40.510419 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15c24e-f86b-41c4-944f-b6aa0b8463d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:40.511965 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15c24e-f86b-41c4-944f-b6aa0b8463d4 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:40.525803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1248/2468] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:06:40.877749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ff90d-73ed-498f-b1a4-ae9873925b3a None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:40.879252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e13ff90d-73ed-498f-b1a4-ae9873925b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:40.891398 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ff90d-73ed-498f-b1a4-ae9873925b3a None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:40.896027 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:40.896970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:40.897249 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:40.897520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] PATH_INFO: `/v3/projects/8756423791284069939de89805ef0bbc` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:40.898890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8756423791284069939de89805ef0bbc)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:40.900724 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:40.990552 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8756423791284069939de89805ef0bbc', 'request_id': 'req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:40.996766 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8756423791284069939de89805ef0bbc', 'request_id': 'req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:41.002171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8756423791284069939de89805ef0bbc', 'request_id': 'req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:41.069628 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] The token cache is being invalidate because project 8756423791284069939de89805ef0bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:06:41.069914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:41.070530 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:41.074951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1221/2469] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:06:40 2022] DELETE /identity/v3/projects/8756423791284069939de89805ef0bbc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:06:41.076477 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15c24e-f86b-41c4-944f-b6aa0b8463d4 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:41.086413 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15c24e-f86b-41c4-944f-b6aa0b8463d4 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:41.140950 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d4d62-1c14-40da-b094-ec72e49c5307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:41.141801 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d4d62-1c14-40da-b094-ec72e49c5307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:41.142079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d4d62-1c14-40da-b094-ec72e49c5307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:41.142560 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d4d62-1c14-40da-b094-ec72e49c5307 admin admin] PATH_INFO: `/v3/users/b2cfe5707a3445fa9a03ec3e9be60848` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:41.143850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d4d62-1c14-40da-b094-ec72e49c5307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2cfe5707a3445fa9a03ec3e9be60848)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:41.146023 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d4d62-1c14-40da-b094-ec72e49c5307 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:41.324416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-026d4d62-1c14-40da-b094-ec72e49c5307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2cfe5707a3445fa9a03ec3e9be60848'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:41.325074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-026d4d62-1c14-40da-b094-ec72e49c5307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2cfe5707a3445fa9a03ec3e9be60848'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:41.325783 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-026d4d62-1c14-40da-b094-ec72e49c5307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2cfe5707a3445fa9a03ec3e9be60848'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:41.337086 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-026d4d62-1c14-40da-b094-ec72e49c5307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2cfe5707a3445fa9a03ec3e9be60848'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:41.343934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-026d4d62-1c14-40da-b094-ec72e49c5307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2cfe5707a3445fa9a03ec3e9be60848'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:41.418476 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1249/2470] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:06:41 2022] DELETE /identity/v3/users/b2cfe5707a3445fa9a03ec3e9be60848 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:06:41.907105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:41.908700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:41.925920 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb3a09a-b924-461c-95b7-a9eedda8c0ba admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:41.990737 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:41.991704 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:41.991996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:41.992274 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d admin admin] PATH_INFO: `/v3/projects/51edd939540c41d5b89e952e1ea633ed` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:41.993516 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=51edd939540c41d5b89e952e1ea633ed)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:41.995477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:42.087952 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51edd939540c41d5b89e952e1ea633ed', 'request_id': 'req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:42.095385 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51edd939540c41d5b89e952e1ea633ed', 'request_id': 'req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:42.101539 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51edd939540c41d5b89e952e1ea633ed', 'request_id': 'req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:42.188350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d admin admin] The token cache is being invalidate because project 51edd939540c41d5b89e952e1ea633ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:06:42.188350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:42.188350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2654a03e-bfed-4c5d-85d4-48aad6a0bb4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:42.188350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1222/2471] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:06:41 2022] DELETE /identity/v3/projects/51edd939540c41d5b89e952e1ea633ed => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:06:42.192699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7c35a-addd-45f0-899d-06d3a47dc729 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:42.193227 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7c35a-addd-45f0-899d-06d3a47dc729 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:42.193334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7c35a-addd-45f0-899d-06d3a47dc729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:42.217729 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-08c7c35a-addd-45f0-899d-06d3a47dc729 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:06:42.218927 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-08c7c35a-addd-45f0-899d-06d3a47dc729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:42.276903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1250/2472] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:06:42.285899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1d63d-2d92-4ba6-986b-8350818765cb None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:42.286189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1d63d-2d92-4ba6-986b-8350818765cb None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:42.286470 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1d63d-2d92-4ba6-986b-8350818765cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:42.304994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-57e1d63d-2d92-4ba6-986b-8350818765cb None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:06:42.306183 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-57e1d63d-2d92-4ba6-986b-8350818765cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:42.314170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1223/2473] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:06:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:06:42.318313 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7c35a-addd-45f0-899d-06d3a47dc729 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:42.328031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7c35a-addd-45f0-899d-06d3a47dc729 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:42.332660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b02bc2-7402-4173-9e9f-ecbffc40c6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:42.333304 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02bc2-7402-4173-9e9f-ecbffc40c6e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:42.333579 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02bc2-7402-4173-9e9f-ecbffc40c6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:42.333851 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b02bc2-7402-4173-9e9f-ecbffc40c6e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:42.334582 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b02bc2-7402-4173-9e9f-ecbffc40c6e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:06:42.334885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b02bc2-7402-4173-9e9f-ecbffc40c6e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:42.336534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b02bc2-7402-4173-9e9f-ecbffc40c6e6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:42.348641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1251/2474] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:06:42.352869 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1d63d-2d92-4ba6-986b-8350818765cb None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:42.362565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1d63d-2d92-4ba6-986b-8350818765cb None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:42.367238 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275333b-ad3f-4c4d-b458-4d9d69236379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:42.367880 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275333b-ad3f-4c4d-b458-4d9d69236379 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:42.368157 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275333b-ad3f-4c4d-b458-4d9d69236379 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:42.368428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275333b-ad3f-4c4d-b458-4d9d69236379 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:42.369132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275333b-ad3f-4c4d-b458-4d9d69236379 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:42.370994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275333b-ad3f-4c4d-b458-4d9d69236379 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:42.467110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1224/2475] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:06:42 2022] POST /identity/v3/projects => generated 401 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:06:42.471090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b02bc2-7402-4173-9e9f-ecbffc40c6e6 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:42.480766 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b02bc2-7402-4173-9e9f-ecbffc40c6e6 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:42.535529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb5865-203d-4d80-a232-a300ceee1508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:42.536191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb5865-203d-4d80-a232-a300ceee1508 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:42.536472 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb5865-203d-4d80-a232-a300ceee1508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:42.536746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb5865-203d-4d80-a232-a300ceee1508 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:42.537469 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb5865-203d-4d80-a232-a300ceee1508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:42.539426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb5865-203d-4d80-a232-a300ceee1508 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:42.614553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1252/2476] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:06:42 2022] POST /identity/v3/users => generated 301 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:06:42.618639 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275333b-ad3f-4c4d-b458-4d9d69236379 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:42.628902 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275333b-ad3f-4c4d-b458-4d9d69236379 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:42.633959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a702d3e-50e3-4f28-9547-592c74a87717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:42.634716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a702d3e-50e3-4f28-9547-592c74a87717 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:42.634913 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a702d3e-50e3-4f28-9547-592c74a87717 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:42.635149 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a702d3e-50e3-4f28-9547-592c74a87717 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:42.635946 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a702d3e-50e3-4f28-9547-592c74a87717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:42.637617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a702d3e-50e3-4f28-9547-592c74a87717 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:42.650389 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1225/2477] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:06:42.654386 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb5865-203d-4d80-a232-a300ceee1508 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:42.665195 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb5865-203d-4d80-a232-a300ceee1508 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:42.669982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0a851c-169d-4e2d-9ad2-61c62960b290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:42.670991 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a851c-169d-4e2d-9ad2-61c62960b290 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:42.671415 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a851c-169d-4e2d-9ad2-61c62960b290 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:42.671823 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0a851c-169d-4e2d-9ad2-61c62960b290 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:42.672636 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a851c-169d-4e2d-9ad2-61c62960b290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:42.674308 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0a851c-169d-4e2d-9ad2-61c62960b290 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:42.686527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1253/2478] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:06:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:06:42.690665 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a702d3e-50e3-4f28-9547-592c74a87717 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:42.700576 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a702d3e-50e3-4f28-9547-592c74a87717 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:42.705788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbfb27-c316-4906-bbd7-9c4968c7819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:42.706661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbfb27-c316-4906-bbd7-9c4968c7819f admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:42.706942 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbfb27-c316-4906-bbd7-9c4968c7819f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:42.707213 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fbfb27-c316-4906-bbd7-9c4968c7819f admin admin] PATH_INFO: `/v3/projects/52f54843034c4bef85a617e4c1e5bd16/users/17062df1b77747a991f05c90b44b42d3/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:42.723684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fbfb27-c316-4906-bbd7-9c4968c7819f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f54843034c4bef85a617e4c1e5bd16, user_id=17062df1b77747a991f05c90b44b42d3, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:42.726263 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fbfb27-c316-4906-bbd7-9c4968c7819f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:42.797110 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1226/2479] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:06:42 2022] PUT /identity/v3/projects/52f54843034c4bef85a617e4c1e5bd16/users/17062df1b77747a991f05c90b44b42d3/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:06:42.807254 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a721e96-8bb0-4b38-95ef-5e469b579bde None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:42.807543 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a721e96-8bb0-4b38-95ef-5e469b579bde None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:42.807819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a721e96-8bb0-4b38-95ef-5e469b579bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:42.836403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-0a721e96-8bb0-4b38-95ef-5e469b579bde None None] MFA Rules not processed for user `17062df1b77747a991f05c90b44b42d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:06:42.837650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-0a721e96-8bb0-4b38-95ef-5e469b579bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:42.913509 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1254/2480] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:06:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:06:42.917494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbfb27-c316-4906-bbd7-9c4968c7819f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:42.977905 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fbfb27-c316-4906-bbd7-9c4968c7819f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:42.982418 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a40be7-ed77-4524-9fd8-c9da64174904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:42.983118 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a40be7-ed77-4524-9fd8-c9da64174904 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:42.983424 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a40be7-ed77-4524-9fd8-c9da64174904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:42.983697 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a40be7-ed77-4524-9fd8-c9da64174904 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:42.984390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a40be7-ed77-4524-9fd8-c9da64174904 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:42.986259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a40be7-ed77-4524-9fd8-c9da64174904 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:43.103935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1227/2481] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:06:42 2022] POST /identity/v3/projects => generated 401 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:06:43.105164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a721e96-8bb0-4b38-95ef-5e469b579bde None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:43.116378 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a721e96-8bb0-4b38-95ef-5e469b579bde None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:43.173887 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf4bee-3d80-49ba-bd94-e362134298e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:43.174552 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf4bee-3d80-49ba-bd94-e362134298e3 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:43.174833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf4bee-3d80-49ba-bd94-e362134298e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:43.175105 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf4bee-3d80-49ba-bd94-e362134298e3 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:43.175867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf4bee-3d80-49ba-bd94-e362134298e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:43.177853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdf4bee-3d80-49ba-bd94-e362134298e3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:43.288153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1255/2482] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:06:43 2022] POST /identity/v3/users => generated 307 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:06:43.292185 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a40be7-ed77-4524-9fd8-c9da64174904 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:43.302828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a40be7-ed77-4524-9fd8-c9da64174904 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:43.307536 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898ceb-6930-4621-a677-6126d746a027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:43.308224 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898ceb-6930-4621-a677-6126d746a027 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:43.308503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898ceb-6930-4621-a677-6126d746a027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:43.308781 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898ceb-6930-4621-a677-6126d746a027 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:43.309520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d898ceb-6930-4621-a677-6126d746a027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:43.311834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d898ceb-6930-4621-a677-6126d746a027 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:43.322791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1228/2483] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:06:43.327764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf4bee-3d80-49ba-bd94-e362134298e3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:43.338097 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf4bee-3d80-49ba-bd94-e362134298e3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:43.344465 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4119141-14a2-430a-a377-21c6b5707878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:43.345902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4119141-14a2-430a-a377-21c6b5707878 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:43.346306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4119141-14a2-430a-a377-21c6b5707878 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:43.346592 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4119141-14a2-430a-a377-21c6b5707878 admin admin] PATH_INFO: `/v3/projects/1af4f1930e344fb38606cfd86554e129/users/b56308a976db4e5e8521b83f8b8cb51c/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:43.362996 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4119141-14a2-430a-a377-21c6b5707878 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af4f1930e344fb38606cfd86554e129, user_id=b56308a976db4e5e8521b83f8b8cb51c, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:43.365814 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4119141-14a2-430a-a377-21c6b5707878 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:43.506206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1256/2484] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:06:43 2022] PUT /identity/v3/projects/1af4f1930e344fb38606cfd86554e129/users/b56308a976db4e5e8521b83f8b8cb51c/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:06:43.510127 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898ceb-6930-4621-a677-6126d746a027 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:43.520135 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898ceb-6930-4621-a677-6126d746a027 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:43.574969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d310cb9-edc4-4d7f-ab48-3c9f8c6d1f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:43.575675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d310cb9-edc4-4d7f-ab48-3c9f8c6d1f7c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:43.575954 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d310cb9-edc4-4d7f-ab48-3c9f8c6d1f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:43.576249 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d310cb9-edc4-4d7f-ab48-3c9f8c6d1f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:43.576972 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d310cb9-edc4-4d7f-ab48-3c9f8c6d1f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:43.578569 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d310cb9-edc4-4d7f-ab48-3c9f8c6d1f7c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:43.588672 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1229/2485] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:06:43.593499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4119141-14a2-430a-a377-21c6b5707878 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:43.604540 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4119141-14a2-430a-a377-21c6b5707878 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:43.618173 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9db0-e92e-45b3-9b6c-650fd5f3b72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:43.619092 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9db0-e92e-45b3-9b6c-650fd5f3b72b admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:43.619411 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9db0-e92e-45b3-9b6c-650fd5f3b72b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:43.619691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede9db0-e92e-45b3-9b6c-650fd5f3b72b admin admin] PATH_INFO: `/v3/projects/1af4f1930e344fb38606cfd86554e129/users/b56308a976db4e5e8521b83f8b8cb51c/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:43.621845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede9db0-e92e-45b3-9b6c-650fd5f3b72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af4f1930e344fb38606cfd86554e129, user_id=b56308a976db4e5e8521b83f8b8cb51c, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:43.625702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede9db0-e92e-45b3-9b6c-650fd5f3b72b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:43.636858 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1257/2486] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:06:43 2022] PUT /identity/v3/projects/1af4f1930e344fb38606cfd86554e129/users/b56308a976db4e5e8521b83f8b8cb51c/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:06:43.647492 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9565-2199-4120-8cec-89ea4fe20b74 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:43.647780 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9565-2199-4120-8cec-89ea4fe20b74 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:43.648056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae9565-2199-4120-8cec-89ea4fe20b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:43.674329 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-47ae9565-2199-4120-8cec-89ea4fe20b74 None None] MFA Rules not processed for user `b56308a976db4e5e8521b83f8b8cb51c`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:06:43.675558 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-47ae9565-2199-4120-8cec-89ea4fe20b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:43.744250 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1230/2487] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:06:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:06:43.753994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9db0-e92e-45b3-9b6c-650fd5f3b72b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:43.755714 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1ede9db0-e92e-45b3-9b6c-650fd5f3b72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:43.811747 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede9db0-e92e-45b3-9b6c-650fd5f3b72b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:43.816315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2e7df-88f5-4be8-8224-7a84170e31bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:43.816684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2e7df-88f5-4be8-8224-7a84170e31bd service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:43.816951 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2e7df-88f5-4be8-8224-7a84170e31bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:43.817256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca2e7df-88f5-4be8-8224-7a84170e31bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:43.827815 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2e7df-88f5-4be8-8224-7a84170e31bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:43.829263 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca2e7df-88f5-4be8-8224-7a84170e31bd service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:43.838856 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1258/2488] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:06:43 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:06:44.062938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae9565-2199-4120-8cec-89ea4fe20b74 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:44.064464 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-47ae9565-2199-4120-8cec-89ea4fe20b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:44.076308 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae9565-2199-4120-8cec-89ea4fe20b74 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:44.081254 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f0439-bdad-4a7e-b61b-90bc80e51b78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:44.081995 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f0439-bdad-4a7e-b61b-90bc80e51b78 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:44.082355 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f0439-bdad-4a7e-b61b-90bc80e51b78 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:44.082634 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f0439-bdad-4a7e-b61b-90bc80e51b78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:44.143757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f0439-bdad-4a7e-b61b-90bc80e51b78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:44.145181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f0439-bdad-4a7e-b61b-90bc80e51b78 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:44.154092 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1231/2489] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:06:44 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:06:49.019737 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2e7df-88f5-4be8-8224-7a84170e31bd service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:49.081806 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca2e7df-88f5-4be8-8224-7a84170e31bd service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:49.086336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4132b0-888e-42bf-be2a-bfd89dc26a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:49.087243 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4132b0-888e-42bf-be2a-bfd89dc26a8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:49.087487 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4132b0-888e-42bf-be2a-bfd89dc26a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:49.087841 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4132b0-888e-42bf-be2a-bfd89dc26a8c admin admin] PATH_INFO: `/v3/users/17062df1b77747a991f05c90b44b42d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:49.088921 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4132b0-888e-42bf-be2a-bfd89dc26a8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=17062df1b77747a991f05c90b44b42d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:49.091128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4132b0-888e-42bf-be2a-bfd89dc26a8c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:49.266469 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6f4132b0-888e-42bf-be2a-bfd89dc26a8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17062df1b77747a991f05c90b44b42d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:49.267569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6f4132b0-888e-42bf-be2a-bfd89dc26a8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17062df1b77747a991f05c90b44b42d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:49.268227 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6f4132b0-888e-42bf-be2a-bfd89dc26a8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17062df1b77747a991f05c90b44b42d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:49.279609 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6f4132b0-888e-42bf-be2a-bfd89dc26a8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17062df1b77747a991f05c90b44b42d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:49.286901 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6f4132b0-888e-42bf-be2a-bfd89dc26a8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17062df1b77747a991f05c90b44b42d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:49.367172 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1259/2490] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:06:49 2022] DELETE /identity/v3/users/17062df1b77747a991f05c90b44b42d3 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:06:49.371705 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468e915-263d-4218-b086-6f1d421659c9 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:49.372310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468e915-263d-4218-b086-6f1d421659c9 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:49.372310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468e915-263d-4218-b086-6f1d421659c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:49.389356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-9468e915-263d-4218-b086-6f1d421659c9 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:06:49.390549 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9468e915-263d-4218-b086-6f1d421659c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:49.446287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1232/2491] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:06:49.456519 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4132b0-888e-42bf-be2a-bfd89dc26a8c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:49.458053 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-6f4132b0-888e-42bf-be2a-bfd89dc26a8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:49.514081 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4132b0-888e-42bf-be2a-bfd89dc26a8c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:49.518623 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aa00c-22b6-4e6c-8d7b-2168fac9cb7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:49.519206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa00c-22b6-4e6c-8d7b-2168fac9cb7f service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:49.519526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa00c-22b6-4e6c-8d7b-2168fac9cb7f service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:49.519802 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9aa00c-22b6-4e6c-8d7b-2168fac9cb7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:49.528937 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9aa00c-22b6-4e6c-8d7b-2168fac9cb7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:49.530364 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9aa00c-22b6-4e6c-8d7b-2168fac9cb7f service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:49.540009 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1260/2492] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:06:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:06:49.980068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468e915-263d-4218-b086-6f1d421659c9 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:49.981522 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9468e915-263d-4218-b086-6f1d421659c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:49.994384 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468e915-263d-4218-b086-6f1d421659c9 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:49.999332 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:50.000189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:50.000500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:50.000807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] PATH_INFO: `/v3/projects/52f54843034c4bef85a617e4c1e5bd16` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:50.002259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f54843034c4bef85a617e4c1e5bd16)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:50.004194 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:50.106314 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f54843034c4bef85a617e4c1e5bd16', 'request_id': 'req-3a630865-3569-4aad-91d5-8381d8c0c4ac'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:50.112425 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f54843034c4bef85a617e4c1e5bd16', 'request_id': 'req-3a630865-3569-4aad-91d5-8381d8c0c4ac'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:50.117852 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f54843034c4bef85a617e4c1e5bd16', 'request_id': 'req-3a630865-3569-4aad-91d5-8381d8c0c4ac'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:50.195190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] The token cache is being invalidate because project 52f54843034c4bef85a617e4c1e5bd16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:06:50.195511 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:50.196140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:50.197676 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1233/2493] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:06:49 2022] DELETE /identity/v3/projects/52f54843034c4bef85a617e4c1e5bd16 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:06:50.201527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aa00c-22b6-4e6c-8d7b-2168fac9cb7f service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:50.211714 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9aa00c-22b6-4e6c-8d7b-2168fac9cb7f service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:50.265626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b1c44-35c5-4be6-8a7a-c27079514f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:50.266471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b1c44-35c5-4be6-8a7a-c27079514f82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:50.266753 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b1c44-35c5-4be6-8a7a-c27079514f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:50.267592 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b1c44-35c5-4be6-8a7a-c27079514f82 admin admin] PATH_INFO: `/v3/users/b56308a976db4e5e8521b83f8b8cb51c` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:50.268819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b1c44-35c5-4be6-8a7a-c27079514f82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b56308a976db4e5e8521b83f8b8cb51c)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:50.270747 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b1c44-35c5-4be6-8a7a-c27079514f82 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:50.419779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-034b1c44-35c5-4be6-8a7a-c27079514f82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b56308a976db4e5e8521b83f8b8cb51c'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:50.420587 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-034b1c44-35c5-4be6-8a7a-c27079514f82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b56308a976db4e5e8521b83f8b8cb51c'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:50.421189 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-034b1c44-35c5-4be6-8a7a-c27079514f82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b56308a976db4e5e8521b83f8b8cb51c'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:50.432998 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-034b1c44-35c5-4be6-8a7a-c27079514f82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b56308a976db4e5e8521b83f8b8cb51c'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:50.440541 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-034b1c44-35c5-4be6-8a7a-c27079514f82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b56308a976db4e5e8521b83f8b8cb51c'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:50.492568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1261/2494] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:06:50 2022] DELETE /identity/v3/users/b56308a976db4e5e8521b83f8b8cb51c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:06:50.929969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:50.931455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:50.946981 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a630865-3569-4aad-91d5-8381d8c0c4ac admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:51.003489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18513e82-ab44-4916-a88f-2f76a89434c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:51.004335 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513e82-ab44-4916-a88f-2f76a89434c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:51.004617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513e82-ab44-4916-a88f-2f76a89434c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:51.004890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18513e82-ab44-4916-a88f-2f76a89434c0 admin admin] PATH_INFO: `/v3/projects/1af4f1930e344fb38606cfd86554e129` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:51.006089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18513e82-ab44-4916-a88f-2f76a89434c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af4f1930e344fb38606cfd86554e129)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:51.008031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18513e82-ab44-4916-a88f-2f76a89434c0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:51.129238 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-18513e82-ab44-4916-a88f-2f76a89434c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af4f1930e344fb38606cfd86554e129', 'request_id': 'req-18513e82-ab44-4916-a88f-2f76a89434c0'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:51.135934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-18513e82-ab44-4916-a88f-2f76a89434c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af4f1930e344fb38606cfd86554e129', 'request_id': 'req-18513e82-ab44-4916-a88f-2f76a89434c0'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:51.142633 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-18513e82-ab44-4916-a88f-2f76a89434c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af4f1930e344fb38606cfd86554e129', 'request_id': 'req-18513e82-ab44-4916-a88f-2f76a89434c0'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:51.207564 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-18513e82-ab44-4916-a88f-2f76a89434c0 admin admin] The token cache is being invalidate because project 1af4f1930e344fb38606cfd86554e129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:06:51.207789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-18513e82-ab44-4916-a88f-2f76a89434c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:51.208393 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-18513e82-ab44-4916-a88f-2f76a89434c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:06:51.209924 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1234/2495] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:06:50 2022] DELETE /identity/v3/projects/1af4f1930e344fb38606cfd86554e129 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:06:51.214867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf27c4f-bb8a-496d-b7d9-855c2c16e2b0 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:51.215744 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf27c4f-bb8a-496d-b7d9-855c2c16e2b0 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:51.215924 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf27c4f-bb8a-496d-b7d9-855c2c16e2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:51.234106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-5bf27c4f-bb8a-496d-b7d9-855c2c16e2b0 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:06:51.235687 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5bf27c4f-bb8a-496d-b7d9-855c2c16e2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:51.294269 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1262/2496] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:06:51.302305 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ae960-46a3-4c5a-a07f-11fc241bd124 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:51.302594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ae960-46a3-4c5a-a07f-11fc241bd124 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:51.302874 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ae960-46a3-4c5a-a07f-11fc241bd124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:51.322212 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-f70ae960-46a3-4c5a-a07f-11fc241bd124 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:06:51.323437 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-f70ae960-46a3-4c5a-a07f-11fc241bd124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:51.332262 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1235/2497] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:06:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:06:51.336323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf27c4f-bb8a-496d-b7d9-855c2c16e2b0 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:51.346615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf27c4f-bb8a-496d-b7d9-855c2c16e2b0 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:51.351107 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7af3fe-da14-4795-8cef-7f2d71ad2471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:51.351769 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7af3fe-da14-4795-8cef-7f2d71ad2471 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:51.352047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7af3fe-da14-4795-8cef-7f2d71ad2471 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:51.352318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7af3fe-da14-4795-8cef-7f2d71ad2471 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:51.353040 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7af3fe-da14-4795-8cef-7f2d71ad2471 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:06:51.353337 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7af3fe-da14-4795-8cef-7f2d71ad2471 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:51.354904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7af3fe-da14-4795-8cef-7f2d71ad2471 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:51.365852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1263/2498] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 05:06:51.369862 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ae960-46a3-4c5a-a07f-11fc241bd124 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:51.378939 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ae960-46a3-4c5a-a07f-11fc241bd124 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:51.383718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879fca9-6a16-4449-8994-a8c16e0ff141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:51.384349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879fca9-6a16-4449-8994-a8c16e0ff141 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:51.384624 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879fca9-6a16-4449-8994-a8c16e0ff141 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:51.384895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9879fca9-6a16-4449-8994-a8c16e0ff141 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:51.385586 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879fca9-6a16-4449-8994-a8c16e0ff141 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:51.387491 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9879fca9-6a16-4449-8994-a8c16e0ff141 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:51.511284 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1236/2499] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:06:51 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:06:51.515220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7af3fe-da14-4795-8cef-7f2d71ad2471 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:51.526291 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7af3fe-da14-4795-8cef-7f2d71ad2471 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:51.581873 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c11193-9a17-430a-a2ba-46eaef00bcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:51.582535 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c11193-9a17-430a-a2ba-46eaef00bcc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:51.582814 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c11193-9a17-430a-a2ba-46eaef00bcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:51.583089 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c11193-9a17-430a-a2ba-46eaef00bcc9 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:51.583824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c11193-9a17-430a-a2ba-46eaef00bcc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:51.594335 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c11193-9a17-430a-a2ba-46eaef00bcc9 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:51.676343 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1264/2500] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:06:51 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:06:51.680525 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879fca9-6a16-4449-8994-a8c16e0ff141 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:51.691199 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9879fca9-6a16-4449-8994-a8c16e0ff141 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:51.695990 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b679246-b021-45a2-b054-6ac5f67b5ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:51.696634 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b679246-b021-45a2-b054-6ac5f67b5ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:51.696912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b679246-b021-45a2-b054-6ac5f67b5ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:51.697333 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b679246-b021-45a2-b054-6ac5f67b5ac9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:51.703456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b679246-b021-45a2-b054-6ac5f67b5ac9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:51.703456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b679246-b021-45a2-b054-6ac5f67b5ac9 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:51.717368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1237/2501] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:06:51.720164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c11193-9a17-430a-a2ba-46eaef00bcc9 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:51.730273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c11193-9a17-430a-a2ba-46eaef00bcc9 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:51.735045 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ba29b-b52f-4b43-8544-3c8d78471b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:51.735750 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ba29b-b52f-4b43-8544-3c8d78471b0a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:51.736031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ba29b-b52f-4b43-8544-3c8d78471b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:51.736335 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ba29b-b52f-4b43-8544-3c8d78471b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:51.737069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ba29b-b52f-4b43-8544-3c8d78471b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:51.738741 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ba29b-b52f-4b43-8544-3c8d78471b0a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:51.748468 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1265/2502] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:06:51.753152 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b679246-b021-45a2-b054-6ac5f67b5ac9 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:51.763178 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b679246-b021-45a2-b054-6ac5f67b5ac9 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:51.768871 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e1e65-cdad-4b73-a30f-2f659dcffb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:51.769733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e1e65-cdad-4b73-a30f-2f659dcffb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:51.770016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e1e65-cdad-4b73-a30f-2f659dcffb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:51.770293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e1e65-cdad-4b73-a30f-2f659dcffb8b admin admin] PATH_INFO: `/v3/projects/a1c0b836ea9c4ad6bd6ccba7aa0891a3/users/3cb9d47037db4281b94a1839a6a41bba/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:51.784674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e1e65-cdad-4b73-a30f-2f659dcffb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1c0b836ea9c4ad6bd6ccba7aa0891a3, user_id=3cb9d47037db4281b94a1839a6a41bba, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:51.787349 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e1e65-cdad-4b73-a30f-2f659dcffb8b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:51.877332 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1238/2503] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:06:51 2022] PUT /identity/v3/projects/a1c0b836ea9c4ad6bd6ccba7aa0891a3/users/3cb9d47037db4281b94a1839a6a41bba/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:06:51.887754 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd2be2-50b6-40f3-bf98-102091a9b560 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:51.887912 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd2be2-50b6-40f3-bf98-102091a9b560 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:51.888150 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fd2be2-50b6-40f3-bf98-102091a9b560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:51.916478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-77fd2be2-50b6-40f3-bf98-102091a9b560 None None] MFA Rules not processed for user `3cb9d47037db4281b94a1839a6a41bba`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:06:51.917678 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-77fd2be2-50b6-40f3-bf98-102091a9b560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:51.982905 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1266/2504] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:06:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:06:51.992929 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e1e65-cdad-4b73-a30f-2f659dcffb8b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:06:51.994616 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-027e1e65-cdad-4b73-a30f-2f659dcffb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:06:52.049863 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e1e65-cdad-4b73-a30f-2f659dcffb8b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:06:52.053417 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b6365-8dda-49b9-a516-4bedf7765019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:06:52.054044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b6365-8dda-49b9-a516-4bedf7765019 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:06:52.054322 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b6365-8dda-49b9-a516-4bedf7765019 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:06:52.054594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b6365-8dda-49b9-a516-4bedf7765019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:06:52.062624 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b6365-8dda-49b9-a516-4bedf7765019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:06:52.064804 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b6365-8dda-49b9-a516-4bedf7765019 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:06:52.074238 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1239/2505] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:06:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:07:04.817095 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd2be2-50b6-40f3-bf98-102091a9b560 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:04.889481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fd2be2-50b6-40f3-bf98-102091a9b560 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:04.894673 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51206d-d24c-4c08-a13d-0dd4a9ada80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:04.895566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51206d-d24c-4c08-a13d-0dd4a9ada80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:04.895841 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51206d-d24c-4c08-a13d-0dd4a9ada80f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:04.896111 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51206d-d24c-4c08-a13d-0dd4a9ada80f admin admin] PATH_INFO: `/v3/users/3cb9d47037db4281b94a1839a6a41bba` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:04.897343 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51206d-d24c-4c08-a13d-0dd4a9ada80f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cb9d47037db4281b94a1839a6a41bba)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:04.899301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51206d-d24c-4c08-a13d-0dd4a9ada80f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:05.045076 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-da51206d-d24c-4c08-a13d-0dd4a9ada80f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cb9d47037db4281b94a1839a6a41bba'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:05.045740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-da51206d-d24c-4c08-a13d-0dd4a9ada80f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cb9d47037db4281b94a1839a6a41bba'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:05.046376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-da51206d-d24c-4c08-a13d-0dd4a9ada80f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cb9d47037db4281b94a1839a6a41bba'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:05.058480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-da51206d-d24c-4c08-a13d-0dd4a9ada80f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cb9d47037db4281b94a1839a6a41bba'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:05.066020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-da51206d-d24c-4c08-a13d-0dd4a9ada80f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cb9d47037db4281b94a1839a6a41bba'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:05.115948 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1267/2506] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:07:04 2022] DELETE /identity/v3/users/3cb9d47037db4281b94a1839a6a41bba => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:07:05.120594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f1d9f-1d7d-44fb-8613-a001d967351b None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:05.121133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f1d9f-1d7d-44fb-8613-a001d967351b None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:05.121324 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f1d9f-1d7d-44fb-8613-a001d967351b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:05.138783 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-b48f1d9f-1d7d-44fb-8613-a001d967351b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:05.140043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b48f1d9f-1d7d-44fb-8613-a001d967351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:05.198666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1240/2507] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:07:05.209480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51206d-d24c-4c08-a13d-0dd4a9ada80f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:05.210890 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-da51206d-d24c-4c08-a13d-0dd4a9ada80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:05.269411 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51206d-d24c-4c08-a13d-0dd4a9ada80f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:05.273100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec26ed-9466-4213-8380-8e7b8b0ebc57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:05.273741 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec26ed-9466-4213-8380-8e7b8b0ebc57 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:05.274073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec26ed-9466-4213-8380-8e7b8b0ebc57 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:05.274390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec26ed-9466-4213-8380-8e7b8b0ebc57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:05.289569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec26ed-9466-4213-8380-8e7b8b0ebc57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:05.291029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec26ed-9466-4213-8380-8e7b8b0ebc57 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:05.301919 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1268/2508] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:07:05.671398 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f1d9f-1d7d-44fb-8613-a001d967351b None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:05.672829 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b48f1d9f-1d7d-44fb-8613-a001d967351b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:05.687435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f1d9f-1d7d-44fb-8613-a001d967351b None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:05.692865 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:05.694768 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:05.695055 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:05.695409 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab admin admin] PATH_INFO: `/v3/projects/a1c0b836ea9c4ad6bd6ccba7aa0891a3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:05.696646 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1c0b836ea9c4ad6bd6ccba7aa0891a3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:05.700229 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:05.802332 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1c0b836ea9c4ad6bd6ccba7aa0891a3', 'request_id': 'req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:05.808423 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1c0b836ea9c4ad6bd6ccba7aa0891a3', 'request_id': 'req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:05.813716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1c0b836ea9c4ad6bd6ccba7aa0891a3', 'request_id': 'req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:05.908186 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab admin admin] The token cache is being invalidate because project a1c0b836ea9c4ad6bd6ccba7aa0891a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:07:05.908493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:05.909071 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e6d2aa36-3d4f-4f0b-9983-32f8db8417ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:05.910637 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1241/2509] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:07:05 2022] DELETE /identity/v3/projects/a1c0b836ea9c4ad6bd6ccba7aa0891a3 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:07:05.915507 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d394ad-ae58-466b-9a67-c2518b8d0b2a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:05.916002 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d394ad-ae58-466b-9a67-c2518b8d0b2a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:05.916135 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d394ad-ae58-466b-9a67-c2518b8d0b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:05.933525 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-f1d394ad-ae58-466b-9a67-c2518b8d0b2a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:05.934745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f1d394ad-ae58-466b-9a67-c2518b8d0b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:05.992785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1269/2510] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:07:06.001193 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840f9cf-67cb-4f46-a27d-7611220cbc8c None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:06.001480 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840f9cf-67cb-4f46-a27d-7611220cbc8c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:06.001758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0840f9cf-67cb-4f46-a27d-7611220cbc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:06.020677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-0840f9cf-67cb-4f46-a27d-7611220cbc8c None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:06.021854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0840f9cf-67cb-4f46-a27d-7611220cbc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:06.029681 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1242/2511] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:07:06.033974 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d394ad-ae58-466b-9a67-c2518b8d0b2a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:06.043528 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d394ad-ae58-466b-9a67-c2518b8d0b2a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:06.048204 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e937ca4-5c3c-4313-b996-0dfe3b2afe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:06.049017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e937ca4-5c3c-4313-b996-0dfe3b2afe8a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:06.049349 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e937ca4-5c3c-4313-b996-0dfe3b2afe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:06.049655 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e937ca4-5c3c-4313-b996-0dfe3b2afe8a admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:06.050418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e937ca4-5c3c-4313-b996-0dfe3b2afe8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:07:06.050722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e937ca4-5c3c-4313-b996-0dfe3b2afe8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:06.052346 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e937ca4-5c3c-4313-b996-0dfe3b2afe8a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:06.063854 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1270/2512] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:07:06.071411 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840f9cf-67cb-4f46-a27d-7611220cbc8c None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:06.081344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0840f9cf-67cb-4f46-a27d-7611220cbc8c None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:06.086050 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66420f-da9b-47b6-acd1-32ac977196fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:06.086692 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66420f-da9b-47b6-acd1-32ac977196fd admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:06.086968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66420f-da9b-47b6-acd1-32ac977196fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:06.087270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66420f-da9b-47b6-acd1-32ac977196fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:06.087983 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66420f-da9b-47b6-acd1-32ac977196fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:06.090106 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66420f-da9b-47b6-acd1-32ac977196fd admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:06.154242 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1243/2513] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:07:06 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:07:06.155394 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e937ca4-5c3c-4313-b996-0dfe3b2afe8a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:06.165485 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e937ca4-5c3c-4313-b996-0dfe3b2afe8a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:06.222375 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5abae-518b-4004-9180-de534cd604e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:06.223031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5abae-518b-4004-9180-de534cd604e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:06.226499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5abae-518b-4004-9180-de534cd604e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:06.226499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5abae-518b-4004-9180-de534cd604e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:06.226499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5abae-518b-4004-9180-de534cd604e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:06.226499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5abae-518b-4004-9180-de534cd604e8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:06.331360 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1271/2514] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:07:06 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:07:06.332555 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66420f-da9b-47b6-acd1-32ac977196fd admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:06.343042 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66420f-da9b-47b6-acd1-32ac977196fd admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:06.348032 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69533f-1904-4ea4-84d3-08348b080df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:06.348688 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69533f-1904-4ea4-84d3-08348b080df3 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:06.348973 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69533f-1904-4ea4-84d3-08348b080df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:06.349255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69533f-1904-4ea4-84d3-08348b080df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:06.349994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69533f-1904-4ea4-84d3-08348b080df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:06.359104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69533f-1904-4ea4-84d3-08348b080df3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:06.366780 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1244/2515] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:07:06.376871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5abae-518b-4004-9180-de534cd604e8 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:06.389997 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5abae-518b-4004-9180-de534cd604e8 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:06.395319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22052769-1de7-4a44-9a60-eab2d238345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:06.396429 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22052769-1de7-4a44-9a60-eab2d238345c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:06.396429 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22052769-1de7-4a44-9a60-eab2d238345c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:06.396687 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22052769-1de7-4a44-9a60-eab2d238345c admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:06.397251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22052769-1de7-4a44-9a60-eab2d238345c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:06.398840 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22052769-1de7-4a44-9a60-eab2d238345c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:06.413009 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1272/2516] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:07:06.414119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69533f-1904-4ea4-84d3-08348b080df3 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:06.424728 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69533f-1904-4ea4-84d3-08348b080df3 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:06.429728 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5355b-47a9-4ef1-b07f-fa87f96f789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:06.430870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5355b-47a9-4ef1-b07f-fa87f96f789a admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:06.431297 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5355b-47a9-4ef1-b07f-fa87f96f789a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:06.431832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5355b-47a9-4ef1-b07f-fa87f96f789a admin admin] PATH_INFO: `/v3/projects/f19549932ee24dad8067091a53090b00/users/bd2931c09478454d83dc5d511dbb1bed/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:06.452171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5355b-47a9-4ef1-b07f-fa87f96f789a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f19549932ee24dad8067091a53090b00, user_id=bd2931c09478454d83dc5d511dbb1bed, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:06.455103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf5355b-47a9-4ef1-b07f-fa87f96f789a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:06.494213 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22052769-1de7-4a44-9a60-eab2d238345c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:06.496292 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-22052769-1de7-4a44-9a60-eab2d238345c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:06.546694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1245/2517] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:07:06 2022] PUT /identity/v3/projects/f19549932ee24dad8067091a53090b00/users/bd2931c09478454d83dc5d511dbb1bed/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:07:06.557567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1472-d423-4646-898c-e3b2d285d95d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:06.557849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1472-d423-4646-898c-e3b2d285d95d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:06.558120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c1472-d423-4646-898c-e3b2d285d95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:06.584255 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-7c3c1472-d423-4646-898c-e3b2d285d95d None None] MFA Rules not processed for user `bd2931c09478454d83dc5d511dbb1bed`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:06.585493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7c3c1472-d423-4646-898c-e3b2d285d95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:06.598255 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22052769-1de7-4a44-9a60-eab2d238345c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:06.650088 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1246/2518] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:07:06.660281 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c1472-d423-4646-898c-e3b2d285d95d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:06.661638 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7c3c1472-d423-4646-898c-e3b2d285d95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:06.663208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bda3f-9246-4a7a-82d7-2599f6777ec0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:06.664030 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bda3f-9246-4a7a-82d7-2599f6777ec0 service placement] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:06.664312 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bda3f-9246-4a7a-82d7-2599f6777ec0 service placement] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:06.664616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bda3f-9246-4a7a-82d7-2599f6777ec0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:06.666328 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-045bda3f-9246-4a7a-82d7-2599f6777ec0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:06.677742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bda3f-9246-4a7a-82d7-2599f6777ec0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:06.679335 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bda3f-9246-4a7a-82d7-2599f6777ec0 service placement] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:06.689102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1273/2519] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:07:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:07:06.719194 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c1472-d423-4646-898c-e3b2d285d95d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:06.722961 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee6056-d48f-47eb-bd24-a88d62aecf3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:06.723677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee6056-d48f-47eb-bd24-a88d62aecf3c service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:06.723957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee6056-d48f-47eb-bd24-a88d62aecf3c service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:06.724362 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee6056-d48f-47eb-bd24-a88d62aecf3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:06.733715 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee6056-d48f-47eb-bd24-a88d62aecf3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:06.734905 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acee6056-d48f-47eb-bd24-a88d62aecf3c service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:06.746971 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1247/2520] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:07:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:07:34.773868 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bda3f-9246-4a7a-82d7-2599f6777ec0 service placement] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:34.832592 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bda3f-9246-4a7a-82d7-2599f6777ec0 service placement] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:34.837036 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fc39f-373e-43b6-bf41-99574fbb0fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:34.837881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fc39f-373e-43b6-bf41-99574fbb0fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:34.838212 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fc39f-373e-43b6-bf41-99574fbb0fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:34.838480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807fc39f-373e-43b6-bf41-99574fbb0fb3 admin admin] PATH_INFO: `/v3/users/bd2931c09478454d83dc5d511dbb1bed` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:34.839957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fc39f-373e-43b6-bf41-99574fbb0fb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd2931c09478454d83dc5d511dbb1bed)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:34.841847 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807fc39f-373e-43b6-bf41-99574fbb0fb3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:35.042614 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-807fc39f-373e-43b6-bf41-99574fbb0fb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd2931c09478454d83dc5d511dbb1bed'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:35.043295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-807fc39f-373e-43b6-bf41-99574fbb0fb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd2931c09478454d83dc5d511dbb1bed'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:35.043904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-807fc39f-373e-43b6-bf41-99574fbb0fb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd2931c09478454d83dc5d511dbb1bed'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:35.055634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-807fc39f-373e-43b6-bf41-99574fbb0fb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd2931c09478454d83dc5d511dbb1bed'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:35.062755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-807fc39f-373e-43b6-bf41-99574fbb0fb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd2931c09478454d83dc5d511dbb1bed'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:35.144021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1274/2521] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:07:34 2022] DELETE /identity/v3/users/bd2931c09478454d83dc5d511dbb1bed => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:07:35.148585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6ce40-6e2c-4a5f-8750-011d119518e8 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:35.149159 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6ce40-6e2c-4a5f-8750-011d119518e8 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:35.149159 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6ce40-6e2c-4a5f-8750-011d119518e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:35.165840 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-cdb6ce40-6e2c-4a5f-8750-011d119518e8 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:35.167025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-cdb6ce40-6e2c-4a5f-8750-011d119518e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:35.226724 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1248/2522] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:07:35.236348 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fc39f-373e-43b6-bf41-99574fbb0fb3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:35.237736 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-807fc39f-373e-43b6-bf41-99574fbb0fb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:35.294925 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807fc39f-373e-43b6-bf41-99574fbb0fb3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:35.298602 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cffbfa-b3c6-4b6f-aa41-001e0107e0dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:35.299250 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cffbfa-b3c6-4b6f-aa41-001e0107e0dd service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:35.300162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cffbfa-b3c6-4b6f-aa41-001e0107e0dd service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:35.300442 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cffbfa-b3c6-4b6f-aa41-001e0107e0dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:35.309447 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cffbfa-b3c6-4b6f-aa41-001e0107e0dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:35.310873 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cffbfa-b3c6-4b6f-aa41-001e0107e0dd service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:35.320158 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1275/2523] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:07:35.728990 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6ce40-6e2c-4a5f-8750-011d119518e8 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:35.732320 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-cdb6ce40-6e2c-4a5f-8750-011d119518e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:35.743215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6ce40-6e2c-4a5f-8750-011d119518e8 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:35.747869 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ad4db-5973-4788-a442-d01a39452b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:35.748712 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ad4db-5973-4788-a442-d01a39452b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:35.748993 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ad4db-5973-4788-a442-d01a39452b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:35.749264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ad4db-5973-4788-a442-d01a39452b22 admin admin] PATH_INFO: `/v3/projects/f19549932ee24dad8067091a53090b00` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:35.750460 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ad4db-5973-4788-a442-d01a39452b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f19549932ee24dad8067091a53090b00)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:35.752396 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ad4db-5973-4788-a442-d01a39452b22 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:35.856976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4b0ad4db-5973-4788-a442-d01a39452b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f19549932ee24dad8067091a53090b00', 'request_id': 'req-4b0ad4db-5973-4788-a442-d01a39452b22'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:35.863185 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4b0ad4db-5973-4788-a442-d01a39452b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f19549932ee24dad8067091a53090b00', 'request_id': 'req-4b0ad4db-5973-4788-a442-d01a39452b22'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:35.868587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4b0ad4db-5973-4788-a442-d01a39452b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f19549932ee24dad8067091a53090b00', 'request_id': 'req-4b0ad4db-5973-4788-a442-d01a39452b22'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:35.954385 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4b0ad4db-5973-4788-a442-d01a39452b22 admin admin] The token cache is being invalidate because project f19549932ee24dad8067091a53090b00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:07:35.954676 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4b0ad4db-5973-4788-a442-d01a39452b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:35.955378 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4b0ad4db-5973-4788-a442-d01a39452b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:35.961205 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1249/2524] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:07:35 2022] DELETE /identity/v3/projects/f19549932ee24dad8067091a53090b00 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:07:35.962498 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf3acc-2ac7-4f91-9a8b-db377142b549 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:35.962974 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf3acc-2ac7-4f91-9a8b-db377142b549 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:35.963110 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bf3acc-2ac7-4f91-9a8b-db377142b549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:35.984060 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c5bf3acc-2ac7-4f91-9a8b-db377142b549 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:35.984060 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c5bf3acc-2ac7-4f91-9a8b-db377142b549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:36.038483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1276/2525] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:07:36.046138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e903-b86f-4007-9c62-9fd1ad8347b3 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:36.046444 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e903-b86f-4007-9c62-9fd1ad8347b3 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:36.046716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750e903-b86f-4007-9c62-9fd1ad8347b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:36.064441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-0750e903-b86f-4007-9c62-9fd1ad8347b3 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:36.066105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0750e903-b86f-4007-9c62-9fd1ad8347b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:36.073890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1250/2526] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:07:36.077770 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf3acc-2ac7-4f91-9a8b-db377142b549 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:36.087566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bf3acc-2ac7-4f91-9a8b-db377142b549 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:36.092316 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04e6ad-dbda-4603-8ad4-0ea122a9bbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:36.092948 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04e6ad-dbda-4603-8ad4-0ea122a9bbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:36.093224 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04e6ad-dbda-4603-8ad4-0ea122a9bbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:36.093520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04e6ad-dbda-4603-8ad4-0ea122a9bbe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:36.094238 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04e6ad-dbda-4603-8ad4-0ea122a9bbe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:07:36.094541 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04e6ad-dbda-4603-8ad4-0ea122a9bbe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:36.096469 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04e6ad-dbda-4603-8ad4-0ea122a9bbe8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:36.111478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1277/2527] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:07:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:07:36.113700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750e903-b86f-4007-9c62-9fd1ad8347b3 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:36.122885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750e903-b86f-4007-9c62-9fd1ad8347b3 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:36.128396 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a7ddc-258c-4341-a555-566a934ea175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:36.129100 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a7ddc-258c-4341-a555-566a934ea175 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:36.129401 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a7ddc-258c-4341-a555-566a934ea175 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:36.129659 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a7ddc-258c-4341-a555-566a934ea175 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:36.130363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a7ddc-258c-4341-a555-566a934ea175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:36.132422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a7ddc-258c-4341-a555-566a934ea175 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:36.293919 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1251/2528] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:07:36 2022] POST /identity/v3/projects => generated 385 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:07:36.298169 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04e6ad-dbda-4603-8ad4-0ea122a9bbe8 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:36.308401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04e6ad-dbda-4603-8ad4-0ea122a9bbe8 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:36.365042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7a9a3-ade7-4be5-bc57-a0b142842b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:36.365628 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7a9a3-ade7-4be5-bc57-a0b142842b4b admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:36.365909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7a9a3-ade7-4be5-bc57-a0b142842b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:36.366181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7a9a3-ade7-4be5-bc57-a0b142842b4b admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:36.366933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7a9a3-ade7-4be5-bc57-a0b142842b4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:36.368958 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a7a9a3-ade7-4be5-bc57-a0b142842b4b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:36.464728 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1278/2529] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:07:36 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:07:36.468894 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a7ddc-258c-4341-a555-566a934ea175 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:36.480055 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a7ddc-258c-4341-a555-566a934ea175 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:36.484746 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d0acf-a4ae-4f49-a18c-2022089de894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:36.485434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d0acf-a4ae-4f49-a18c-2022089de894 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:36.485717 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d0acf-a4ae-4f49-a18c-2022089de894 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:36.485994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d0acf-a4ae-4f49-a18c-2022089de894 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:36.486739 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d0acf-a4ae-4f49-a18c-2022089de894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:36.488907 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d0acf-a4ae-4f49-a18c-2022089de894 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:36.499823 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1252/2530] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:07:36.504647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7a9a3-ade7-4be5-bc57-a0b142842b4b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:36.514520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7a9a3-ade7-4be5-bc57-a0b142842b4b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:36.519665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c8dd5-f421-448d-a752-2c534eb2467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:36.520298 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c8dd5-f421-448d-a752-2c534eb2467c admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:36.520574 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c8dd5-f421-448d-a752-2c534eb2467c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:36.520843 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c8dd5-f421-448d-a752-2c534eb2467c admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:36.521597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c8dd5-f421-448d-a752-2c534eb2467c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:36.523250 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c8dd5-f421-448d-a752-2c534eb2467c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:36.533436 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1279/2531] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:07:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:07:36.537691 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d0acf-a4ae-4f49-a18c-2022089de894 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:36.547500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d0acf-a4ae-4f49-a18c-2022089de894 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:36.552242 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6904f7a-99b3-4ba5-9031-d87cf1d9e6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:36.553097 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6904f7a-99b3-4ba5-9031-d87cf1d9e6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:36.553378 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6904f7a-99b3-4ba5-9031-d87cf1d9e6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:36.553651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6904f7a-99b3-4ba5-9031-d87cf1d9e6ae admin admin] PATH_INFO: `/v3/projects/76e178ab257f42449df0a58131e1070a/users/60d44b319bc749ce93204b0adbb7e1c6/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:36.568442 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6904f7a-99b3-4ba5-9031-d87cf1d9e6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e178ab257f42449df0a58131e1070a, user_id=60d44b319bc749ce93204b0adbb7e1c6, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:36.571319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6904f7a-99b3-4ba5-9031-d87cf1d9e6ae admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:36.681790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1253/2532] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:07:36 2022] PUT /identity/v3/projects/76e178ab257f42449df0a58131e1070a/users/60d44b319bc749ce93204b0adbb7e1c6/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:07:36.737882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af46a87-93f5-43a9-9198-5e09aacf7bcd None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:36.738153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af46a87-93f5-43a9-9198-5e09aacf7bcd None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:36.738429 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af46a87-93f5-43a9-9198-5e09aacf7bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:36.764142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-8af46a87-93f5-43a9-9198-5e09aacf7bcd None None] MFA Rules not processed for user `60d44b319bc749ce93204b0adbb7e1c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:36.765320 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-8af46a87-93f5-43a9-9198-5e09aacf7bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:36.828610 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1280/2533] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:07:36.832963 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6904f7a-99b3-4ba5-9031-d87cf1d9e6ae admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:36.894794 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6904f7a-99b3-4ba5-9031-d87cf1d9e6ae admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:36.899636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d3186-ae5e-46a6-b4ce-452428eff2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:36.900282 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d3186-ae5e-46a6-b4ce-452428eff2ba admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:36.900563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d3186-ae5e-46a6-b4ce-452428eff2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:36.900843 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d3186-ae5e-46a6-b4ce-452428eff2ba admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:36.901550 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d3186-ae5e-46a6-b4ce-452428eff2ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:36.903650 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d3186-ae5e-46a6-b4ce-452428eff2ba admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:37.002370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1254/2534] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:07:36 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:07:37.010326 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af46a87-93f5-43a9-9198-5e09aacf7bcd None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:37.021499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af46a87-93f5-43a9-9198-5e09aacf7bcd None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:37.075787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30b328-aaa5-4f5c-accf-9819404704c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:37.076455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30b328-aaa5-4f5c-accf-9819404704c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:37.076737 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30b328-aaa5-4f5c-accf-9819404704c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:37.077014 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30b328-aaa5-4f5c-accf-9819404704c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:37.077726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30b328-aaa5-4f5c-accf-9819404704c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:37.079737 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30b328-aaa5-4f5c-accf-9819404704c5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:37.172087 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1281/2535] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:07:37 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:07:37.176176 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d3186-ae5e-46a6-b4ce-452428eff2ba admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:37.186394 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d3186-ae5e-46a6-b4ce-452428eff2ba admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:37.191025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63730353-1985-499c-9ba5-feb5649618fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:37.191703 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63730353-1985-499c-9ba5-feb5649618fb admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:37.191988 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63730353-1985-499c-9ba5-feb5649618fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:37.192264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63730353-1985-499c-9ba5-feb5649618fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:37.192996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63730353-1985-499c-9ba5-feb5649618fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:37.194573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63730353-1985-499c-9ba5-feb5649618fb admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:37.204680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1255/2536] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:07:37.209751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30b328-aaa5-4f5c-accf-9819404704c5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:37.219823 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30b328-aaa5-4f5c-accf-9819404704c5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:37.226406 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37086491-ba87-4194-a7b2-a0ea670bb906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:37.227062 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37086491-ba87-4194-a7b2-a0ea670bb906 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:37.227376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37086491-ba87-4194-a7b2-a0ea670bb906 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:37.227650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37086491-ba87-4194-a7b2-a0ea670bb906 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:37.228395 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37086491-ba87-4194-a7b2-a0ea670bb906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:37.229976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37086491-ba87-4194-a7b2-a0ea670bb906 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:37.240305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1282/2537] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:07:37.244384 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63730353-1985-499c-9ba5-feb5649618fb admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:37.254963 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63730353-1985-499c-9ba5-feb5649618fb admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:37.259582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd509ade-2568-41c6-83f1-149dd82ca7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:37.260451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd509ade-2568-41c6-83f1-149dd82ca7ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:37.260720 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd509ade-2568-41c6-83f1-149dd82ca7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:37.260995 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd509ade-2568-41c6-83f1-149dd82ca7ef admin admin] PATH_INFO: `/v3/projects/25080897f58747379c4942925cea7404/users/bbc5303b3ece421fb25f4563b58cc462/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:37.275975 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd509ade-2568-41c6-83f1-149dd82ca7ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=25080897f58747379c4942925cea7404, user_id=bbc5303b3ece421fb25f4563b58cc462, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:37.278707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd509ade-2568-41c6-83f1-149dd82ca7ef admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:37.344115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1256/2538] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:07:37 2022] PUT /identity/v3/projects/25080897f58747379c4942925cea7404/users/bbc5303b3ece421fb25f4563b58cc462/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:07:37.354716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3741bc-d74f-4040-b31f-3fa8213c2bd7 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:37.360405 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3741bc-d74f-4040-b31f-3fa8213c2bd7 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:37.360405 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3741bc-d74f-4040-b31f-3fa8213c2bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:37.382524 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-8f3741bc-d74f-4040-b31f-3fa8213c2bd7 None None] MFA Rules not processed for user `bbc5303b3ece421fb25f4563b58cc462`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:37.383798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-8f3741bc-d74f-4040-b31f-3fa8213c2bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:37.459125 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1283/2539] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:07:37.463257 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd509ade-2568-41c6-83f1-149dd82ca7ef admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:37.525989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd509ade-2568-41c6-83f1-149dd82ca7ef admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:37.530796 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1f0e9-43ea-426f-9bdc-5690493ba308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:37.531496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1f0e9-43ea-426f-9bdc-5690493ba308 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:37.531784 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1f0e9-43ea-426f-9bdc-5690493ba308 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:37.532061 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1f0e9-43ea-426f-9bdc-5690493ba308 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:37.532773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1f0e9-43ea-426f-9bdc-5690493ba308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:37.534722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1f0e9-43ea-426f-9bdc-5690493ba308 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:37.653107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1257/2540] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:07:37 2022] POST /identity/v3/projects => generated 383 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:07:37.657163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3741bc-d74f-4040-b31f-3fa8213c2bd7 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:37.667574 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3741bc-d74f-4040-b31f-3fa8213c2bd7 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:37.721504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fba217-aa02-4236-9d16-ba15024a332e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:37.722137 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fba217-aa02-4236-9d16-ba15024a332e admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:37.722418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fba217-aa02-4236-9d16-ba15024a332e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:37.722689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fba217-aa02-4236-9d16-ba15024a332e admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:37.723417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fba217-aa02-4236-9d16-ba15024a332e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:37.725331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fba217-aa02-4236-9d16-ba15024a332e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:37.847374 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1284/2541] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:07:37 2022] POST /identity/v3/users => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:07:37.851358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1f0e9-43ea-426f-9bdc-5690493ba308 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:37.861395 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1f0e9-43ea-426f-9bdc-5690493ba308 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:37.866532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932909e-a9b8-4c14-926d-36f6b02a6971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:37.867181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932909e-a9b8-4c14-926d-36f6b02a6971 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:37.867498 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932909e-a9b8-4c14-926d-36f6b02a6971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:37.867777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932909e-a9b8-4c14-926d-36f6b02a6971 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:37.868585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932909e-a9b8-4c14-926d-36f6b02a6971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:37.870157 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932909e-a9b8-4c14-926d-36f6b02a6971 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:37.882171 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1258/2542] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:07:37.887987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fba217-aa02-4236-9d16-ba15024a332e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:37.898054 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fba217-aa02-4236-9d16-ba15024a332e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:37.902796 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8979c3-2730-47e4-a898-757f1ed629d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:37.903777 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8979c3-2730-47e4-a898-757f1ed629d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:37.904060 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8979c3-2730-47e4-a898-757f1ed629d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:37.904332 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8979c3-2730-47e4-a898-757f1ed629d8 admin admin] PATH_INFO: `/v3/projects/5ef9f4b7f69e48f69b67fb4c84caa56c/users/e298fb4ae1b34ae6821188769948eb7e/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:37.919813 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8979c3-2730-47e4-a898-757f1ed629d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef9f4b7f69e48f69b67fb4c84caa56c, user_id=e298fb4ae1b34ae6821188769948eb7e, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:37.922422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8979c3-2730-47e4-a898-757f1ed629d8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:37.988365 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1285/2543] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:07:37 2022] PUT /identity/v3/projects/5ef9f4b7f69e48f69b67fb4c84caa56c/users/e298fb4ae1b34ae6821188769948eb7e/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:07:37.992484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932909e-a9b8-4c14-926d-36f6b02a6971 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:38.002312 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932909e-a9b8-4c14-926d-36f6b02a6971 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:38.056860 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8d39c7-b26f-4293-8bdf-598e369a6aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:38.057505 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d39c7-b26f-4293-8bdf-598e369a6aac admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:38.057782 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d39c7-b26f-4293-8bdf-598e369a6aac admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:38.058052 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8d39c7-b26f-4293-8bdf-598e369a6aac admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:38.058775 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d39c7-b26f-4293-8bdf-598e369a6aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:38.060368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8d39c7-b26f-4293-8bdf-598e369a6aac admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:38.069850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1259/2544] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:07:38.074049 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8979c3-2730-47e4-a898-757f1ed629d8 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:38.084280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8979c3-2730-47e4-a898-757f1ed629d8 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:38.089131 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7eedd-d334-4170-8b27-d3e6380ea0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:38.089991 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7eedd-d334-4170-8b27-d3e6380ea0fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:38.090265 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7eedd-d334-4170-8b27-d3e6380ea0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:38.090534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce7eedd-d334-4170-8b27-d3e6380ea0fa admin admin] PATH_INFO: `/v3/projects/5ef9f4b7f69e48f69b67fb4c84caa56c/users/e298fb4ae1b34ae6821188769948eb7e/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:38.092478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7eedd-d334-4170-8b27-d3e6380ea0fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef9f4b7f69e48f69b67fb4c84caa56c, user_id=e298fb4ae1b34ae6821188769948eb7e, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:38.095213 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce7eedd-d334-4170-8b27-d3e6380ea0fa admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:38.105712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1286/2545] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:07:38 2022] PUT /identity/v3/projects/5ef9f4b7f69e48f69b67fb4c84caa56c/users/e298fb4ae1b34ae6821188769948eb7e/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:07:38.117526 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb3b88-79d6-48cc-a655-9e2a5f2aa1d9 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:38.117900 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb3b88-79d6-48cc-a655-9e2a5f2aa1d9 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:38.118182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb3b88-79d6-48cc-a655-9e2a5f2aa1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:38.144745 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-c1fb3b88-79d6-48cc-a655-9e2a5f2aa1d9 None None] MFA Rules not processed for user `e298fb4ae1b34ae6821188769948eb7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:38.145935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c1fb3b88-79d6-48cc-a655-9e2a5f2aa1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:38.212129 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1260/2546] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:07:38.222469 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7eedd-d334-4170-8b27-d3e6380ea0fa admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:38.224136 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-6ce7eedd-d334-4170-8b27-d3e6380ea0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:38.288754 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce7eedd-d334-4170-8b27-d3e6380ea0fa admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:38.292441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cde7ad-c3dc-40f6-85c9-2beb8d59b9f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:38.293073 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cde7ad-c3dc-40f6-85c9-2beb8d59b9f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:38.293352 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cde7ad-c3dc-40f6-85c9-2beb8d59b9f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:38.293624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cde7ad-c3dc-40f6-85c9-2beb8d59b9f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:38.347983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cde7ad-c3dc-40f6-85c9-2beb8d59b9f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:38.349400 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cde7ad-c3dc-40f6-85c9-2beb8d59b9f9 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:38.357987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1287/2547] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:07:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:07:40.298915 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb3b88-79d6-48cc-a655-9e2a5f2aa1d9 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:40.308989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb3b88-79d6-48cc-a655-9e2a5f2aa1d9 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:40.312560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423eef7-b1c7-4bf4-b8bf-ba46b37a7492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:40.313185 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423eef7-b1c7-4bf4-b8bf-ba46b37a7492 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:40.313459 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423eef7-b1c7-4bf4-b8bf-ba46b37a7492 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:40.313765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423eef7-b1c7-4bf4-b8bf-ba46b37a7492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:40.368996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423eef7-b1c7-4bf4-b8bf-ba46b37a7492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:40.370405 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423eef7-b1c7-4bf4-b8bf-ba46b37a7492 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:40.379135 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1261/2548] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:07:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:07:41.583544 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cde7ad-c3dc-40f6-85c9-2beb8d59b9f9 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:41.592409 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cde7ad-c3dc-40f6-85c9-2beb8d59b9f9 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:41.597853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469b48b-ee14-4e7d-9373-efd4ab994fb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:41.598923 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469b48b-ee14-4e7d-9373-efd4ab994fb1 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:41.599458 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469b48b-ee14-4e7d-9373-efd4ab994fb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:41.599781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469b48b-ee14-4e7d-9373-efd4ab994fb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:41.609049 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469b48b-ee14-4e7d-9373-efd4ab994fb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:41.610465 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469b48b-ee14-4e7d-9373-efd4ab994fb1 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:41.620461 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1288/2549] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:07:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:07:45.998046 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423eef7-b1c7-4bf4-b8bf-ba46b37a7492 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:45.999453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-4423eef7-b1c7-4bf4-b8bf-ba46b37a7492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:46.055806 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423eef7-b1c7-4bf4-b8bf-ba46b37a7492 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:46.059367 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d90d393-f101-4ee2-bae2-454c4e55d9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:46.059993 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90d393-f101-4ee2-bae2-454c4e55d9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:46.060296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90d393-f101-4ee2-bae2-454c4e55d9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:46.060567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d90d393-f101-4ee2-bae2-454c4e55d9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:46.062315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2d90d393-f101-4ee2-bae2-454c4e55d9e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:46.123446 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90d393-f101-4ee2-bae2-454c4e55d9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:46.124878 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d90d393-f101-4ee2-bae2-454c4e55d9e2 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:46.135097 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1262/2550] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:07:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:07:46.255903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469b48b-ee14-4e7d-9373-efd4ab994fb1 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:46.266303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469b48b-ee14-4e7d-9373-efd4ab994fb1 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:46.271032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e5411-cbe4-4ee4-85fd-5459d71eddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:46.272005 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e5411-cbe4-4ee4-85fd-5459d71eddc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:46.272390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e5411-cbe4-4ee4-85fd-5459d71eddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:46.272732 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459e5411-cbe4-4ee4-85fd-5459d71eddc5 admin admin] PATH_INFO: `/v3/users/60d44b319bc749ce93204b0adbb7e1c6` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:46.274044 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e5411-cbe4-4ee4-85fd-5459d71eddc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d44b319bc749ce93204b0adbb7e1c6)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:46.280044 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459e5411-cbe4-4ee4-85fd-5459d71eddc5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:46.422380 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-459e5411-cbe4-4ee4-85fd-5459d71eddc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d44b319bc749ce93204b0adbb7e1c6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:46.422910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-459e5411-cbe4-4ee4-85fd-5459d71eddc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d44b319bc749ce93204b0adbb7e1c6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:46.423614 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-459e5411-cbe4-4ee4-85fd-5459d71eddc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d44b319bc749ce93204b0adbb7e1c6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:46.437119 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-459e5411-cbe4-4ee4-85fd-5459d71eddc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d44b319bc749ce93204b0adbb7e1c6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:46.443999 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-459e5411-cbe4-4ee4-85fd-5459d71eddc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d44b319bc749ce93204b0adbb7e1c6'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:46.509490 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1289/2551] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:07:46 2022] DELETE /identity/v3/users/60d44b319bc749ce93204b0adbb7e1c6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:07:46.513905 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1f6a5-df8b-4c96-8c50-08777239c8db None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:46.514192 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1f6a5-df8b-4c96-8c50-08777239c8db None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:46.514467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1f6a5-df8b-4c96-8c50-08777239c8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:46.531777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-97e1f6a5-df8b-4c96-8c50-08777239c8db None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:46.533073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-97e1f6a5-df8b-4c96-8c50-08777239c8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:46.594220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1263/2552] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:07:46.608969 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e5411-cbe4-4ee4-85fd-5459d71eddc5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:46.610399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-459e5411-cbe4-4ee4-85fd-5459d71eddc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:46.668466 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459e5411-cbe4-4ee4-85fd-5459d71eddc5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:46.672163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fa672-ff3e-4a44-896b-fefed0adc09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:46.672877 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fa672-ff3e-4a44-896b-fefed0adc09b service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:46.673159 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fa672-ff3e-4a44-896b-fefed0adc09b service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:46.673542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fa672-ff3e-4a44-896b-fefed0adc09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:46.682799 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fa672-ff3e-4a44-896b-fefed0adc09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:46.684257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fa672-ff3e-4a44-896b-fefed0adc09b service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:46.693857 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1290/2553] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:07:46.760094 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1f6a5-df8b-4c96-8c50-08777239c8db None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:46.761500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-97e1f6a5-df8b-4c96-8c50-08777239c8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:46.780622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1f6a5-df8b-4c96-8c50-08777239c8db None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:46.784247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87568cbf-9d79-497b-89b0-863dec17a54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:46.785059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87568cbf-9d79-497b-89b0-863dec17a54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:46.785333 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87568cbf-9d79-497b-89b0-863dec17a54e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:46.785600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87568cbf-9d79-497b-89b0-863dec17a54e admin admin] PATH_INFO: `/v3/users/9d263d17f5844d95a75a9b0ba4fb2455` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:46.787622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87568cbf-9d79-497b-89b0-863dec17a54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d263d17f5844d95a75a9b0ba4fb2455)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:46.789584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87568cbf-9d79-497b-89b0-863dec17a54e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:46.985454 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-87568cbf-9d79-497b-89b0-863dec17a54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d263d17f5844d95a75a9b0ba4fb2455'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:46.986675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-87568cbf-9d79-497b-89b0-863dec17a54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d263d17f5844d95a75a9b0ba4fb2455'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:46.987342 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-87568cbf-9d79-497b-89b0-863dec17a54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d263d17f5844d95a75a9b0ba4fb2455'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:46.999583 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-87568cbf-9d79-497b-89b0-863dec17a54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d263d17f5844d95a75a9b0ba4fb2455'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.007036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-87568cbf-9d79-497b-89b0-863dec17a54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d263d17f5844d95a75a9b0ba4fb2455'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.095111 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1264/2554] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:07:46 2022] DELETE /identity/v3/users/9d263d17f5844d95a75a9b0ba4fb2455 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:07:47.122817 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fa672-ff3e-4a44-896b-fefed0adc09b service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:47.124417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-6f7fa672-ff3e-4a44-896b-fefed0adc09b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:47.138597 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fa672-ff3e-4a44-896b-fefed0adc09b service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:47.204849 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:47.205700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:47.205975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:47.206247 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] PATH_INFO: `/v3/projects/76e178ab257f42449df0a58131e1070a` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:47.207473 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e178ab257f42449df0a58131e1070a)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:47.210139 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:47.307708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e178ab257f42449df0a58131e1070a', 'request_id': 'req-ee063145-bb5d-4b76-90ae-6e863f181f11'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.372478 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87568cbf-9d79-497b-89b0-863dec17a54e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:47.373875 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-87568cbf-9d79-497b-89b0-863dec17a54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:47.387779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e178ab257f42449df0a58131e1070a', 'request_id': 'req-ee063145-bb5d-4b76-90ae-6e863f181f11'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.391721 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87568cbf-9d79-497b-89b0-863dec17a54e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:47.394082 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e178ab257f42449df0a58131e1070a', 'request_id': 'req-ee063145-bb5d-4b76-90ae-6e863f181f11'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.407482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] The token cache is being invalidate because project 76e178ab257f42449df0a58131e1070a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:07:47.407851 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.408501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.410129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1291/2555] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:07:47 2022] DELETE /identity/v3/projects/76e178ab257f42449df0a58131e1070a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:07:47.414115 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:47.415445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:47.456206 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d53c01-6a90-4180-9a8c-d22674fef43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:47.457217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d53c01-6a90-4180-9a8c-d22674fef43b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:47.457648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d53c01-6a90-4180-9a8c-d22674fef43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:47.458023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d53c01-6a90-4180-9a8c-d22674fef43b admin admin] PATH_INFO: `/v3/projects/2bf65f62690f4c2ea3daf79e1021e475` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:47.459345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d53c01-6a90-4180-9a8c-d22674fef43b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bf65f62690f4c2ea3daf79e1021e475)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:47.461290 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d53c01-6a90-4180-9a8c-d22674fef43b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:47.477746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee063145-bb5d-4b76-90ae-6e863f181f11 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:47.482412 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701818d4-69db-404b-ab3a-5583dad59e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:47.483301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701818d4-69db-404b-ab3a-5583dad59e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:47.483584 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701818d4-69db-404b-ab3a-5583dad59e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:47.483860 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701818d4-69db-404b-ab3a-5583dad59e4e admin admin] PATH_INFO: `/v3/users/bbc5303b3ece421fb25f4563b58cc462` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:47.485075 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701818d4-69db-404b-ab3a-5583dad59e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbc5303b3ece421fb25f4563b58cc462)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:47.486975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701818d4-69db-404b-ab3a-5583dad59e4e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:47.595406 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-90d53c01-6a90-4180-9a8c-d22674fef43b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bf65f62690f4c2ea3daf79e1021e475', 'request_id': 'req-90d53c01-6a90-4180-9a8c-d22674fef43b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.601551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-90d53c01-6a90-4180-9a8c-d22674fef43b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bf65f62690f4c2ea3daf79e1021e475', 'request_id': 'req-90d53c01-6a90-4180-9a8c-d22674fef43b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.606737 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-90d53c01-6a90-4180-9a8c-d22674fef43b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bf65f62690f4c2ea3daf79e1021e475', 'request_id': 'req-90d53c01-6a90-4180-9a8c-d22674fef43b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.685393 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-90d53c01-6a90-4180-9a8c-d22674fef43b admin admin] The token cache is being invalidate because project 2bf65f62690f4c2ea3daf79e1021e475 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:07:47.685692 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-90d53c01-6a90-4180-9a8c-d22674fef43b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.686298 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-90d53c01-6a90-4180-9a8c-d22674fef43b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.687567 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-701818d4-69db-404b-ab3a-5583dad59e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbc5303b3ece421fb25f4563b58cc462'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.687913 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1265/2556] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:07:47 2022] DELETE /identity/v3/projects/2bf65f62690f4c2ea3daf79e1021e475 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:07:47.691431 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-701818d4-69db-404b-ab3a-5583dad59e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbc5303b3ece421fb25f4563b58cc462'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.692247 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-701818d4-69db-404b-ab3a-5583dad59e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbc5303b3ece421fb25f4563b58cc462'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.692460 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce4e56-adff-4582-a899-965b4cb16258 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:47.692747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce4e56-adff-4582-a899-965b4cb16258 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:47.693024 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce4e56-adff-4582-a899-965b4cb16258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:47.704695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-701818d4-69db-404b-ab3a-5583dad59e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbc5303b3ece421fb25f4563b58cc462'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.710825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-5cce4e56-adff-4582-a899-965b4cb16258 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:47.711533 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-701818d4-69db-404b-ab3a-5583dad59e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbc5303b3ece421fb25f4563b58cc462'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:47.712118 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-5cce4e56-adff-4582-a899-965b4cb16258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:47.769298 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1266/2557] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:07:47.777029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5ff95-8a7c-4198-aaf4-9642261fecc5 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:47.777322 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5ff95-8a7c-4198-aaf4-9642261fecc5 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:47.777601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5ff95-8a7c-4198-aaf4-9642261fecc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:47.794649 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1292/2558] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:07:47 2022] DELETE /identity/v3/users/bbc5303b3ece421fb25f4563b58cc462 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:07:47.797782 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-96f5ff95-8a7c-4198-aaf4-9642261fecc5 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:47.797782 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-96f5ff95-8a7c-4198-aaf4-9642261fecc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:47.856304 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1267/2559] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:07:47.860469 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701818d4-69db-404b-ab3a-5583dad59e4e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:47.870859 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701818d4-69db-404b-ab3a-5583dad59e4e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:47.878388 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f228d-1341-4bec-8a96-d3190c65628a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:47.878388 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f228d-1341-4bec-8a96-d3190c65628a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:47.878388 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f228d-1341-4bec-8a96-d3190c65628a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:47.878388 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f228d-1341-4bec-8a96-d3190c65628a admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:47.878831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f228d-1341-4bec-8a96-d3190c65628a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:07:47.878831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f228d-1341-4bec-8a96-d3190c65628a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:47.879463 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f228d-1341-4bec-8a96-d3190c65628a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:47.891368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1293/2560] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:07:47.895563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5ff95-8a7c-4198-aaf4-9642261fecc5 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:47.904532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5ff95-8a7c-4198-aaf4-9642261fecc5 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:47.909401 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55239b67-6136-484d-852e-4da55de16cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:47.910045 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55239b67-6136-484d-852e-4da55de16cf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:47.910329 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55239b67-6136-484d-852e-4da55de16cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:47.910609 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55239b67-6136-484d-852e-4da55de16cf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:47.912119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55239b67-6136-484d-852e-4da55de16cf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:47.914147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55239b67-6136-484d-852e-4da55de16cf4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:47.991643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1268/2561] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:07:47 2022] POST /identity/v3/projects => generated 397 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:07:47.995854 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f228d-1341-4bec-8a96-d3190c65628a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:48.018957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f228d-1341-4bec-8a96-d3190c65628a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:48.075790 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893cf32-203c-4cfd-8dfc-d9c6fd67d136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:48.076456 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893cf32-203c-4cfd-8dfc-d9c6fd67d136 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:48.076741 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893cf32-203c-4cfd-8dfc-d9c6fd67d136 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:48.077019 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893cf32-203c-4cfd-8dfc-d9c6fd67d136 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:48.077736 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893cf32-203c-4cfd-8dfc-d9c6fd67d136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:48.079671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893cf32-203c-4cfd-8dfc-d9c6fd67d136 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:48.187387 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1294/2562] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:07:47 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:07:48.189615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55239b67-6136-484d-852e-4da55de16cf4 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:48.199492 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55239b67-6136-484d-852e-4da55de16cf4 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:48.204027 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a8b81-4f40-43f3-905a-476173a3c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:48.204670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a8b81-4f40-43f3-905a-476173a3c555 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:48.204948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a8b81-4f40-43f3-905a-476173a3c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:48.205220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a8b81-4f40-43f3-905a-476173a3c555 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:48.205951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a8b81-4f40-43f3-905a-476173a3c555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:48.207555 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a8b81-4f40-43f3-905a-476173a3c555 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:48.215900 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893cf32-203c-4cfd-8dfc-d9c6fd67d136 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:48.218322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e893cf32-203c-4cfd-8dfc-d9c6fd67d136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:48.220044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1269/2563] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:07:48.224109 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a8b81-4f40-43f3-905a-476173a3c555 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:48.235656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a8b81-4f40-43f3-905a-476173a3c555 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:48.238593 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893cf32-203c-4cfd-8dfc-d9c6fd67d136 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:48.241325 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c856f71-d172-468c-9295-c80d1a8aeb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:48.242344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c856f71-d172-468c-9295-c80d1a8aeb0f admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:48.242593 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c856f71-d172-468c-9295-c80d1a8aeb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:48.242885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c856f71-d172-468c-9295-c80d1a8aeb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:48.243675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c856f71-d172-468c-9295-c80d1a8aeb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:48.244968 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:48.245260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c856f71-d172-468c-9295-c80d1a8aeb0f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:48.245958 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:48.246309 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:48.246783 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] PATH_INFO: `/v3/projects/25080897f58747379c4942925cea7404` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:48.248212 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25080897f58747379c4942925cea7404)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:48.250678 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:48.255738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1270/2564] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:07:48.260676 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c856f71-d172-468c-9295-c80d1a8aeb0f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:48.270291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c856f71-d172-468c-9295-c80d1a8aeb0f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:48.275078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d406-0dcb-4555-9b68-e31f4be29515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:48.275981 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d406-0dcb-4555-9b68-e31f4be29515 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:48.276294 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d406-0dcb-4555-9b68-e31f4be29515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:48.276936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d406-0dcb-4555-9b68-e31f4be29515 admin admin] PATH_INFO: `/v3/projects/9e53c2ff20cf4523a44ec304ec9cb6fa/users/03c8e4230ac84edba24d32b394489bfe/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:48.292022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304d406-0dcb-4555-9b68-e31f4be29515 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e53c2ff20cf4523a44ec304ec9cb6fa, user_id=03c8e4230ac84edba24d32b394489bfe, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:48.294676 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304d406-0dcb-4555-9b68-e31f4be29515 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:48.405070 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1271/2565] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:07:48 2022] PUT /identity/v3/projects/9e53c2ff20cf4523a44ec304ec9cb6fa/users/03c8e4230ac84edba24d32b394489bfe/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:07:48.412902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25080897f58747379c4942925cea7404', 'request_id': 'req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:48.415930 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2bb73-060a-4a4e-b62a-5c05bc5f2fd9 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:48.416851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2bb73-060a-4a4e-b62a-5c05bc5f2fd9 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:48.417132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2bb73-060a-4a4e-b62a-5c05bc5f2fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:48.443185 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-98e2bb73-060a-4a4e-b62a-5c05bc5f2fd9 None None] MFA Rules not processed for user `03c8e4230ac84edba24d32b394489bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:48.444590 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-98e2bb73-060a-4a4e-b62a-5c05bc5f2fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:48.484498 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25080897f58747379c4942925cea7404', 'request_id': 'req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:48.490620 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25080897f58747379c4942925cea7404', 'request_id': 'req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:48.503366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] The token cache is being invalidate because project 25080897f58747379c4942925cea7404 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:07:48.503659 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:48.504309 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:48.506052 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1295/2566] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:07:48 2022] DELETE /identity/v3/projects/25080897f58747379c4942925cea7404 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:07:48.508780 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1272/2567] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:07:48.513682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:48.515047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:48.519146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2bb73-060a-4a4e-b62a-5c05bc5f2fd9 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:48.520501 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-98e2bb73-060a-4a4e-b62a-5c05bc5f2fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:48.575760 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2bb73-060a-4a4e-b62a-5c05bc5f2fd9 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:48.578891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c94b4-f5d4-4c47-9c84-18c56a786bb7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:48.579652 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538564c1-41af-4d08-ae04-08de5e9f4de8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:48.580335 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538564c1-41af-4d08-ae04-08de5e9f4de8 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:48.580594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538564c1-41af-4d08-ae04-08de5e9f4de8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:48.580976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538564c1-41af-4d08-ae04-08de5e9f4de8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:48.582729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-538564c1-41af-4d08-ae04-08de5e9f4de8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:48.583697 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158a1b1-ed20-4e73-a181-267e8018f040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:48.584596 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158a1b1-ed20-4e73-a181-267e8018f040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:48.584879 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158a1b1-ed20-4e73-a181-267e8018f040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:48.585153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158a1b1-ed20-4e73-a181-267e8018f040 admin admin] PATH_INFO: `/v3/users/e298fb4ae1b34ae6821188769948eb7e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:48.586369 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158a1b1-ed20-4e73-a181-267e8018f040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e298fb4ae1b34ae6821188769948eb7e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:48.588319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158a1b1-ed20-4e73-a181-267e8018f040 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:48.594010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538564c1-41af-4d08-ae04-08de5e9f4de8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:48.595477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538564c1-41af-4d08-ae04-08de5e9f4de8 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:48.604677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1273/2568] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:07:48 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:07:48.806842 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8158a1b1-ed20-4e73-a181-267e8018f040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e298fb4ae1b34ae6821188769948eb7e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:48.807517 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8158a1b1-ed20-4e73-a181-267e8018f040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e298fb4ae1b34ae6821188769948eb7e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:48.809803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8158a1b1-ed20-4e73-a181-267e8018f040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e298fb4ae1b34ae6821188769948eb7e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:48.820104 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8158a1b1-ed20-4e73-a181-267e8018f040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e298fb4ae1b34ae6821188769948eb7e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:48.827010 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8158a1b1-ed20-4e73-a181-267e8018f040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e298fb4ae1b34ae6821188769948eb7e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:48.920970 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1296/2569] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:07:48 2022] DELETE /identity/v3/users/e298fb4ae1b34ae6821188769948eb7e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:07:49.311990 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538564c1-41af-4d08-ae04-08de5e9f4de8 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:49.323654 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538564c1-41af-4d08-ae04-08de5e9f4de8 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:49.383825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3caf4-a179-40d3-8a03-49a731da5bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:49.384673 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3caf4-a179-40d3-8a03-49a731da5bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:49.384951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3caf4-a179-40d3-8a03-49a731da5bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:49.385223 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3caf4-a179-40d3-8a03-49a731da5bb8 admin admin] PATH_INFO: `/v3/projects/5ef9f4b7f69e48f69b67fb4c84caa56c` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:49.386410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3caf4-a179-40d3-8a03-49a731da5bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ef9f4b7f69e48f69b67fb4c84caa56c)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:49.388402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3caf4-a179-40d3-8a03-49a731da5bb8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:49.527151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-fca3caf4-a179-40d3-8a03-49a731da5bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ef9f4b7f69e48f69b67fb4c84caa56c', 'request_id': 'req-fca3caf4-a179-40d3-8a03-49a731da5bb8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:49.533197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-fca3caf4-a179-40d3-8a03-49a731da5bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ef9f4b7f69e48f69b67fb4c84caa56c', 'request_id': 'req-fca3caf4-a179-40d3-8a03-49a731da5bb8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:49.539384 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-fca3caf4-a179-40d3-8a03-49a731da5bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ef9f4b7f69e48f69b67fb4c84caa56c', 'request_id': 'req-fca3caf4-a179-40d3-8a03-49a731da5bb8'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:49.621847 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-fca3caf4-a179-40d3-8a03-49a731da5bb8 admin admin] The token cache is being invalidate because project 5ef9f4b7f69e48f69b67fb4c84caa56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:07:49.622154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-fca3caf4-a179-40d3-8a03-49a731da5bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:49.622773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-fca3caf4-a179-40d3-8a03-49a731da5bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:49.624387 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1274/2570] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:07:49 2022] DELETE /identity/v3/projects/5ef9f4b7f69e48f69b67fb4c84caa56c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:07:49.629423 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2fc12-c8fb-4341-b41b-700c603846c2 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:49.629933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2fc12-c8fb-4341-b41b-700c603846c2 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:49.630041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b2fc12-c8fb-4341-b41b-700c603846c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:49.647780 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-45b2fc12-c8fb-4341-b41b-700c603846c2 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:49.648993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-45b2fc12-c8fb-4341-b41b-700c603846c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:49.705874 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1297/2571] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:07:49.714501 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32798b-5100-4545-b626-7844c668cdc5 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:49.714793 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32798b-5100-4545-b626-7844c668cdc5 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:49.715072 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32798b-5100-4545-b626-7844c668cdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:49.733809 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-3b32798b-5100-4545-b626-7844c668cdc5 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:49.735004 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-3b32798b-5100-4545-b626-7844c668cdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:49.743193 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1275/2572] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:07:49.747246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2fc12-c8fb-4341-b41b-700c603846c2 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:49.756782 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b2fc12-c8fb-4341-b41b-700c603846c2 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:49.761385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a213f2-1989-480f-8ee8-0f3c5f6dd95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:49.762019 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a213f2-1989-480f-8ee8-0f3c5f6dd95a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:49.762303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a213f2-1989-480f-8ee8-0f3c5f6dd95a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:49.762573 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a213f2-1989-480f-8ee8-0f3c5f6dd95a admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:49.763325 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a213f2-1989-480f-8ee8-0f3c5f6dd95a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:07:49.763627 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a213f2-1989-480f-8ee8-0f3c5f6dd95a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:49.765270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a213f2-1989-480f-8ee8-0f3c5f6dd95a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:49.777350 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1298/2573] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:07:49.781328 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32798b-5100-4545-b626-7844c668cdc5 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:49.791455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32798b-5100-4545-b626-7844c668cdc5 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:49.796368 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a1c9f-6529-4fe3-bf4d-6214277d4554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:49.797007 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a1c9f-6529-4fe3-bf4d-6214277d4554 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:49.797289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a1c9f-6529-4fe3-bf4d-6214277d4554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:49.797565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a1c9f-6529-4fe3-bf4d-6214277d4554 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:49.798274 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a1c9f-6529-4fe3-bf4d-6214277d4554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:49.800189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a1c9f-6529-4fe3-bf4d-6214277d4554 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:49.899553 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1276/2574] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:07:49 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:07:49.903533 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a213f2-1989-480f-8ee8-0f3c5f6dd95a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:49.913552 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a213f2-1989-480f-8ee8-0f3c5f6dd95a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:49.967091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b0f2-7778-441f-9b8f-090c75f88496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:49.967812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b0f2-7778-441f-9b8f-090c75f88496 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:49.968097 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b0f2-7778-441f-9b8f-090c75f88496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:49.968370 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285b0f2-7778-441f-9b8f-090c75f88496 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:49.969084 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285b0f2-7778-441f-9b8f-090c75f88496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:49.971018 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285b0f2-7778-441f-9b8f-090c75f88496 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:50.075283 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1299/2575] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:07:49 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:07:50.079198 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a1c9f-6529-4fe3-bf4d-6214277d4554 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:50.090626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a1c9f-6529-4fe3-bf4d-6214277d4554 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:50.095416 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c202d08-8e25-4943-ab8a-d4871a543508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:50.096139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c202d08-8e25-4943-ab8a-d4871a543508 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:50.096427 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c202d08-8e25-4943-ab8a-d4871a543508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:50.096707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c202d08-8e25-4943-ab8a-d4871a543508 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:50.097451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c202d08-8e25-4943-ab8a-d4871a543508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:50.099037 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c202d08-8e25-4943-ab8a-d4871a543508 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:50.109671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1277/2576] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:07:50.113614 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b0f2-7778-441f-9b8f-090c75f88496 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:50.123535 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285b0f2-7778-441f-9b8f-090c75f88496 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:50.128241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58594185-91e1-4516-a705-eebb89530a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:50.128887 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58594185-91e1-4516-a705-eebb89530a42 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:50.129170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58594185-91e1-4516-a705-eebb89530a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:50.129444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58594185-91e1-4516-a705-eebb89530a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:50.130177 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58594185-91e1-4516-a705-eebb89530a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:50.132338 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58594185-91e1-4516-a705-eebb89530a42 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:50.141896 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1300/2577] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:07:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:07:50.145926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c202d08-8e25-4943-ab8a-d4871a543508 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:50.156579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c202d08-8e25-4943-ab8a-d4871a543508 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:50.161411 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f78686-08a2-4c42-848f-5b7b6e8d34d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:50.162387 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f78686-08a2-4c42-848f-5b7b6e8d34d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:50.162706 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f78686-08a2-4c42-848f-5b7b6e8d34d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:50.163000 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f78686-08a2-4c42-848f-5b7b6e8d34d7 admin admin] PATH_INFO: `/v3/projects/fc148aa31dac470990a5172b5fca6256/users/6c93c65ee4e24efc82d26e66d18b63cb/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:50.177104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f78686-08a2-4c42-848f-5b7b6e8d34d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc148aa31dac470990a5172b5fca6256, user_id=6c93c65ee4e24efc82d26e66d18b63cb, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:50.180148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f78686-08a2-4c42-848f-5b7b6e8d34d7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:50.298962 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1278/2578] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:07:50 2022] PUT /identity/v3/projects/fc148aa31dac470990a5172b5fca6256/users/6c93c65ee4e24efc82d26e66d18b63cb/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:07:50.304920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420495d0-bb96-4af3-a12a-220840ec3898 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:50.305208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420495d0-bb96-4af3-a12a-220840ec3898 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:50.307727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420495d0-bb96-4af3-a12a-220840ec3898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:50.333588 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-420495d0-bb96-4af3-a12a-220840ec3898 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:50.335058 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-420495d0-bb96-4af3-a12a-220840ec3898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:50.393026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1301/2579] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:07:50.402521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f78686-08a2-4c42-848f-5b7b6e8d34d7 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:50.404288 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d0f78686-08a2-4c42-848f-5b7b6e8d34d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:50.461429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f78686-08a2-4c42-848f-5b7b6e8d34d7 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:50.465288 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174a8ee-750b-4ae1-a33e-0737e4dc107d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:50.465922 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174a8ee-750b-4ae1-a33e-0737e4dc107d service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:50.466200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174a8ee-750b-4ae1-a33e-0737e4dc107d service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:50.466473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174a8ee-750b-4ae1-a33e-0737e4dc107d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:50.475673 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174a8ee-750b-4ae1-a33e-0737e4dc107d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:50.477080 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174a8ee-750b-4ae1-a33e-0737e4dc107d service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:50.486847 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1279/2580] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:07:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:07:51.645075 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c2465-2308-4a71-b946-9e84b0584f59 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:51.645591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c2465-2308-4a71-b946-9e84b0584f59 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:51.645715 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c2465-2308-4a71-b946-9e84b0584f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:51.673930 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c34c2465-2308-4a71-b946-9e84b0584f59 None None] MFA Rules not processed for user `6c93c65ee4e24efc82d26e66d18b63cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:51.675177 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c34c2465-2308-4a71-b946-9e84b0584f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:51.740349 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1302/2581] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:07:51.757259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174a8ee-750b-4ae1-a33e-0737e4dc107d service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:51.758760 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d174a8ee-750b-4ae1-a33e-0737e4dc107d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:51.814435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174a8ee-750b-4ae1-a33e-0737e4dc107d service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:51.818057 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f232c03-c1b1-4654-9bc7-aa3db5551b21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:51.818783 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f232c03-c1b1-4654-9bc7-aa3db5551b21 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:51.819289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f232c03-c1b1-4654-9bc7-aa3db5551b21 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:51.819578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f232c03-c1b1-4654-9bc7-aa3db5551b21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:51.827661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f232c03-c1b1-4654-9bc7-aa3db5551b21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:51.829069 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f232c03-c1b1-4654-9bc7-aa3db5551b21 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:51.840594 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1280/2582] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:07:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:07:54.572687 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901e153-5bba-4a06-b4de-5b9c293f78ce None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:54.573187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901e153-5bba-4a06-b4de-5b9c293f78ce None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:54.573307 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901e153-5bba-4a06-b4de-5b9c293f78ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:54.591026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1901e153-5bba-4a06-b4de-5b9c293f78ce None None] MFA Rules not processed for user `6c93c65ee4e24efc82d26e66d18b63cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:54.592287 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1901e153-5bba-4a06-b4de-5b9c293f78ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:54.602904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1303/2583] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:07:57.426014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f232c03-c1b1-4654-9bc7-aa3db5551b21 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:57.427513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0f232c03-c1b1-4654-9bc7-aa3db5551b21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:57.441485 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f232c03-c1b1-4654-9bc7-aa3db5551b21 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:57.446010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfe1a4-2d70-43e5-97e1-f2f32ea4b5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:57.446848 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfe1a4-2d70-43e5-97e1-f2f32ea4b5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:57.447126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfe1a4-2d70-43e5-97e1-f2f32ea4b5af admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:57.447428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bfe1a4-2d70-43e5-97e1-f2f32ea4b5af admin admin] PATH_INFO: `/v3/users/03c8e4230ac84edba24d32b394489bfe` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:57.448603 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfe1a4-2d70-43e5-97e1-f2f32ea4b5af admin admin] RBAC: Authorizing `identity:delete_user(user_id=03c8e4230ac84edba24d32b394489bfe)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:57.450540 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bfe1a4-2d70-43e5-97e1-f2f32ea4b5af admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:57.622962 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-66bfe1a4-2d70-43e5-97e1-f2f32ea4b5af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c8e4230ac84edba24d32b394489bfe'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:57.623909 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-66bfe1a4-2d70-43e5-97e1-f2f32ea4b5af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c8e4230ac84edba24d32b394489bfe'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:57.630167 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-66bfe1a4-2d70-43e5-97e1-f2f32ea4b5af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c8e4230ac84edba24d32b394489bfe'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:57.637219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-66bfe1a4-2d70-43e5-97e1-f2f32ea4b5af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c8e4230ac84edba24d32b394489bfe'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:57.644107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-66bfe1a4-2d70-43e5-97e1-f2f32ea4b5af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c8e4230ac84edba24d32b394489bfe'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:57.725141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1281/2584] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:07:57 2022] DELETE /identity/v3/users/03c8e4230ac84edba24d32b394489bfe => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:07:57.730180 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8851da9-0e25-4021-8fc9-53a94964c65b None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:57.730642 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8851da9-0e25-4021-8fc9-53a94964c65b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:57.730642 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8851da9-0e25-4021-8fc9-53a94964c65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:57.749147 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-e8851da9-0e25-4021-8fc9-53a94964c65b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:07:57.750329 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e8851da9-0e25-4021-8fc9-53a94964c65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:57.808945 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1304/2585] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:07:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:07:57.818785 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfe1a4-2d70-43e5-97e1-f2f32ea4b5af admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:57.820303 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-66bfe1a4-2d70-43e5-97e1-f2f32ea4b5af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:58.007471 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bfe1a4-2d70-43e5-97e1-f2f32ea4b5af admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:58.010994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cba903-500c-480b-a543-a642eec842b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:58.011661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cba903-500c-480b-a543-a642eec842b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:58.011939 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cba903-500c-480b-a543-a642eec842b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:58.012241 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cba903-500c-480b-a543-a642eec842b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:58.022909 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cba903-500c-480b-a543-a642eec842b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:58.024405 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cba903-500c-480b-a543-a642eec842b3 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:58.034456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1282/2586] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:07:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:07:58.601426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8851da9-0e25-4021-8fc9-53a94964c65b None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:07:58.601426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e8851da9-0e25-4021-8fc9-53a94964c65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:07:58.611055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8851da9-0e25-4021-8fc9-53a94964c65b None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:07:58.616162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e868e0-4d35-48e7-a61b-24149d6d7348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:07:58.617022 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e868e0-4d35-48e7-a61b-24149d6d7348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:07:58.617495 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e868e0-4d35-48e7-a61b-24149d6d7348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:07:58.617940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e868e0-4d35-48e7-a61b-24149d6d7348 admin admin] PATH_INFO: `/v3/projects/9e53c2ff20cf4523a44ec304ec9cb6fa` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:07:58.619627 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e868e0-4d35-48e7-a61b-24149d6d7348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e53c2ff20cf4523a44ec304ec9cb6fa)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:07:58.621757 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e868e0-4d35-48e7-a61b-24149d6d7348 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:07:58.725417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-59e868e0-4d35-48e7-a61b-24149d6d7348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e53c2ff20cf4523a44ec304ec9cb6fa', 'request_id': 'req-59e868e0-4d35-48e7-a61b-24149d6d7348'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:58.822179 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-59e868e0-4d35-48e7-a61b-24149d6d7348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e53c2ff20cf4523a44ec304ec9cb6fa', 'request_id': 'req-59e868e0-4d35-48e7-a61b-24149d6d7348'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:58.829313 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-59e868e0-4d35-48e7-a61b-24149d6d7348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e53c2ff20cf4523a44ec304ec9cb6fa', 'request_id': 'req-59e868e0-4d35-48e7-a61b-24149d6d7348'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:58.842159 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-59e868e0-4d35-48e7-a61b-24149d6d7348 admin admin] The token cache is being invalidate because project 9e53c2ff20cf4523a44ec304ec9cb6fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:07:58.842460 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-59e868e0-4d35-48e7-a61b-24149d6d7348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:58.843182 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-59e868e0-4d35-48e7-a61b-24149d6d7348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:07:58.844974 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1305/2587] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:07:58 2022] DELETE /identity/v3/projects/9e53c2ff20cf4523a44ec304ec9cb6fa => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:08:12.945312 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde98d4-a6ae-4f5e-a61c-3f022548f63f None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:12.945840 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde98d4-a6ae-4f5e-a61c-3f022548f63f None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:12.945840 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcde98d4-a6ae-4f5e-a61c-3f022548f63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:12.963007 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-bcde98d4-a6ae-4f5e-a61c-3f022548f63f None None] MFA Rules not processed for user `6c93c65ee4e24efc82d26e66d18b63cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:08:12.964258 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-bcde98d4-a6ae-4f5e-a61c-3f022548f63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:08:13.016690 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1283/2588] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:08:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:08:33.700561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c6cc5-719f-4919-92f1-ca9b50d59e3b None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:33.701102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c6cc5-719f-4919-92f1-ca9b50d59e3b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:33.701102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c6cc5-719f-4919-92f1-ca9b50d59e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:33.768184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-5b9c6cc5-719f-4919-92f1-ca9b50d59e3b None None] MFA Rules not processed for user `560fd9efb8a04f449acaf2f3987ce81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:08:33.769302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5b9c6cc5-719f-4919-92f1-ca9b50d59e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:08:33.840170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1306/2589] 10.222.0.35 () {58 vars in 1009 bytes} [Sat Feb 12 05:08:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:08:33.962688 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde98d4-a6ae-4f5e-a61c-3f022548f63f None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:08:33.964123 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-bcde98d4-a6ae-4f5e-a61c-3f022548f63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:08:34.071997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcde98d4-a6ae-4f5e-a61c-3f022548f63f None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:08:34.076871 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621962-2306-4a2c-af3f-ba043cd1ddcb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b37a10e3b5e404db7aad72e1772a2de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:08:34.077505 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621962-2306-4a2c-af3f-ba043cd1ddcb service swift] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:34.077783 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621962-2306-4a2c-af3f-ba043cd1ddcb service swift] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:34.078054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1621962-2306-4a2c-af3f-ba043cd1ddcb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:34.086386 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1621962-2306-4a2c-af3f-ba043cd1ddcb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:08:34.088218 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1621962-2306-4a2c-af3f-ba043cd1ddcb service swift] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:08:34.096281 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1284/2590] 10.222.0.35 () {60 vars in 1384 bytes} [Sat Feb 12 05:08:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 05:08:49.399366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c7874-cc7b-479f-a3a6-93aa18762e79 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:49.399883 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c7874-cc7b-479f-a3a6-93aa18762e79 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:49.400010 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c7874-cc7b-479f-a3a6-93aa18762e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:49.417638 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-2e9c7874-cc7b-479f-a3a6-93aa18762e79 None None] MFA Rules not processed for user `560fd9efb8a04f449acaf2f3987ce81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:08:49.418824 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2e9c7874-cc7b-479f-a3a6-93aa18762e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:08:49.426209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1307/2591] 10.222.0.35 () {58 vars in 967 bytes} [Sat Feb 12 05:08:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:08:49.438411 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621962-2306-4a2c-af3f-ba043cd1ddcb service swift] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:08:49.448764 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1621962-2306-4a2c-af3f-ba043cd1ddcb service swift] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:08:49.453987 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ff885-117f-4c94-83af-78040b877d12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b37a10e3b5e404db7aad72e1772a2de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:08:49.454635 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ff885-117f-4c94-83af-78040b877d12 service swift] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:49.454916 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ff885-117f-4c94-83af-78040b877d12 service swift] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:49.455191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16ff885-117f-4c94-83af-78040b877d12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:49.464382 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ff885-117f-4c94-83af-78040b877d12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:08:49.465939 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16ff885-117f-4c94-83af-78040b877d12 service swift] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:08:49.473821 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1285/2592] 10.222.0.35 () {60 vars in 1384 bytes} [Sat Feb 12 05:08:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 05:08:52.281312 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c7874-cc7b-479f-a3a6-93aa18762e79 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:08:52.282825 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2e9c7874-cc7b-479f-a3a6-93aa18762e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:08:52.347376 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c7874-cc7b-479f-a3a6-93aa18762e79 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:08:52.352516 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115a88b-83ea-45c2-9f82-2abf4fbe1a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:08:52.353357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115a88b-83ea-45c2-9f82-2abf4fbe1a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:52.353633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115a88b-83ea-45c2-9f82-2abf4fbe1a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:52.353902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115a88b-83ea-45c2-9f82-2abf4fbe1a3a admin admin] PATH_INFO: `/v3/users/6c93c65ee4e24efc82d26e66d18b63cb` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:52.355101 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115a88b-83ea-45c2-9f82-2abf4fbe1a3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c93c65ee4e24efc82d26e66d18b63cb)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:08:52.357096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9115a88b-83ea-45c2-9f82-2abf4fbe1a3a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:08:52.520841 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9115a88b-83ea-45c2-9f82-2abf4fbe1a3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c93c65ee4e24efc82d26e66d18b63cb'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:08:52.521426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9115a88b-83ea-45c2-9f82-2abf4fbe1a3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c93c65ee4e24efc82d26e66d18b63cb'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:08:52.522016 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9115a88b-83ea-45c2-9f82-2abf4fbe1a3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c93c65ee4e24efc82d26e66d18b63cb'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:08:52.533276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9115a88b-83ea-45c2-9f82-2abf4fbe1a3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c93c65ee4e24efc82d26e66d18b63cb'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:08:52.540616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9115a88b-83ea-45c2-9f82-2abf4fbe1a3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c93c65ee4e24efc82d26e66d18b63cb'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:08:52.624108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1308/2593] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:08:52 2022] DELETE /identity/v3/users/6c93c65ee4e24efc82d26e66d18b63cb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:08:52.915823 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ff885-117f-4c94-83af-78040b877d12 service swift] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:08:52.927141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16ff885-117f-4c94-83af-78040b877d12 service swift] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:08:52.985595 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacba821-58cc-4925-becf-2d485fbb7b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:08:52.986421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacba821-58cc-4925-becf-2d485fbb7b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:52.986695 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacba821-58cc-4925-becf-2d485fbb7b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:52.986959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacba821-58cc-4925-becf-2d485fbb7b4a admin admin] PATH_INFO: `/v3/projects/fc148aa31dac470990a5172b5fca6256` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:52.988166 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacba821-58cc-4925-becf-2d485fbb7b4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc148aa31dac470990a5172b5fca6256)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:08:52.990059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacba821-58cc-4925-becf-2d485fbb7b4a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:08:53.093269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-cacba821-58cc-4925-becf-2d485fbb7b4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc148aa31dac470990a5172b5fca6256', 'request_id': 'req-cacba821-58cc-4925-becf-2d485fbb7b4a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:08:53.099015 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-cacba821-58cc-4925-becf-2d485fbb7b4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc148aa31dac470990a5172b5fca6256', 'request_id': 'req-cacba821-58cc-4925-becf-2d485fbb7b4a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:08:53.105169 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-cacba821-58cc-4925-becf-2d485fbb7b4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc148aa31dac470990a5172b5fca6256', 'request_id': 'req-cacba821-58cc-4925-becf-2d485fbb7b4a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:08:53.187534 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-cacba821-58cc-4925-becf-2d485fbb7b4a admin admin] The token cache is being invalidate because project fc148aa31dac470990a5172b5fca6256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:08:53.187832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-cacba821-58cc-4925-becf-2d485fbb7b4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:08:53.188448 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-cacba821-58cc-4925-becf-2d485fbb7b4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:08:53.189999 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1286/2594] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:08:52 2022] DELETE /identity/v3/projects/fc148aa31dac470990a5172b5fca6256 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:08:53.194706 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dc27d-1e59-414b-96df-00485ca34937 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:53.195746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dc27d-1e59-414b-96df-00485ca34937 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:53.196030 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1dc27d-1e59-414b-96df-00485ca34937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:53.214942 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-3c1dc27d-1e59-414b-96df-00485ca34937 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:08:53.216199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3c1dc27d-1e59-414b-96df-00485ca34937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:08:53.274771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1309/2595] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:08:53.282934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8540d6f-5895-43f2-9800-3143c148c7cd None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:53.283236 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8540d6f-5895-43f2-9800-3143c148c7cd None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:53.283530 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8540d6f-5895-43f2-9800-3143c148c7cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:53.301697 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-d8540d6f-5895-43f2-9800-3143c148c7cd None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:08:53.302887 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d8540d6f-5895-43f2-9800-3143c148c7cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:08:53.310747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1287/2596] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:08:53.314904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dc27d-1e59-414b-96df-00485ca34937 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:08:53.324823 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1dc27d-1e59-414b-96df-00485ca34937 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:08:53.329661 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5591d1e-fbc3-49a7-b5af-0469af58c28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:08:53.330319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5591d1e-fbc3-49a7-b5af-0469af58c28f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:53.330601 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5591d1e-fbc3-49a7-b5af-0469af58c28f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:53.330876 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5591d1e-fbc3-49a7-b5af-0469af58c28f admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:53.331643 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5591d1e-fbc3-49a7-b5af-0469af58c28f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:08:53.331952 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5591d1e-fbc3-49a7-b5af-0469af58c28f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:08:53.333574 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5591d1e-fbc3-49a7-b5af-0469af58c28f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:08:53.345317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1310/2597] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:08:53.349285 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8540d6f-5895-43f2-9800-3143c148c7cd None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:08:53.358910 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8540d6f-5895-43f2-9800-3143c148c7cd None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:08:53.363562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228847f-a4a5-4d1a-a515-0d50f58e477e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:08:53.364192 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228847f-a4a5-4d1a-a515-0d50f58e477e admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:53.364469 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228847f-a4a5-4d1a-a515-0d50f58e477e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:53.364738 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1228847f-a4a5-4d1a-a515-0d50f58e477e admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:53.365442 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228847f-a4a5-4d1a-a515-0d50f58e477e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:08:53.368075 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1228847f-a4a5-4d1a-a515-0d50f58e477e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:08:53.465150 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1288/2598] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:08:53 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:08:53.469356 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5591d1e-fbc3-49a7-b5af-0469af58c28f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:08:53.480110 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5591d1e-fbc3-49a7-b5af-0469af58c28f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:08:53.533270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc444bb-e8cb-467c-a541-fe7399876b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:08:53.533922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc444bb-e8cb-467c-a541-fe7399876b9c admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:53.534200 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc444bb-e8cb-467c-a541-fe7399876b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:53.534472 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc444bb-e8cb-467c-a541-fe7399876b9c admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:53.535160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc444bb-e8cb-467c-a541-fe7399876b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:08:53.537076 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc444bb-e8cb-467c-a541-fe7399876b9c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:08:53.622492 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1311/2599] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:08:53 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:08:53.626480 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228847f-a4a5-4d1a-a515-0d50f58e477e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:08:53.637106 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1228847f-a4a5-4d1a-a515-0d50f58e477e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:08:53.641834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093a701-e4f1-4bed-a8eb-1731b013522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:08:53.642470 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093a701-e4f1-4bed-a8eb-1731b013522b admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:53.642746 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093a701-e4f1-4bed-a8eb-1731b013522b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:53.643012 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093a701-e4f1-4bed-a8eb-1731b013522b admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:53.643805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093a701-e4f1-4bed-a8eb-1731b013522b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:08:53.645364 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093a701-e4f1-4bed-a8eb-1731b013522b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:08:53.656252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1289/2600] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:08:53.660181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc444bb-e8cb-467c-a541-fe7399876b9c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:08:53.670518 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc444bb-e8cb-467c-a541-fe7399876b9c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:08:53.675172 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c028c0ab-2f4e-48af-96b6-07c140d91a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:08:53.675791 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028c0ab-2f4e-48af-96b6-07c140d91a6e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:53.676069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028c0ab-2f4e-48af-96b6-07c140d91a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:53.676343 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c028c0ab-2f4e-48af-96b6-07c140d91a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:53.677074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028c0ab-2f4e-48af-96b6-07c140d91a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:08:53.678711 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c028c0ab-2f4e-48af-96b6-07c140d91a6e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:08:53.688669 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1312/2601] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:08:53.692471 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093a701-e4f1-4bed-a8eb-1731b013522b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:08:53.702136 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093a701-e4f1-4bed-a8eb-1731b013522b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:08:53.706713 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e3f7e-2fe7-4701-a3b9-77b242226d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:08:53.707606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e3f7e-2fe7-4701-a3b9-77b242226d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:53.707888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e3f7e-2fe7-4701-a3b9-77b242226d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:53.708162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e3f7e-2fe7-4701-a3b9-77b242226d5c admin admin] PATH_INFO: `/v3/projects/b78b10c70af64d6d9ee563bdaf279f3a/users/2f7e064dc635490ba1d71f88ee29934f/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:53.722696 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e3f7e-2fe7-4701-a3b9-77b242226d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b78b10c70af64d6d9ee563bdaf279f3a, user_id=2f7e064dc635490ba1d71f88ee29934f, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:08:53.725320 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e3f7e-2fe7-4701-a3b9-77b242226d5c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:08:53.793910 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1290/2602] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:08:53 2022] PUT /identity/v3/projects/b78b10c70af64d6d9ee563bdaf279f3a/users/2f7e064dc635490ba1d71f88ee29934f/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:08:53.809852 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106ae00-baaa-4a71-ad97-e02df80fed78 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:53.810140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106ae00-baaa-4a71-ad97-e02df80fed78 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:53.810433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106ae00-baaa-4a71-ad97-e02df80fed78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:53.837470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-3106ae00-baaa-4a71-ad97-e02df80fed78 None None] MFA Rules not processed for user `2f7e064dc635490ba1d71f88ee29934f`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:08:53.838692 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3106ae00-baaa-4a71-ad97-e02df80fed78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:08:53.899444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1313/2603] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:08:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:08:53.908834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e3f7e-2fe7-4701-a3b9-77b242226d5c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:08:53.910533 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-191e3f7e-2fe7-4701-a3b9-77b242226d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:08:53.966934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e3f7e-2fe7-4701-a3b9-77b242226d5c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:08:53.970775 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a8ca7-976f-464e-a13b-0a43d241136f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:08:53.971445 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a8ca7-976f-464e-a13b-0a43d241136f service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:53.971726 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a8ca7-976f-464e-a13b-0a43d241136f service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:53.972033 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a8ca7-976f-464e-a13b-0a43d241136f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:53.981087 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a8ca7-976f-464e-a13b-0a43d241136f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:08:53.982488 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81a8ca7-976f-464e-a13b-0a43d241136f service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:08:53.991369 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1291/2604] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:08:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:08:55.661058 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422a204-9ac6-422a-b317-db2c15810425 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:08:55.661568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422a204-9ac6-422a-b317-db2c15810425 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:08:55.661677 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422a204-9ac6-422a-b317-db2c15810425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:08:55.678853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-9422a204-9ac6-422a-b317-db2c15810425 None None] MFA Rules not processed for user `2f7e064dc635490ba1d71f88ee29934f`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:08:55.680232 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9422a204-9ac6-422a-b317-db2c15810425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:08:55.687053 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1314/2605] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:08:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:09:13.514740 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e0a9e-694f-40d1-9eb4-5961ad640c33 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:13.515743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e0a9e-694f-40d1-9eb4-5961ad640c33 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:13.515743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e0a9e-694f-40d1-9eb4-5961ad640c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:13.532616 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-c16e0a9e-694f-40d1-9eb4-5961ad640c33 None None] MFA Rules not processed for user `560fd9efb8a04f449acaf2f3987ce81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:09:13.533813 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c16e0a9e-694f-40d1-9eb4-5961ad640c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:13.586826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1292/2606] 10.222.0.35 () {58 vars in 1009 bytes} [Sat Feb 12 05:09:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:09:13.599029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422a204-9ac6-422a-b317-db2c15810425 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:13.600491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9422a204-9ac6-422a-b317-db2c15810425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:13.676363 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422a204-9ac6-422a-b317-db2c15810425 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:13.681320 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f376a-4573-4bc8-bc95-22f7adc06dc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b37a10e3b5e404db7aad72e1772a2de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:13.682695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f376a-4573-4bc8-bc95-22f7adc06dc2 service swift] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:13.682973 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f376a-4573-4bc8-bc95-22f7adc06dc2 service swift] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:13.683271 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f376a-4573-4bc8-bc95-22f7adc06dc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:13.691242 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f376a-4573-4bc8-bc95-22f7adc06dc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:13.692834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f376a-4573-4bc8-bc95-22f7adc06dc2 service swift] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:13.700934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1315/2607] 10.222.0.35 () {60 vars in 1384 bytes} [Sat Feb 12 05:09:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 05:09:14.604510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fbda8-2b0a-412f-a09a-a62c1c102669 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:14.604994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fbda8-2b0a-412f-a09a-a62c1c102669 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:14.605104 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4fbda8-2b0a-412f-a09a-a62c1c102669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:14.623584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-3e4fbda8-2b0a-412f-a09a-a62c1c102669 None None] MFA Rules not processed for user `560fd9efb8a04f449acaf2f3987ce81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:09:14.624758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-3e4fbda8-2b0a-412f-a09a-a62c1c102669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:14.631682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1293/2608] 10.222.0.35 () {58 vars in 967 bytes} [Sat Feb 12 05:09:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:09:14.643915 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f376a-4573-4bc8-bc95-22f7adc06dc2 service swift] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:14.655505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f376a-4573-4bc8-bc95-22f7adc06dc2 service swift] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:14.660793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9114b-cc02-4980-bed0-82f3ec21bd4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b37a10e3b5e404db7aad72e1772a2de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:14.661462 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9114b-cc02-4980-bed0-82f3ec21bd4f service swift] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:14.661748 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9114b-cc02-4980-bed0-82f3ec21bd4f service swift] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:14.662029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d9114b-cc02-4980-bed0-82f3ec21bd4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:14.672041 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9114b-cc02-4980-bed0-82f3ec21bd4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:14.673758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d9114b-cc02-4980-bed0-82f3ec21bd4f service swift] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:14.682804 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1316/2609] 10.222.0.35 () {60 vars in 1384 bytes} [Sat Feb 12 05:09:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 05:09:15.221482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97c4dd-d59d-48d4-bd83-d4bc128a0b02 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:15.221761 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97c4dd-d59d-48d4-bd83-d4bc128a0b02 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:15.222037 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97c4dd-d59d-48d4-bd83-d4bc128a0b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:15.240015 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-7c97c4dd-d59d-48d4-bd83-d4bc128a0b02 None None] MFA Rules not processed for user `560fd9efb8a04f449acaf2f3987ce81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:09:15.241202 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-7c97c4dd-d59d-48d4-bd83-d4bc128a0b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:15.265361 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1294/2610] 10.222.0.35 () {58 vars in 1009 bytes} [Sat Feb 12 05:09:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:09:15.277626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9114b-cc02-4980-bed0-82f3ec21bd4f service swift] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:15.298083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d9114b-cc02-4980-bed0-82f3ec21bd4f service swift] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:15.303168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3ee62-592a-492e-8ef3-8ef6aa9c0538 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b37a10e3b5e404db7aad72e1772a2de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:15.303829 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3ee62-592a-492e-8ef3-8ef6aa9c0538 service swift] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:15.304123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3ee62-592a-492e-8ef3-8ef6aa9c0538 service swift] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:15.304394 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3ee62-592a-492e-8ef3-8ef6aa9c0538 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:15.312919 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3ee62-592a-492e-8ef3-8ef6aa9c0538 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:15.314545 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3ee62-592a-492e-8ef3-8ef6aa9c0538 service swift] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:15.322974 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1317/2611] 10.222.0.35 () {60 vars in 1384 bytes} [Sat Feb 12 05:09:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 05:09:15.930647 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c805fd7-6322-4fd2-a2f0-6664b0036fc1 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:15.931115 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c805fd7-6322-4fd2-a2f0-6664b0036fc1 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:15.931219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c805fd7-6322-4fd2-a2f0-6664b0036fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:15.948884 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-6c805fd7-6322-4fd2-a2f0-6664b0036fc1 None None] MFA Rules not processed for user `560fd9efb8a04f449acaf2f3987ce81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:09:15.950056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-6c805fd7-6322-4fd2-a2f0-6664b0036fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:15.957054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1295/2612] 10.222.0.35 () {58 vars in 967 bytes} [Sat Feb 12 05:09:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:09:15.969871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3ee62-592a-492e-8ef3-8ef6aa9c0538 service swift] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:15.980703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3ee62-592a-492e-8ef3-8ef6aa9c0538 service swift] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:15.985761 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04900341-a58a-4fb8-9218-f8320b5eb53e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b37a10e3b5e404db7aad72e1772a2de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:15.986384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04900341-a58a-4fb8-9218-f8320b5eb53e service swift] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:15.986669 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04900341-a58a-4fb8-9218-f8320b5eb53e service swift] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:15.986948 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04900341-a58a-4fb8-9218-f8320b5eb53e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:15.995617 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04900341-a58a-4fb8-9218-f8320b5eb53e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:15.997377 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04900341-a58a-4fb8-9218-f8320b5eb53e service swift] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:16.005278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1318/2613] 10.222.0.35 () {60 vars in 1384 bytes} [Sat Feb 12 05:09:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 05:09:18.444699 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c805fd7-6322-4fd2-a2f0-6664b0036fc1 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:18.504151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c805fd7-6322-4fd2-a2f0-6664b0036fc1 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:18.508685 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15302a-dd62-45ad-8bab-624be31410d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:18.509525 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15302a-dd62-45ad-8bab-624be31410d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:18.509805 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15302a-dd62-45ad-8bab-624be31410d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:18.510081 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d15302a-dd62-45ad-8bab-624be31410d4 admin admin] PATH_INFO: `/v3/users/2f7e064dc635490ba1d71f88ee29934f` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:18.512714 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15302a-dd62-45ad-8bab-624be31410d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f7e064dc635490ba1d71f88ee29934f)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:18.514601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d15302a-dd62-45ad-8bab-624be31410d4 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:18.717876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5d15302a-dd62-45ad-8bab-624be31410d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f7e064dc635490ba1d71f88ee29934f'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:09:18.718527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5d15302a-dd62-45ad-8bab-624be31410d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f7e064dc635490ba1d71f88ee29934f'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:09:18.719175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5d15302a-dd62-45ad-8bab-624be31410d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f7e064dc635490ba1d71f88ee29934f'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:09:18.730894 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5d15302a-dd62-45ad-8bab-624be31410d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f7e064dc635490ba1d71f88ee29934f'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:09:18.737476 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-5d15302a-dd62-45ad-8bab-624be31410d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f7e064dc635490ba1d71f88ee29934f'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:09:18.829982 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1296/2614] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:09:18 2022] DELETE /identity/v3/users/2f7e064dc635490ba1d71f88ee29934f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:09:18.834539 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567d9e9-d7b6-4fc0-87a7-025bd6a2f992 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:18.839397 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567d9e9-d7b6-4fc0-87a7-025bd6a2f992 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:18.839397 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567d9e9-d7b6-4fc0-87a7-025bd6a2f992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:18.854767 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-9567d9e9-d7b6-4fc0-87a7-025bd6a2f992 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:09:18.855999 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9567d9e9-d7b6-4fc0-87a7-025bd6a2f992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:18.912718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1319/2615] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:09:18.922473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15302a-dd62-45ad-8bab-624be31410d4 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:18.926872 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-5d15302a-dd62-45ad-8bab-624be31410d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:18.983937 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d15302a-dd62-45ad-8bab-624be31410d4 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:18.987455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20cfb5a-f69d-4283-88b2-2e0c30885314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:18.988086 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cfb5a-f69d-4283-88b2-2e0c30885314 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:18.988363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cfb5a-f69d-4283-88b2-2e0c30885314 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:18.988677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20cfb5a-f69d-4283-88b2-2e0c30885314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:18.998315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20cfb5a-f69d-4283-88b2-2e0c30885314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:18.999786 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20cfb5a-f69d-4283-88b2-2e0c30885314 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:19.009012 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1297/2616] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:09:19.246180 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567d9e9-d7b6-4fc0-87a7-025bd6a2f992 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:19.247644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9567d9e9-d7b6-4fc0-87a7-025bd6a2f992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:19.261946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567d9e9-d7b6-4fc0-87a7-025bd6a2f992 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:19.266696 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:19.268056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:19.268686 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:19.268967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a admin admin] PATH_INFO: `/v3/projects/b78b10c70af64d6d9ee563bdaf279f3a` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:19.270216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b78b10c70af64d6d9ee563bdaf279f3a)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:19.272233 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:19.374810 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b78b10c70af64d6d9ee563bdaf279f3a', 'request_id': 'req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:09:19.421291 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b78b10c70af64d6d9ee563bdaf279f3a', 'request_id': 'req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:09:19.426755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b78b10c70af64d6d9ee563bdaf279f3a', 'request_id': 'req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:09:19.437666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a admin admin] The token cache is being invalidate because project b78b10c70af64d6d9ee563bdaf279f3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:09:19.437950 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:09:19.438569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-32cf7786-0bc5-4ef7-82f4-7ebabdf4546a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:09:19.441220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1320/2617] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:09:19 2022] DELETE /identity/v3/projects/b78b10c70af64d6d9ee563bdaf279f3a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:09:19.445102 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013331-7cb2-4a0e-9b7d-a002deb99718 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:19.445590 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013331-7cb2-4a0e-9b7d-a002deb99718 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:19.445707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00013331-7cb2-4a0e-9b7d-a002deb99718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:19.463632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-00013331-7cb2-4a0e-9b7d-a002deb99718 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:09:19.465491 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-00013331-7cb2-4a0e-9b7d-a002deb99718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:19.521429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1298/2618] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:09:19.529668 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2a304-4168-46c0-bae0-500ac257bc54 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:19.529957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2a304-4168-46c0-bae0-500ac257bc54 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:19.530240 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2a304-4168-46c0-bae0-500ac257bc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:19.551090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-11e2a304-4168-46c0-bae0-500ac257bc54 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:09:19.553169 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-11e2a304-4168-46c0-bae0-500ac257bc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:19.561812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1321/2619] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:09:19.565947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00013331-7cb2-4a0e-9b7d-a002deb99718 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:19.576154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00013331-7cb2-4a0e-9b7d-a002deb99718 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:19.580834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216d17a-a15e-4d25-987a-1ec37b42530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:19.581477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216d17a-a15e-4d25-987a-1ec37b42530b admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:19.581764 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216d17a-a15e-4d25-987a-1ec37b42530b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:19.582036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216d17a-a15e-4d25-987a-1ec37b42530b admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:19.582773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216d17a-a15e-4d25-987a-1ec37b42530b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:09:19.583078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216d17a-a15e-4d25-987a-1ec37b42530b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:19.584754 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216d17a-a15e-4d25-987a-1ec37b42530b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:19.597416 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1299/2620] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:09:19.601506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2a304-4168-46c0-bae0-500ac257bc54 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:19.610859 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2a304-4168-46c0-bae0-500ac257bc54 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:19.615637 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93b427-5f0a-4a15-bbb6-51a8b0022fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:19.616341 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b427-5f0a-4a15-bbb6-51a8b0022fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:19.616630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b427-5f0a-4a15-bbb6-51a8b0022fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:19.616908 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b427-5f0a-4a15-bbb6-51a8b0022fa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:19.617624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93b427-5f0a-4a15-bbb6-51a8b0022fa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:19.619551 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93b427-5f0a-4a15-bbb6-51a8b0022fa4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:19.725682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1322/2621] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:09:19 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:09:19.729985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216d17a-a15e-4d25-987a-1ec37b42530b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:19.739716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216d17a-a15e-4d25-987a-1ec37b42530b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:19.793853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871e8d6-7136-4cc3-bb7a-727992f349b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:19.794466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871e8d6-7136-4cc3-bb7a-727992f349b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:19.794746 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871e8d6-7136-4cc3-bb7a-727992f349b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:19.795092 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871e8d6-7136-4cc3-bb7a-727992f349b2 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:19.795785 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871e8d6-7136-4cc3-bb7a-727992f349b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:19.797705 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871e8d6-7136-4cc3-bb7a-727992f349b2 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:19.884639 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1300/2622] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:09:19 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:09:19.889289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93b427-5f0a-4a15-bbb6-51a8b0022fa4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:19.899284 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93b427-5f0a-4a15-bbb6-51a8b0022fa4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:19.904398 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405591ee-2bd2-4218-b9a9-c1c73a41af46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:19.905035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405591ee-2bd2-4218-b9a9-c1c73a41af46 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:19.905313 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405591ee-2bd2-4218-b9a9-c1c73a41af46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:19.905583 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405591ee-2bd2-4218-b9a9-c1c73a41af46 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:19.906315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405591ee-2bd2-4218-b9a9-c1c73a41af46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:19.907910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405591ee-2bd2-4218-b9a9-c1c73a41af46 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:19.918522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1323/2623] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:09:19.922442 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871e8d6-7136-4cc3-bb7a-727992f349b2 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:19.932229 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871e8d6-7136-4cc3-bb7a-727992f349b2 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:19.937128 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e4cb7-931b-4a6d-be57-6d975d41316c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:19.937773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e4cb7-931b-4a6d-be57-6d975d41316c admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:19.938056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e4cb7-931b-4a6d-be57-6d975d41316c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:19.938329 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e4cb7-931b-4a6d-be57-6d975d41316c admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:19.939057 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e4cb7-931b-4a6d-be57-6d975d41316c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:19.940659 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e4cb7-931b-4a6d-be57-6d975d41316c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:19.950494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1301/2624] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:09:19.954595 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405591ee-2bd2-4218-b9a9-c1c73a41af46 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:19.965446 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405591ee-2bd2-4218-b9a9-c1c73a41af46 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:19.970372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb390df6-b29d-4100-9122-16d5df06c010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:19.971253 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb390df6-b29d-4100-9122-16d5df06c010 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:19.971543 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb390df6-b29d-4100-9122-16d5df06c010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:19.971832 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb390df6-b29d-4100-9122-16d5df06c010 admin admin] PATH_INFO: `/v3/projects/5202622e17a348e4bcb43c74abf37a6e/users/182001be496c4437a532048933011a15/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:19.986802 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb390df6-b29d-4100-9122-16d5df06c010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5202622e17a348e4bcb43c74abf37a6e, user_id=182001be496c4437a532048933011a15, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:19.989462 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb390df6-b29d-4100-9122-16d5df06c010 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:20.073332 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1324/2625] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:09:19 2022] PUT /identity/v3/projects/5202622e17a348e4bcb43c74abf37a6e/users/182001be496c4437a532048933011a15/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:09:20.078798 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d1160-6e7b-4b34-a741-9a227328e23c None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:20.079089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d1160-6e7b-4b34-a741-9a227328e23c None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:20.079461 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3d1160-6e7b-4b34-a741-9a227328e23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:20.097632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-db3d1160-6e7b-4b34-a741-9a227328e23c None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:09:20.098807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-db3d1160-6e7b-4b34-a741-9a227328e23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:20.156044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1302/2626] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:09:20.165481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb390df6-b29d-4100-9122-16d5df06c010 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:20.167165 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-eb390df6-b29d-4100-9122-16d5df06c010 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:20.222695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb390df6-b29d-4100-9122-16d5df06c010 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:20.226281 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f7928-10f8-4a16-ba70-ecb2b9af19db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:20.226907 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f7928-10f8-4a16-ba70-ecb2b9af19db service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:20.227186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f7928-10f8-4a16-ba70-ecb2b9af19db service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:20.227488 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f7928-10f8-4a16-ba70-ecb2b9af19db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:20.236586 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f7928-10f8-4a16-ba70-ecb2b9af19db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:20.238001 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f7928-10f8-4a16-ba70-ecb2b9af19db service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:20.247310 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1325/2627] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:09:25.424817 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471d913-b069-46f0-8cdd-123386fbb944 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:25.425294 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471d913-b069-46f0-8cdd-123386fbb944 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:25.425294 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471d913-b069-46f0-8cdd-123386fbb944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:25.458232 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-c471d913-b069-46f0-8cdd-123386fbb944 None None] MFA Rules not processed for user `182001be496c4437a532048933011a15`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:09:25.459587 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c471d913-b069-46f0-8cdd-123386fbb944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:25.539551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1303/2628] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:09:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:09:25.544414 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f7928-10f8-4a16-ba70-ecb2b9af19db service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:25.555071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f7928-10f8-4a16-ba70-ecb2b9af19db service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:25.560108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f9fb7-c2d9-4ba9-b9fc-efcd941bcf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:25.561029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f9fb7-c2d9-4ba9-b9fc-efcd941bcf10 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:25.561503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f9fb7-c2d9-4ba9-b9fc-efcd941bcf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:25.561951 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f9fb7-c2d9-4ba9-b9fc-efcd941bcf10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:25.562885 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f9fb7-c2d9-4ba9-b9fc-efcd941bcf10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:25.565649 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f9fb7-c2d9-4ba9-b9fc-efcd941bcf10 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:25.661528 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1326/2629] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:09:25 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:09:25.665498 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471d913-b069-46f0-8cdd-123386fbb944 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:25.678051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471d913-b069-46f0-8cdd-123386fbb944 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:25.741938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4961c-7435-4c05-a14f-5b1e7fa09a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:25.742608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4961c-7435-4c05-a14f-5b1e7fa09a8e admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:25.742891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4961c-7435-4c05-a14f-5b1e7fa09a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:25.743159 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da4961c-7435-4c05-a14f-5b1e7fa09a8e admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:25.743907 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4961c-7435-4c05-a14f-5b1e7fa09a8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:25.746474 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da4961c-7435-4c05-a14f-5b1e7fa09a8e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:25.880490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1304/2630] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:09:25 2022] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:09:25.884387 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f9fb7-c2d9-4ba9-b9fc-efcd941bcf10 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:25.896178 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f9fb7-c2d9-4ba9-b9fc-efcd941bcf10 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:25.900881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e0de1-be20-49cc-bc99-5d688c4dc6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:25.905775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e0de1-be20-49cc-bc99-5d688c4dc6ed admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:25.905775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e0de1-be20-49cc-bc99-5d688c4dc6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:25.905775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e0de1-be20-49cc-bc99-5d688c4dc6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:25.905775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e0de1-be20-49cc-bc99-5d688c4dc6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:25.905775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e0de1-be20-49cc-bc99-5d688c4dc6ed admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:25.916149 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1327/2631] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:09:25.920435 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4961c-7435-4c05-a14f-5b1e7fa09a8e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:25.930279 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da4961c-7435-4c05-a14f-5b1e7fa09a8e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:25.936277 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401ab25-f2b8-42e1-9b04-be89a098e06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:25.937272 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401ab25-f2b8-42e1-9b04-be89a098e06a admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:25.937758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401ab25-f2b8-42e1-9b04-be89a098e06a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:25.938143 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401ab25-f2b8-42e1-9b04-be89a098e06a admin admin] PATH_INFO: `/v3/projects/b1e42b33501b4016a6bffb95882c5876/users/937a895d972d4142afdc7370d900b629/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:25.953165 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401ab25-f2b8-42e1-9b04-be89a098e06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e42b33501b4016a6bffb95882c5876, user_id=937a895d972d4142afdc7370d900b629, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:25.955813 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401ab25-f2b8-42e1-9b04-be89a098e06a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:26.045934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1305/2632] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:09:25 2022] PUT /identity/v3/projects/b1e42b33501b4016a6bffb95882c5876/users/937a895d972d4142afdc7370d900b629/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:09:26.049902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e0de1-be20-49cc-bc99-5d688c4dc6ed admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:26.060479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e0de1-be20-49cc-bc99-5d688c4dc6ed admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:26.114091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038fe5d-e27a-41ee-b7ea-e29f64020b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:26.114747 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038fe5d-e27a-41ee-b7ea-e29f64020b40 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:26.115029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038fe5d-e27a-41ee-b7ea-e29f64020b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:26.115332 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038fe5d-e27a-41ee-b7ea-e29f64020b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:26.116068 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038fe5d-e27a-41ee-b7ea-e29f64020b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:26.117687 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038fe5d-e27a-41ee-b7ea-e29f64020b40 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:26.127978 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1328/2633] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:09:26.132137 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401ab25-f2b8-42e1-9b04-be89a098e06a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:26.142156 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401ab25-f2b8-42e1-9b04-be89a098e06a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:26.146724 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8afe2-cdcc-45ec-bc91-e37b73435b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:26.147616 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8afe2-cdcc-45ec-bc91-e37b73435b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:26.147897 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8afe2-cdcc-45ec-bc91-e37b73435b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:26.148168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8afe2-cdcc-45ec-bc91-e37b73435b42 admin admin] PATH_INFO: `/v3/projects/b1e42b33501b4016a6bffb95882c5876/users/937a895d972d4142afdc7370d900b629/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:26.150127 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8afe2-cdcc-45ec-bc91-e37b73435b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e42b33501b4016a6bffb95882c5876, user_id=937a895d972d4142afdc7370d900b629, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:26.152911 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8afe2-cdcc-45ec-bc91-e37b73435b42 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:26.162781 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1306/2634] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:09:26 2022] PUT /identity/v3/projects/b1e42b33501b4016a6bffb95882c5876/users/937a895d972d4142afdc7370d900b629/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:09:28.430351 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038fe5d-e27a-41ee-b7ea-e29f64020b40 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:28.433641 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2038fe5d-e27a-41ee-b7ea-e29f64020b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:28.508215 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038fe5d-e27a-41ee-b7ea-e29f64020b40 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:28.535491 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8afe2-cdcc-45ec-bc91-e37b73435b42 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:28.537434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d6c8afe2-cdcc-45ec-bc91-e37b73435b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:28.586957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34ae17-1424-411a-a949-30af1f7cfee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:28.587654 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34ae17-1424-411a-a949-30af1f7cfee0 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:28.588310 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34ae17-1424-411a-a949-30af1f7cfee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:28.588591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34ae17-1424-411a-a949-30af1f7cfee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:28.591671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5b34ae17-1424-411a-a949-30af1f7cfee0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:28.641408 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8afe2-cdcc-45ec-bc91-e37b73435b42 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:28.647961 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb077b-d163-4382-9ddd-b0a7d110d132 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:28.648896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb077b-d163-4382-9ddd-b0a7d110d132 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:28.649373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb077b-d163-4382-9ddd-b0a7d110d132 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:28.649863 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb077b-d163-4382-9ddd-b0a7d110d132 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:28.652091 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2efb077b-d163-4382-9ddd-b0a7d110d132 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:28.709995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34ae17-1424-411a-a949-30af1f7cfee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:28.712047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b34ae17-1424-411a-a949-30af1f7cfee0 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:28.732010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb077b-d163-4382-9ddd-b0a7d110d132 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:28.734840 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb077b-d163-4382-9ddd-b0a7d110d132 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:28.735628 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1329/2635] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:09:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:09:28.749025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1307/2636] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:09:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:09:28.775040 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34ae17-1424-411a-a949-30af1f7cfee0 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:28.776569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5b34ae17-1424-411a-a949-30af1f7cfee0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:28.788920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34ae17-1424-411a-a949-30af1f7cfee0 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:28.794507 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6577a-389c-407f-8f60-d9f1e677d183 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:28.795210 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6577a-389c-407f-8f60-d9f1e677d183 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:28.795519 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6577a-389c-407f-8f60-d9f1e677d183 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:28.795794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6577a-389c-407f-8f60-d9f1e677d183 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:28.797704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e9d6577a-389c-407f-8f60-d9f1e677d183 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:28.819621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6577a-389c-407f-8f60-d9f1e677d183 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:28.821252 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6577a-389c-407f-8f60-d9f1e677d183 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:28.835104 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1330/2637] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:09:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:09:31.927079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b4be-7cbf-4ce4-8020-1789662612f3 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:31.927585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b4be-7cbf-4ce4-8020-1789662612f3 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:31.927741 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6b4be-7cbf-4ce4-8020-1789662612f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:31.958660 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-45b6b4be-7cbf-4ce4-8020-1789662612f3 None None] MFA Rules not processed for user `937a895d972d4142afdc7370d900b629`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:09:31.960830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-45b6b4be-7cbf-4ce4-8020-1789662612f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:32.051917 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1308/2638] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:09:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:09:32.064011 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6577a-389c-407f-8f60-d9f1e677d183 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:32.065653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e9d6577a-389c-407f-8f60-d9f1e677d183 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:32.131378 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6577a-389c-407f-8f60-d9f1e677d183 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:32.135557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1118a-fbae-44ad-a6c0-b0b69688bc57 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3df18302cd84e6eae6a1a60b0a8b2dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:32.136946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1118a-fbae-44ad-a6c0-b0b69688bc57 service glance] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:32.137106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1118a-fbae-44ad-a6c0-b0b69688bc57 service glance] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:32.137380 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1118a-fbae-44ad-a6c0-b0b69688bc57 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:32.194163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1118a-fbae-44ad-a6c0-b0b69688bc57 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:32.195658 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1118a-fbae-44ad-a6c0-b0b69688bc57 service glance] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:32.205458 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1331/2639] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:09:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:09:32.468181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b52ba-bd56-41fa-961c-67e4ec1c510d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:32.468181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b52ba-bd56-41fa-961c-67e4ec1c510d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:32.468181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b52ba-bd56-41fa-961c-67e4ec1c510d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:32.476185 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-3d9b52ba-bd56-41fa-961c-67e4ec1c510d None None] MFA Rules not processed for user `560fd9efb8a04f449acaf2f3987ce81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:09:32.477378 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-3d9b52ba-bd56-41fa-961c-67e4ec1c510d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:32.531434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1309/2640] 10.222.0.35 () {58 vars in 1009 bytes} [Sat Feb 12 05:09:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:09:32.543956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1118a-fbae-44ad-a6c0-b0b69688bc57 service glance] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:32.545305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-06a1118a-fbae-44ad-a6c0-b0b69688bc57 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:32.612432 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1118a-fbae-44ad-a6c0-b0b69688bc57 service glance] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:32.617410 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6ff33-5061-466d-bfed-d56f5c37b038 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b37a10e3b5e404db7aad72e1772a2de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:32.618037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6ff33-5061-466d-bfed-d56f5c37b038 service swift] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:32.618314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6ff33-5061-466d-bfed-d56f5c37b038 service swift] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:32.618587 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6ff33-5061-466d-bfed-d56f5c37b038 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:32.626643 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6ff33-5061-466d-bfed-d56f5c37b038 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:32.631782 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6ff33-5061-466d-bfed-d56f5c37b038 service swift] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:32.636278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1332/2641] 10.222.0.35 () {60 vars in 1384 bytes} [Sat Feb 12 05:09:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Feb 12 05:09:44.344052 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfba26-5fef-43d5-8d4a-64d1b3ed857e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:44.344567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfba26-5fef-43d5-8d4a-64d1b3ed857e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:44.344658 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dfba26-5fef-43d5-8d4a-64d1b3ed857e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:44.362671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-a7dfba26-5fef-43d5-8d4a-64d1b3ed857e None None] MFA Rules not processed for user `182001be496c4437a532048933011a15`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:09:44.363890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a7dfba26-5fef-43d5-8d4a-64d1b3ed857e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:44.371645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1310/2642] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:09:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:09:47.505328 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935334e-5bcd-48ef-b42c-5a4d92c76de8 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:47.505815 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935334e-5bcd-48ef-b42c-5a4d92c76de8 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:47.505914 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935334e-5bcd-48ef-b42c-5a4d92c76de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:47.523721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-f935334e-5bcd-48ef-b42c-5a4d92c76de8 None None] MFA Rules not processed for user `560fd9efb8a04f449acaf2f3987ce81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:09:47.524790 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f935334e-5bcd-48ef-b42c-5a4d92c76de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:09:47.533761 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1333/2643] 10.222.0.35 () {58 vars in 1009 bytes} [Sat Feb 12 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:09:47.547748 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfba26-5fef-43d5-8d4a-64d1b3ed857e None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:09:47.559510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dfba26-5fef-43d5-8d4a-64d1b3ed857e None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:09:47.564815 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d32f2-313e-4cf8-9599-3dcbb889df47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b37a10e3b5e404db7aad72e1772a2de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:09:47.568936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d32f2-313e-4cf8-9599-3dcbb889df47 service swift] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:09:47.569220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d32f2-313e-4cf8-9599-3dcbb889df47 service swift] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:09:47.569493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514d32f2-313e-4cf8-9599-3dcbb889df47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:09:47.578202 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d32f2-313e-4cf8-9599-3dcbb889df47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:09:47.586850 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514d32f2-313e-4cf8-9599-3dcbb889df47 service swift] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:09:47.587778 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1311/2644] 10.222.0.35 () {60 vars in 1384 bytes} [Sat Feb 12 05:09:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 05:10:15.996834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935334e-5bcd-48ef-b42c-5a4d92c76de8 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:10:15.998249 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f935334e-5bcd-48ef-b42c-5a4d92c76de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:10:16.053819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935334e-5bcd-48ef-b42c-5a4d92c76de8 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:10:16.057445 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e748f-588a-4f74-a640-68386ee5bea8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:10:16.058182 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e748f-588a-4f74-a640-68386ee5bea8 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:10:16.058534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e748f-588a-4f74-a640-68386ee5bea8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:10:16.058814 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e748f-588a-4f74-a640-68386ee5bea8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:10:16.067560 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e748f-588a-4f74-a640-68386ee5bea8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:10:16.069007 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e748f-588a-4f74-a640-68386ee5bea8 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:10:16.079967 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1334/2645] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:10:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:10:38.376344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d32f2-313e-4cf8-9599-3dcbb889df47 service swift] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:10:38.385462 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514d32f2-313e-4cf8-9599-3dcbb889df47 service swift] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:10:38.389099 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb6b7f-8f02-4b7b-97fd-f39f79357494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:10:38.389722 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6b7f-8f02-4b7b-97fd-f39f79357494 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:10:38.389997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6b7f-8f02-4b7b-97fd-f39f79357494 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:10:38.390261 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6b7f-8f02-4b7b-97fd-f39f79357494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:10:38.392155 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-00bb6b7f-8f02-4b7b-97fd-f39f79357494 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:10:38.409141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb6b7f-8f02-4b7b-97fd-f39f79357494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:10:38.410604 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb6b7f-8f02-4b7b-97fd-f39f79357494 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:10:38.420768 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1312/2646] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:10:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:11:15.714193 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e748f-588a-4f74-a640-68386ee5bea8 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:15.715706 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-128e748f-588a-4f74-a640-68386ee5bea8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:15.807477 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e748f-588a-4f74-a640-68386ee5bea8 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:15.812624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874cf65-dfce-4a53-9f52-f7eda704b73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:15.813471 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874cf65-dfce-4a53-9f52-f7eda704b73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:15.813752 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874cf65-dfce-4a53-9f52-f7eda704b73d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:15.814024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874cf65-dfce-4a53-9f52-f7eda704b73d admin admin] PATH_INFO: `/v3/users/0596a225af1645498937367326e22e2d` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:15.815217 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874cf65-dfce-4a53-9f52-f7eda704b73d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0596a225af1645498937367326e22e2d)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:15.817146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874cf65-dfce-4a53-9f52-f7eda704b73d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:15.970651 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b874cf65-dfce-4a53-9f52-f7eda704b73d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0596a225af1645498937367326e22e2d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:15.971237 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b874cf65-dfce-4a53-9f52-f7eda704b73d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0596a225af1645498937367326e22e2d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:15.971844 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b874cf65-dfce-4a53-9f52-f7eda704b73d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0596a225af1645498937367326e22e2d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:15.983855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b874cf65-dfce-4a53-9f52-f7eda704b73d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0596a225af1645498937367326e22e2d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:15.990435 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b874cf65-dfce-4a53-9f52-f7eda704b73d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0596a225af1645498937367326e22e2d'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:16.064873 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1335/2647] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:11:15 2022] DELETE /identity/v3/users/0596a225af1645498937367326e22e2d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:16.069307 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad0ae1-6bec-49e5-971a-12ecb6ad756a None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:16.073721 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad0ae1-6bec-49e5-971a-12ecb6ad756a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:16.073721 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ad0ae1-6bec-49e5-971a-12ecb6ad756a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:16.096771 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-b3ad0ae1-6bec-49e5-971a-12ecb6ad756a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:16.101895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b3ad0ae1-6bec-49e5-971a-12ecb6ad756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:16.155207 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1313/2648] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:16.164671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874cf65-dfce-4a53-9f52-f7eda704b73d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:16.166083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b874cf65-dfce-4a53-9f52-f7eda704b73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:16.246297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874cf65-dfce-4a53-9f52-f7eda704b73d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:16.250141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ffc22-0512-472a-aecb-9e99deb10a00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:16.250778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ffc22-0512-472a-aecb-9e99deb10a00 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:16.251061 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ffc22-0512-472a-aecb-9e99deb10a00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:16.251416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ffc22-0512-472a-aecb-9e99deb10a00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:16.260491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ffc22-0512-472a-aecb-9e99deb10a00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:16.262102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ffc22-0512-472a-aecb-9e99deb10a00 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:16.271431 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1336/2649] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:11:16.616431 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad0ae1-6bec-49e5-971a-12ecb6ad756a None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:16.617436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b3ad0ae1-6bec-49e5-971a-12ecb6ad756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:16.636272 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ad0ae1-6bec-49e5-971a-12ecb6ad756a None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:16.636272 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b6da4-8cba-43f2-8880-07e961e024a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:16.636578 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b6da4-8cba-43f2-8880-07e961e024a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:16.636795 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b6da4-8cba-43f2-8880-07e961e024a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:16.637024 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b6da4-8cba-43f2-8880-07e961e024a7 admin admin] PATH_INFO: `/v3/projects/22e3caeaad4246b09b371c7aca184f27` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:16.638251 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b6da4-8cba-43f2-8880-07e961e024a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22e3caeaad4246b09b371c7aca184f27)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:16.640217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b6da4-8cba-43f2-8880-07e961e024a7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:16.728353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-882b6da4-8cba-43f2-8880-07e961e024a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22e3caeaad4246b09b371c7aca184f27', 'request_id': 'req-882b6da4-8cba-43f2-8880-07e961e024a7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:16.734890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-882b6da4-8cba-43f2-8880-07e961e024a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22e3caeaad4246b09b371c7aca184f27', 'request_id': 'req-882b6da4-8cba-43f2-8880-07e961e024a7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:16.740407 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-882b6da4-8cba-43f2-8880-07e961e024a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22e3caeaad4246b09b371c7aca184f27', 'request_id': 'req-882b6da4-8cba-43f2-8880-07e961e024a7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:16.807327 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-882b6da4-8cba-43f2-8880-07e961e024a7 admin admin] The token cache is being invalidate because project 22e3caeaad4246b09b371c7aca184f27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:11:16.807747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-882b6da4-8cba-43f2-8880-07e961e024a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:16.808345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-882b6da4-8cba-43f2-8880-07e961e024a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:16.809885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1314/2650] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:11:16 2022] DELETE /identity/v3/projects/22e3caeaad4246b09b371c7aca184f27 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:16.816632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a85ac-fd1a-4723-a657-7bd26a7f6090 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:16.819514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a85ac-fd1a-4723-a657-7bd26a7f6090 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:16.819514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a85ac-fd1a-4723-a657-7bd26a7f6090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:16.835543 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-d48a85ac-fd1a-4723-a657-7bd26a7f6090 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:16.836740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d48a85ac-fd1a-4723-a657-7bd26a7f6090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:16.895534 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1337/2651] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:16.903858 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd1a28-22a7-4e24-b98b-2bae3578ec7d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:16.904169 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd1a28-22a7-4e24-b98b-2bae3578ec7d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:16.904446 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd1a28-22a7-4e24-b98b-2bae3578ec7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:16.923755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-d3cd1a28-22a7-4e24-b98b-2bae3578ec7d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:16.924953 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d3cd1a28-22a7-4e24-b98b-2bae3578ec7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:16.933340 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1315/2652] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:11:16.937213 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a85ac-fd1a-4723-a657-7bd26a7f6090 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:16.946966 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a85ac-fd1a-4723-a657-7bd26a7f6090 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:16.952128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb47455-baea-47e6-97cd-7fa50a7fc097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:16.952771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb47455-baea-47e6-97cd-7fa50a7fc097 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:16.953050 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb47455-baea-47e6-97cd-7fa50a7fc097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:16.953323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb47455-baea-47e6-97cd-7fa50a7fc097 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:16.954053 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb47455-baea-47e6-97cd-7fa50a7fc097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:11:16.954356 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb47455-baea-47e6-97cd-7fa50a7fc097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:16.955990 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb47455-baea-47e6-97cd-7fa50a7fc097 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:16.968135 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1338/2653] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:11:16.972356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd1a28-22a7-4e24-b98b-2bae3578ec7d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:16.981346 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd1a28-22a7-4e24-b98b-2bae3578ec7d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:16.986013 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df886f3-9634-4c03-b6c6-1e978fec2f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:16.986641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df886f3-9634-4c03-b6c6-1e978fec2f52 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:16.986914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df886f3-9634-4c03-b6c6-1e978fec2f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:16.987210 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df886f3-9634-4c03-b6c6-1e978fec2f52 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:16.987938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df886f3-9634-4c03-b6c6-1e978fec2f52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:16.989788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df886f3-9634-4c03-b6c6-1e978fec2f52 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:17.078429 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1316/2654] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:11:16 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:11:17.082719 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb47455-baea-47e6-97cd-7fa50a7fc097 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:17.093211 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb47455-baea-47e6-97cd-7fa50a7fc097 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:17.146490 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e31343-e452-4e55-9331-7d1034d7b554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:17.147146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e31343-e452-4e55-9331-7d1034d7b554 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:17.147496 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e31343-e452-4e55-9331-7d1034d7b554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:17.147776 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e31343-e452-4e55-9331-7d1034d7b554 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:17.148484 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e31343-e452-4e55-9331-7d1034d7b554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:17.150397 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e31343-e452-4e55-9331-7d1034d7b554 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:17.208402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1339/2655] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:11:17 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:11:17.212375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df886f3-9634-4c03-b6c6-1e978fec2f52 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:17.223146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df886f3-9634-4c03-b6c6-1e978fec2f52 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:17.227859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb55f9-9bb8-45de-afa1-4236f1765e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:17.228509 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb55f9-9bb8-45de-afa1-4236f1765e6a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:17.228790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb55f9-9bb8-45de-afa1-4236f1765e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:17.229067 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb55f9-9bb8-45de-afa1-4236f1765e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:17.230040 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb55f9-9bb8-45de-afa1-4236f1765e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:17.231723 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb55f9-9bb8-45de-afa1-4236f1765e6a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:17.245982 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1317/2656] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:11:17.246953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e31343-e452-4e55-9331-7d1034d7b554 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:17.256720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e31343-e452-4e55-9331-7d1034d7b554 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:17.261821 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0aa95a-2854-467c-b492-be4c5e1b71e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:17.262441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aa95a-2854-467c-b492-be4c5e1b71e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:17.262718 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aa95a-2854-467c-b492-be4c5e1b71e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:17.262988 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0aa95a-2854-467c-b492-be4c5e1b71e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:17.263779 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0aa95a-2854-467c-b492-be4c5e1b71e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:17.265385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0aa95a-2854-467c-b492-be4c5e1b71e6 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:17.279194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1340/2657] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:11:17.280338 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb55f9-9bb8-45de-afa1-4236f1765e6a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:17.290108 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb55f9-9bb8-45de-afa1-4236f1765e6a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:17.294985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38719208-2d6f-471a-b4ca-c3cbc63b2c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:17.295866 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38719208-2d6f-471a-b4ca-c3cbc63b2c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:17.296142 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38719208-2d6f-471a-b4ca-c3cbc63b2c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:17.296410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38719208-2d6f-471a-b4ca-c3cbc63b2c55 admin admin] PATH_INFO: `/v3/projects/84867c2ca16e4b77ae92dc0fff8d69f4/users/fc1b0c409c544c1e943f921bc25148d2/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:17.310303 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38719208-2d6f-471a-b4ca-c3cbc63b2c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84867c2ca16e4b77ae92dc0fff8d69f4, user_id=fc1b0c409c544c1e943f921bc25148d2, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:17.312931 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38719208-2d6f-471a-b4ca-c3cbc63b2c55 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:17.361890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1318/2658] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:11:17 2022] PUT /identity/v3/projects/84867c2ca16e4b77ae92dc0fff8d69f4/users/fc1b0c409c544c1e943f921bc25148d2/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:17.372898 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade97ad6-d598-4391-87a9-54ce9d1d322b None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:17.373194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade97ad6-d598-4391-87a9-54ce9d1d322b None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:17.373470 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade97ad6-d598-4391-87a9-54ce9d1d322b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:17.399540 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-ade97ad6-d598-4391-87a9-54ce9d1d322b None None] MFA Rules not processed for user `fc1b0c409c544c1e943f921bc25148d2`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:17.400717 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ade97ad6-d598-4391-87a9-54ce9d1d322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:17.464631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1341/2659] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:17.468759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38719208-2d6f-471a-b4ca-c3cbc63b2c55 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:17.527395 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38719208-2d6f-471a-b4ca-c3cbc63b2c55 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:17.531951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641891a2-4ba6-49bf-8c4d-533067a76113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:17.532590 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641891a2-4ba6-49bf-8c4d-533067a76113 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:17.532870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641891a2-4ba6-49bf-8c4d-533067a76113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:17.533140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641891a2-4ba6-49bf-8c4d-533067a76113 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:17.533846 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641891a2-4ba6-49bf-8c4d-533067a76113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:17.535742 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641891a2-4ba6-49bf-8c4d-533067a76113 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:17.629305 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1319/2660] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:11:17 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:11:17.633277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade97ad6-d598-4391-87a9-54ce9d1d322b None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:17.644619 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade97ad6-d598-4391-87a9-54ce9d1d322b None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:17.697477 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf5071-4468-47cc-b4a6-c3e1807d1a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:17.698155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf5071-4468-47cc-b4a6-c3e1807d1a44 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:17.699127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf5071-4468-47cc-b4a6-c3e1807d1a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:17.699434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf5071-4468-47cc-b4a6-c3e1807d1a44 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:17.700168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf5071-4468-47cc-b4a6-c3e1807d1a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:17.702068 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf5071-4468-47cc-b4a6-c3e1807d1a44 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:17.773402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1342/2661] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:11:17 2022] POST /identity/v3/users => generated 300 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:11:17.777647 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641891a2-4ba6-49bf-8c4d-533067a76113 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:17.787582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641891a2-4ba6-49bf-8c4d-533067a76113 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:17.792766 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fa46e-808f-412d-ace7-46f92504e5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:17.793403 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fa46e-808f-412d-ace7-46f92504e5bf admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:17.793682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fa46e-808f-412d-ace7-46f92504e5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:17.793953 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31fa46e-808f-412d-ace7-46f92504e5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:17.794677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fa46e-808f-412d-ace7-46f92504e5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:17.796263 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31fa46e-808f-412d-ace7-46f92504e5bf admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:17.806224 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1320/2662] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:11:17.810899 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf5071-4468-47cc-b4a6-c3e1807d1a44 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:17.821098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf5071-4468-47cc-b4a6-c3e1807d1a44 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:17.826372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07cb94-ba27-4b80-af59-c153e2b42295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:17.827252 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07cb94-ba27-4b80-af59-c153e2b42295 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:17.827548 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07cb94-ba27-4b80-af59-c153e2b42295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:17.827825 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07cb94-ba27-4b80-af59-c153e2b42295 admin admin] PATH_INFO: `/v3/projects/b849e7b467e94a08a3b6b0eebaf97b30/users/a7698d92818440ffbf44f21a4885adc7/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:17.843289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07cb94-ba27-4b80-af59-c153e2b42295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b849e7b467e94a08a3b6b0eebaf97b30, user_id=a7698d92818440ffbf44f21a4885adc7, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:17.845917 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c07cb94-ba27-4b80-af59-c153e2b42295 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:17.910956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1343/2663] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:11:17 2022] PUT /identity/v3/projects/b849e7b467e94a08a3b6b0eebaf97b30/users/a7698d92818440ffbf44f21a4885adc7/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:17.914834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fa46e-808f-412d-ace7-46f92504e5bf admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:17.924674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31fa46e-808f-412d-ace7-46f92504e5bf admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:17.978810 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103bdd8-d719-4645-a6e9-ef5dbc5e1f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:17.979514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103bdd8-d719-4645-a6e9-ef5dbc5e1f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:17.979848 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103bdd8-d719-4645-a6e9-ef5dbc5e1f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:17.980306 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103bdd8-d719-4645-a6e9-ef5dbc5e1f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:17.981185 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103bdd8-d719-4645-a6e9-ef5dbc5e1f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:17.982899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f103bdd8-d719-4645-a6e9-ef5dbc5e1f79 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:17.992279 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1321/2664] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:11:17.996386 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07cb94-ba27-4b80-af59-c153e2b42295 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:18.006448 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c07cb94-ba27-4b80-af59-c153e2b42295 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:18.011633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f61eb9-8bd2-45ed-9a97-a36c175233a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:18.012585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f61eb9-8bd2-45ed-9a97-a36c175233a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:18.012867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f61eb9-8bd2-45ed-9a97-a36c175233a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:18.013141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f61eb9-8bd2-45ed-9a97-a36c175233a1 admin admin] PATH_INFO: `/v3/projects/b849e7b467e94a08a3b6b0eebaf97b30/users/a7698d92818440ffbf44f21a4885adc7/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:18.015116 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f61eb9-8bd2-45ed-9a97-a36c175233a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b849e7b467e94a08a3b6b0eebaf97b30, user_id=a7698d92818440ffbf44f21a4885adc7, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:18.017754 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f61eb9-8bd2-45ed-9a97-a36c175233a1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:18.028371 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1344/2665] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:11:17 2022] PUT /identity/v3/projects/b849e7b467e94a08a3b6b0eebaf97b30/users/a7698d92818440ffbf44f21a4885adc7/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:18.038917 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafc7c7-4179-41b7-a678-4fc5834eae2e None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:18.039304 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafc7c7-4179-41b7-a678-4fc5834eae2e None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:18.039656 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafc7c7-4179-41b7-a678-4fc5834eae2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:18.065206 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-acafc7c7-4179-41b7-a678-4fc5834eae2e None None] MFA Rules not processed for user `a7698d92818440ffbf44f21a4885adc7`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:18.066383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-acafc7c7-4179-41b7-a678-4fc5834eae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:18.130452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1322/2666] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:18.141314 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f61eb9-8bd2-45ed-9a97-a36c175233a1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:18.143530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-10f61eb9-8bd2-45ed-9a97-a36c175233a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:18.200031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f61eb9-8bd2-45ed-9a97-a36c175233a1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:18.203680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9888a22b-ab0a-4539-a2f3-db1310f1be1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:18.204309 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888a22b-ab0a-4539-a2f3-db1310f1be1b service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:18.204591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888a22b-ab0a-4539-a2f3-db1310f1be1b service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:18.204867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9888a22b-ab0a-4539-a2f3-db1310f1be1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:18.215189 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888a22b-ab0a-4539-a2f3-db1310f1be1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:18.216862 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9888a22b-ab0a-4539-a2f3-db1310f1be1b service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:18.226449 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1345/2667] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:18 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:11:18.254403 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafc7c7-4179-41b7-a678-4fc5834eae2e None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:18.315417 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafc7c7-4179-41b7-a678-4fc5834eae2e None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:18.320059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de987d-8e73-4617-ada0-894cbaf0959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:18.320909 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de987d-8e73-4617-ada0-894cbaf0959b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:18.321197 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de987d-8e73-4617-ada0-894cbaf0959b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:18.321472 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de987d-8e73-4617-ada0-894cbaf0959b admin admin] PATH_INFO: `/v3/users/fc1b0c409c544c1e943f921bc25148d2` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:18.322695 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de987d-8e73-4617-ada0-894cbaf0959b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1b0c409c544c1e943f921bc25148d2)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:18.324612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de987d-8e73-4617-ada0-894cbaf0959b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:18.494869 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-24de987d-8e73-4617-ada0-894cbaf0959b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1b0c409c544c1e943f921bc25148d2'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:18.495616 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-24de987d-8e73-4617-ada0-894cbaf0959b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1b0c409c544c1e943f921bc25148d2'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:18.496216 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-24de987d-8e73-4617-ada0-894cbaf0959b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1b0c409c544c1e943f921bc25148d2'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:18.507436 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-24de987d-8e73-4617-ada0-894cbaf0959b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1b0c409c544c1e943f921bc25148d2'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:18.514884 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-24de987d-8e73-4617-ada0-894cbaf0959b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1b0c409c544c1e943f921bc25148d2'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:18.573988 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1323/2668] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:11:18 2022] DELETE /identity/v3/users/fc1b0c409c544c1e943f921bc25148d2 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:18.578313 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f31002-7e03-47f3-bb8d-3f71afa633f9 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:18.578788 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f31002-7e03-47f3-bb8d-3f71afa633f9 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:18.578959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f31002-7e03-47f3-bb8d-3f71afa633f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:18.597401 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-48f31002-7e03-47f3-bb8d-3f71afa633f9 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:18.598578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-48f31002-7e03-47f3-bb8d-3f71afa633f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:18.659017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1346/2669] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:18.668963 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de987d-8e73-4617-ada0-894cbaf0959b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:18.670355 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-24de987d-8e73-4617-ada0-894cbaf0959b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:18.725595 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de987d-8e73-4617-ada0-894cbaf0959b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:18.729198 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ab485-0a8a-4c9d-8a1c-d6e3a0fd633c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:18.729934 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ab485-0a8a-4c9d-8a1c-d6e3a0fd633c service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:18.730207 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ab485-0a8a-4c9d-8a1c-d6e3a0fd633c service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:18.730480 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ab485-0a8a-4c9d-8a1c-d6e3a0fd633c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:18.739009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ab485-0a8a-4c9d-8a1c-d6e3a0fd633c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:18.740446 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ab485-0a8a-4c9d-8a1c-d6e3a0fd633c service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:18.749392 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1324/2670] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:11:19.090147 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f31002-7e03-47f3-bb8d-3f71afa633f9 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:19.091920 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-48f31002-7e03-47f3-bb8d-3f71afa633f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:19.106340 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f31002-7e03-47f3-bb8d-3f71afa633f9 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:19.112322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:19.117482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:19.117482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:19.117482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] PATH_INFO: `/v3/projects/84867c2ca16e4b77ae92dc0fff8d69f4` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:19.117482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84867c2ca16e4b77ae92dc0fff8d69f4)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:19.117482 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:19.202595 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84867c2ca16e4b77ae92dc0fff8d69f4', 'request_id': 'req-4cf8a52b-cbbd-4644-be94-aafe920ad631'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:19.259868 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84867c2ca16e4b77ae92dc0fff8d69f4', 'request_id': 'req-4cf8a52b-cbbd-4644-be94-aafe920ad631'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:19.265822 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84867c2ca16e4b77ae92dc0fff8d69f4', 'request_id': 'req-4cf8a52b-cbbd-4644-be94-aafe920ad631'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:19.276855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] The token cache is being invalidate because project 84867c2ca16e4b77ae92dc0fff8d69f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:11:19.277142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:19.277792 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:19.279388 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1347/2671] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:11:19 2022] DELETE /identity/v3/projects/84867c2ca16e4b77ae92dc0fff8d69f4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:19.283373 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ab485-0a8a-4c9d-8a1c-d6e3a0fd633c service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:19.292799 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ab485-0a8a-4c9d-8a1c-d6e3a0fd633c service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:19.348126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d8c0e-6ecb-475c-a8a4-234137c842e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:19.349037 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d8c0e-6ecb-475c-a8a4-234137c842e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:19.349320 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d8c0e-6ecb-475c-a8a4-234137c842e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:19.349591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d8c0e-6ecb-475c-a8a4-234137c842e3 admin admin] PATH_INFO: `/v3/users/a7698d92818440ffbf44f21a4885adc7` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:19.350797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d8c0e-6ecb-475c-a8a4-234137c842e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7698d92818440ffbf44f21a4885adc7)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:19.352718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d8c0e-6ecb-475c-a8a4-234137c842e3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:19.490092 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-001d8c0e-6ecb-475c-a8a4-234137c842e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7698d92818440ffbf44f21a4885adc7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:19.490741 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-001d8c0e-6ecb-475c-a8a4-234137c842e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7698d92818440ffbf44f21a4885adc7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:19.491415 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-001d8c0e-6ecb-475c-a8a4-234137c842e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7698d92818440ffbf44f21a4885adc7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:19.503356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-001d8c0e-6ecb-475c-a8a4-234137c842e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7698d92818440ffbf44f21a4885adc7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:19.509786 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-001d8c0e-6ecb-475c-a8a4-234137c842e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7698d92818440ffbf44f21a4885adc7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:19.568063 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1325/2672] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:11:19 2022] DELETE /identity/v3/users/a7698d92818440ffbf44f21a4885adc7 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:19.947709 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:19.949361 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:19.968032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8a52b-cbbd-4644-be94-aafe920ad631 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:20.025513 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d226117-0c4a-4def-b0ff-c03aa93c1730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:20.026366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d226117-0c4a-4def-b0ff-c03aa93c1730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:20.026645 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d226117-0c4a-4def-b0ff-c03aa93c1730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:20.026940 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d226117-0c4a-4def-b0ff-c03aa93c1730 admin admin] PATH_INFO: `/v3/projects/b849e7b467e94a08a3b6b0eebaf97b30` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:20.028770 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d226117-0c4a-4def-b0ff-c03aa93c1730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b849e7b467e94a08a3b6b0eebaf97b30)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:20.030700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d226117-0c4a-4def-b0ff-c03aa93c1730 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:20.128749 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4d226117-0c4a-4def-b0ff-c03aa93c1730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b849e7b467e94a08a3b6b0eebaf97b30', 'request_id': 'req-4d226117-0c4a-4def-b0ff-c03aa93c1730'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:20.168150 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4d226117-0c4a-4def-b0ff-c03aa93c1730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b849e7b467e94a08a3b6b0eebaf97b30', 'request_id': 'req-4d226117-0c4a-4def-b0ff-c03aa93c1730'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:20.173884 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4d226117-0c4a-4def-b0ff-c03aa93c1730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b849e7b467e94a08a3b6b0eebaf97b30', 'request_id': 'req-4d226117-0c4a-4def-b0ff-c03aa93c1730'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:20.185198 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4d226117-0c4a-4def-b0ff-c03aa93c1730 admin admin] The token cache is being invalidate because project b849e7b467e94a08a3b6b0eebaf97b30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:11:20.185477 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4d226117-0c4a-4def-b0ff-c03aa93c1730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:20.186098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4d226117-0c4a-4def-b0ff-c03aa93c1730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:20.187661 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1348/2673] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:11:19 2022] DELETE /identity/v3/projects/b849e7b467e94a08a3b6b0eebaf97b30 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:11:20.192729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0978176-9d00-4402-b340-a6b0cadfb129 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:20.192951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0978176-9d00-4402-b340-a6b0cadfb129 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:20.193228 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0978176-9d00-4402-b340-a6b0cadfb129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:20.211045 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-b0978176-9d00-4402-b340-a6b0cadfb129 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:20.212271 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b0978176-9d00-4402-b340-a6b0cadfb129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:20.268962 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1326/2674] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:20.276616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822bf00-59ab-4c9b-b2cb-72e5c60e8ff7 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:20.276902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822bf00-59ab-4c9b-b2cb-72e5c60e8ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:20.277173 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822bf00-59ab-4c9b-b2cb-72e5c60e8ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:20.296347 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-a822bf00-59ab-4c9b-b2cb-72e5c60e8ff7 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:20.297520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a822bf00-59ab-4c9b-b2cb-72e5c60e8ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:20.305227 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1349/2675] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:20.309467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0978176-9d00-4402-b340-a6b0cadfb129 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:20.318980 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0978176-9d00-4402-b340-a6b0cadfb129 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:20.323560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9e274-f432-4f04-84f8-6c19847f343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:20.324199 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e274-f432-4f04-84f8-6c19847f343e admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:20.324483 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e274-f432-4f04-84f8-6c19847f343e admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:20.324781 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f9e274-f432-4f04-84f8-6c19847f343e admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:20.325734 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9e274-f432-4f04-84f8-6c19847f343e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:11:20.326045 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9e274-f432-4f04-84f8-6c19847f343e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:20.327660 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f9e274-f432-4f04-84f8-6c19847f343e admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:20.338981 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1327/2676] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:11:20.343830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822bf00-59ab-4c9b-b2cb-72e5c60e8ff7 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:20.352696 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822bf00-59ab-4c9b-b2cb-72e5c60e8ff7 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:20.358115 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f6989-c55f-48ec-898a-9d0f724baadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:20.358745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f6989-c55f-48ec-898a-9d0f724baadd admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:20.359020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f6989-c55f-48ec-898a-9d0f724baadd admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:20.359327 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f6989-c55f-48ec-898a-9d0f724baadd admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:20.360032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f6989-c55f-48ec-898a-9d0f724baadd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:20.361899 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f6989-c55f-48ec-898a-9d0f724baadd admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:20.425221 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1350/2677] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:11:20 2022] POST /identity/v3/projects => generated 385 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:11:20.426788 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9e274-f432-4f04-84f8-6c19847f343e admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:20.437231 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f9e274-f432-4f04-84f8-6c19847f343e admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:20.490742 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb994403-54a2-4691-ac08-af487a115b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:20.491350 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb994403-54a2-4691-ac08-af487a115b91 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:20.491637 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb994403-54a2-4691-ac08-af487a115b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:20.491914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb994403-54a2-4691-ac08-af487a115b91 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:20.492636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb994403-54a2-4691-ac08-af487a115b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:20.494527 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb994403-54a2-4691-ac08-af487a115b91 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:20.574117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1328/2678] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:11:20 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:11:20.578977 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f6989-c55f-48ec-898a-9d0f724baadd admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:20.589431 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f6989-c55f-48ec-898a-9d0f724baadd admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:20.594214 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dd9f2-c9fc-4293-b283-dd0dc24ca2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:20.594860 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dd9f2-c9fc-4293-b283-dd0dc24ca2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:20.595167 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dd9f2-c9fc-4293-b283-dd0dc24ca2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:20.595490 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7dd9f2-c9fc-4293-b283-dd0dc24ca2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:20.596241 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dd9f2-c9fc-4293-b283-dd0dc24ca2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:20.597820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7dd9f2-c9fc-4293-b283-dd0dc24ca2a3 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:20.608190 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1351/2679] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:11:20.612067 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb994403-54a2-4691-ac08-af487a115b91 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:20.622299 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb994403-54a2-4691-ac08-af487a115b91 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:20.627117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d789862f-a5b1-4e02-9378-9b12de4c88b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:20.627790 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789862f-a5b1-4e02-9378-9b12de4c88b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:20.628073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789862f-a5b1-4e02-9378-9b12de4c88b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:20.628344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d789862f-a5b1-4e02-9378-9b12de4c88b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:20.629074 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789862f-a5b1-4e02-9378-9b12de4c88b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:20.630671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d789862f-a5b1-4e02-9378-9b12de4c88b8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:20.641375 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1329/2680] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:11:20.645291 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dd9f2-c9fc-4293-b283-dd0dc24ca2a3 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:20.655090 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7dd9f2-c9fc-4293-b283-dd0dc24ca2a3 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:20.659769 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a799d-8853-4129-881a-16f14e65d581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:20.660630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a799d-8853-4129-881a-16f14e65d581 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:20.660909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a799d-8853-4129-881a-16f14e65d581 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:20.661186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a799d-8853-4129-881a-16f14e65d581 admin admin] PATH_INFO: `/v3/projects/fb1c6ea7002342b6a9d369cfa7d02001/users/a201245629544c6f85e0ca71b4a51f37/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:20.676071 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a799d-8853-4129-881a-16f14e65d581 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb1c6ea7002342b6a9d369cfa7d02001, user_id=a201245629544c6f85e0ca71b4a51f37, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:20.678703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a799d-8853-4129-881a-16f14e65d581 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:20.744891 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1352/2681] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:11:20 2022] PUT /identity/v3/projects/fb1c6ea7002342b6a9d369cfa7d02001/users/a201245629544c6f85e0ca71b4a51f37/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:11:20.757078 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c6f25-01e3-48fd-aff7-2ae7f8a662ac None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:20.757369 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c6f25-01e3-48fd-aff7-2ae7f8a662ac None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:20.757645 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c6f25-01e3-48fd-aff7-2ae7f8a662ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:20.782976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-b99c6f25-01e3-48fd-aff7-2ae7f8a662ac None None] MFA Rules not processed for user `a201245629544c6f85e0ca71b4a51f37`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:20.784226 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b99c6f25-01e3-48fd-aff7-2ae7f8a662ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:20.844997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1330/2682] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:20.849299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a799d-8853-4129-881a-16f14e65d581 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:20.909456 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a799d-8853-4129-881a-16f14e65d581 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:20.914083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5692cdc-5755-4370-91de-bb0baeb569a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:20.914720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5692cdc-5755-4370-91de-bb0baeb569a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:20.914998 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5692cdc-5755-4370-91de-bb0baeb569a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:20.915298 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5692cdc-5755-4370-91de-bb0baeb569a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:20.916002 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5692cdc-5755-4370-91de-bb0baeb569a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:20.917871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5692cdc-5755-4370-91de-bb0baeb569a7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:21.010248 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1353/2683] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:11:20 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:11:21.014417 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c6f25-01e3-48fd-aff7-2ae7f8a662ac None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:21.025591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c6f25-01e3-48fd-aff7-2ae7f8a662ac None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:21.080617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777515b-8082-4d22-879e-b3586ed6e08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:21.081267 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777515b-8082-4d22-879e-b3586ed6e08f admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:21.081545 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777515b-8082-4d22-879e-b3586ed6e08f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:21.081814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777515b-8082-4d22-879e-b3586ed6e08f admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:21.082781 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777515b-8082-4d22-879e-b3586ed6e08f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:21.084694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777515b-8082-4d22-879e-b3586ed6e08f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:21.157301 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1331/2684] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:11:21 2022] POST /identity/v3/users => generated 294 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:11:21.161357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5692cdc-5755-4370-91de-bb0baeb569a7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:21.172555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5692cdc-5755-4370-91de-bb0baeb569a7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:21.177153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fabc67-edb7-437c-a207-b376d2d12a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:21.177861 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fabc67-edb7-437c-a207-b376d2d12a25 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:21.178181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fabc67-edb7-437c-a207-b376d2d12a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:21.178443 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fabc67-edb7-437c-a207-b376d2d12a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:21.179249 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fabc67-edb7-437c-a207-b376d2d12a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:21.180962 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fabc67-edb7-437c-a207-b376d2d12a25 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:21.191375 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1354/2685] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:11:21.195330 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777515b-8082-4d22-879e-b3586ed6e08f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:21.205132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777515b-8082-4d22-879e-b3586ed6e08f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:21.209980 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a00fb0-efcb-43a0-9ae1-07cfe663a9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:21.210623 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a00fb0-efcb-43a0-9ae1-07cfe663a9db admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:21.210904 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a00fb0-efcb-43a0-9ae1-07cfe663a9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:21.211182 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a00fb0-efcb-43a0-9ae1-07cfe663a9db admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:21.211970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a00fb0-efcb-43a0-9ae1-07cfe663a9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:21.213531 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a00fb0-efcb-43a0-9ae1-07cfe663a9db admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:21.224585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1332/2686] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:11:21.228106 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fabc67-edb7-437c-a207-b376d2d12a25 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:21.238812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fabc67-edb7-437c-a207-b376d2d12a25 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:21.243441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ff97b-6e12-4a09-81a3-4b8028137ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:21.244301 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ff97b-6e12-4a09-81a3-4b8028137ecc admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:21.244608 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ff97b-6e12-4a09-81a3-4b8028137ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:21.244882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ff97b-6e12-4a09-81a3-4b8028137ecc admin admin] PATH_INFO: `/v3/projects/ac99e5e755c349f7977c51017ff5c331/users/c85d00da24c2413da8dc9bedca4ae3f5/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:21.259044 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ff97b-6e12-4a09-81a3-4b8028137ecc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac99e5e755c349f7977c51017ff5c331, user_id=c85d00da24c2413da8dc9bedca4ae3f5, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:21.261746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ff97b-6e12-4a09-81a3-4b8028137ecc admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:21.328083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1355/2687] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:11:21 2022] PUT /identity/v3/projects/ac99e5e755c349f7977c51017ff5c331/users/c85d00da24c2413da8dc9bedca4ae3f5/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:21.338413 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891690dd-1ed3-48e3-a786-48b279eebcf2 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:21.338868 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891690dd-1ed3-48e3-a786-48b279eebcf2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:21.338980 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891690dd-1ed3-48e3-a786-48b279eebcf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:21.365170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-891690dd-1ed3-48e3-a786-48b279eebcf2 None None] MFA Rules not processed for user `c85d00da24c2413da8dc9bedca4ae3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:21.366327 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-891690dd-1ed3-48e3-a786-48b279eebcf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:21.426665 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1333/2688] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:21.431063 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ff97b-6e12-4a09-81a3-4b8028137ecc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:21.490871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ff97b-6e12-4a09-81a3-4b8028137ecc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:21.495626 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95819cb0-11db-4c89-aad8-5b53dfc8073d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:21.496272 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95819cb0-11db-4c89-aad8-5b53dfc8073d admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:21.496657 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95819cb0-11db-4c89-aad8-5b53dfc8073d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:21.496935 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95819cb0-11db-4c89-aad8-5b53dfc8073d admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:21.497649 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95819cb0-11db-4c89-aad8-5b53dfc8073d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:21.499564 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95819cb0-11db-4c89-aad8-5b53dfc8073d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:21.575515 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1356/2689] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:11:21 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:11:21.579674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891690dd-1ed3-48e3-a786-48b279eebcf2 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:21.591376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891690dd-1ed3-48e3-a786-48b279eebcf2 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:21.644957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083120fa-9e0a-48fd-b375-688a96577657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:21.645612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083120fa-9e0a-48fd-b375-688a96577657 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:21.645895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083120fa-9e0a-48fd-b375-688a96577657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:21.646173 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083120fa-9e0a-48fd-b375-688a96577657 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:21.646882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083120fa-9e0a-48fd-b375-688a96577657 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:21.648819 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083120fa-9e0a-48fd-b375-688a96577657 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:21.705651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1334/2690] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:11:21 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:11:21.710019 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95819cb0-11db-4c89-aad8-5b53dfc8073d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:21.720695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95819cb0-11db-4c89-aad8-5b53dfc8073d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:21.725224 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46cc63-6489-4ae4-9c7e-88c478ce768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:21.725864 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46cc63-6489-4ae4-9c7e-88c478ce768d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:21.726144 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46cc63-6489-4ae4-9c7e-88c478ce768d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:21.726416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46cc63-6489-4ae4-9c7e-88c478ce768d admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:21.727182 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46cc63-6489-4ae4-9c7e-88c478ce768d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:21.728827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46cc63-6489-4ae4-9c7e-88c478ce768d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:21.739354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1357/2691] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:11:21.743357 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083120fa-9e0a-48fd-b375-688a96577657 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:21.753050 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083120fa-9e0a-48fd-b375-688a96577657 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:21.757591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377fb79-55e6-4928-a144-3bc5e786acf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:21.758449 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377fb79-55e6-4928-a144-3bc5e786acf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:21.758725 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377fb79-55e6-4928-a144-3bc5e786acf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:21.758994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4377fb79-55e6-4928-a144-3bc5e786acf8 admin admin] PATH_INFO: `/v3/projects/8816c959b1ad4e349b653144b62eaca9/users/d13f6dbedad944108bcde32c549c45cc/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:21.773755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377fb79-55e6-4928-a144-3bc5e786acf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8816c959b1ad4e349b653144b62eaca9, user_id=d13f6dbedad944108bcde32c549c45cc, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:21.776450 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4377fb79-55e6-4928-a144-3bc5e786acf8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:21.831314 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1335/2692] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:11:21 2022] PUT /identity/v3/projects/8816c959b1ad4e349b653144b62eaca9/users/d13f6dbedad944108bcde32c549c45cc/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:21.835360 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46cc63-6489-4ae4-9c7e-88c478ce768d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:21.845397 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46cc63-6489-4ae4-9c7e-88c478ce768d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:21.900322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd32a29-d66b-4335-b5a3-d2be3ab9b6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:21.900972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd32a29-d66b-4335-b5a3-d2be3ab9b6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:21.901256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd32a29-d66b-4335-b5a3-d2be3ab9b6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:21.901528 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd32a29-d66b-4335-b5a3-d2be3ab9b6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:21.902260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd32a29-d66b-4335-b5a3-d2be3ab9b6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:21.903947 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd32a29-d66b-4335-b5a3-d2be3ab9b6f8 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:21.913456 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1358/2693] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:11:21.917518 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377fb79-55e6-4928-a144-3bc5e786acf8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:21.927851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4377fb79-55e6-4928-a144-3bc5e786acf8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:21.932489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacd94a-95ad-49b9-9cec-28795b927695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:21.933353 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacd94a-95ad-49b9-9cec-28795b927695 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:21.933634 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacd94a-95ad-49b9-9cec-28795b927695 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:21.933905 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baacd94a-95ad-49b9-9cec-28795b927695 admin admin] PATH_INFO: `/v3/projects/8816c959b1ad4e349b653144b62eaca9/users/d13f6dbedad944108bcde32c549c45cc/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:21.936492 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baacd94a-95ad-49b9-9cec-28795b927695 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8816c959b1ad4e349b653144b62eaca9, user_id=d13f6dbedad944108bcde32c549c45cc, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:21.939084 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baacd94a-95ad-49b9-9cec-28795b927695 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:21.949015 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1336/2694] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:11:21 2022] PUT /identity/v3/projects/8816c959b1ad4e349b653144b62eaca9/users/d13f6dbedad944108bcde32c549c45cc/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:11:21.959910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1eb18-ef19-4042-a620-d4422a65c1ae None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:21.960199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1eb18-ef19-4042-a620-d4422a65c1ae None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:21.960481 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1eb18-ef19-4042-a620-d4422a65c1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:21.986154 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-5ae1eb18-ef19-4042-a620-d4422a65c1ae None None] MFA Rules not processed for user `d13f6dbedad944108bcde32c549c45cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:21.987420 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5ae1eb18-ef19-4042-a620-d4422a65c1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:22.052125 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1359/2695] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:22.062013 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacd94a-95ad-49b9-9cec-28795b927695 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:22.063701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-baacd94a-95ad-49b9-9cec-28795b927695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:22.120084 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baacd94a-95ad-49b9-9cec-28795b927695 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:22.124555 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc251a71-b214-41e0-a5ca-9a8a69f17f97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:22.125185 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc251a71-b214-41e0-a5ca-9a8a69f17f97 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:22.125463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc251a71-b214-41e0-a5ca-9a8a69f17f97 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:22.125733 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc251a71-b214-41e0-a5ca-9a8a69f17f97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:22.134524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc251a71-b214-41e0-a5ca-9a8a69f17f97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:22.135947 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc251a71-b214-41e0-a5ca-9a8a69f17f97 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:22.145902 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1337/2696] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:11:22.977224 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1eb18-ef19-4042-a620-d4422a65c1ae None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:22.981125 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-5ae1eb18-ef19-4042-a620-d4422a65c1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:22.990982 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1eb18-ef19-4042-a620-d4422a65c1ae None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:22.994742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32129705-942e-45f8-91e9-0705c93671f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:22.995413 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32129705-942e-45f8-91e9-0705c93671f1 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:22.999661 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32129705-942e-45f8-91e9-0705c93671f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:22.999661 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32129705-942e-45f8-91e9-0705c93671f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:23.057484 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32129705-942e-45f8-91e9-0705c93671f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:23.058928 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32129705-942e-45f8-91e9-0705c93671f1 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:23.070300 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1360/2697] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:11:23.078787 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc251a71-b214-41e0-a5ca-9a8a69f17f97 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:23.080715 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-dc251a71-b214-41e0-a5ca-9a8a69f17f97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:23.230390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc251a71-b214-41e0-a5ca-9a8a69f17f97 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:23.241666 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc47fb-d949-425a-a0de-38ff603487d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:23.242591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc47fb-d949-425a-a0de-38ff603487d2 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:23.243081 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc47fb-d949-425a-a0de-38ff603487d2 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:23.243885 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc47fb-d949-425a-a0de-38ff603487d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:23.245842 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-5fdc47fb-d949-425a-a0de-38ff603487d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:23.270673 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc47fb-d949-425a-a0de-38ff603487d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:23.273669 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc47fb-d949-425a-a0de-38ff603487d2 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:23.292226 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1338/2698] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:11:24.663206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32129705-942e-45f8-91e9-0705c93671f1 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:24.676303 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32129705-942e-45f8-91e9-0705c93671f1 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:24.682294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3552a-be6e-4c7b-bfeb-f7ca0bb59e5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:24.683396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3552a-be6e-4c7b-bfeb-f7ca0bb59e5b service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:24.683680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3552a-be6e-4c7b-bfeb-f7ca0bb59e5b service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:24.683953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3552a-be6e-4c7b-bfeb-f7ca0bb59e5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:24.686260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2ec3552a-be6e-4c7b-bfeb-f7ca0bb59e5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:24.698922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3552a-be6e-4c7b-bfeb-f7ca0bb59e5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:24.701246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3552a-be6e-4c7b-bfeb-f7ca0bb59e5b service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:24.712339 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1361/2699] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:11:27.877648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc47fb-d949-425a-a0de-38ff603487d2 service nova] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:27.887083 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc47fb-d949-425a-a0de-38ff603487d2 service nova] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:27.891724 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb3afb-1d00-4397-9134-3e6897b325d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:27.892345 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb3afb-1d00-4397-9134-3e6897b325d4 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:27.892623 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb3afb-1d00-4397-9134-3e6897b325d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:27.892892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb3afb-1d00-4397-9134-3e6897b325d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:27.946101 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb3afb-1d00-4397-9134-3e6897b325d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:27.947464 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb3afb-1d00-4397-9134-3e6897b325d4 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:27.956695 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1339/2700] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:11:30.962449 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc780ae2-10f3-4aaa-8715-63357d4e8d17 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:30.962933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc780ae2-10f3-4aaa-8715-63357d4e8d17 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:30.963364 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc780ae2-10f3-4aaa-8715-63357d4e8d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:30.982531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-fc780ae2-10f3-4aaa-8715-63357d4e8d17 None None] MFA Rules not processed for user `560fd9efb8a04f449acaf2f3987ce81c`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:30.983691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-fc780ae2-10f3-4aaa-8715-63357d4e8d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:31.036257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1362/2701] 10.222.0.35 () {58 vars in 967 bytes} [Sat Feb 12 05:11:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:31.076923 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb3afb-1d00-4397-9134-3e6897b325d4 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:31.078335 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9dfb3afb-1d00-4397-9134-3e6897b325d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:31.146919 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb3afb-1d00-4397-9134-3e6897b325d4 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:31.152029 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a8b77-9622-4a84-8ff2-5a45d1eaf3fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3b37a10e3b5e404db7aad72e1772a2de', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:31.152708 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a8b77-9622-4a84-8ff2-5a45d1eaf3fe service swift] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:31.152989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a8b77-9622-4a84-8ff2-5a45d1eaf3fe service swift] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:31.153263 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a8b77-9622-4a84-8ff2-5a45d1eaf3fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:31.161379 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a8b77-9622-4a84-8ff2-5a45d1eaf3fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:31.162928 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a8b77-9622-4a84-8ff2-5a45d1eaf3fe service swift] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:31.171154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1340/2702] 10.222.0.35 () {60 vars in 1384 bytes} [Sat Feb 12 05:11:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Feb 12 05:11:31.713302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc780ae2-10f3-4aaa-8715-63357d4e8d17 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:31.774904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc780ae2-10f3-4aaa-8715-63357d4e8d17 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:31.779976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478b951-6379-41a3-b441-1c7641635b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:31.780873 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478b951-6379-41a3-b441-1c7641635b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:31.781107 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478b951-6379-41a3-b441-1c7641635b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:31.781382 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c478b951-6379-41a3-b441-1c7641635b85 admin admin] PATH_INFO: `/v3/users/a201245629544c6f85e0ca71b4a51f37` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:31.782563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478b951-6379-41a3-b441-1c7641635b85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a201245629544c6f85e0ca71b4a51f37)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:31.784499 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c478b951-6379-41a3-b441-1c7641635b85 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:31.965457 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c478b951-6379-41a3-b441-1c7641635b85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a201245629544c6f85e0ca71b4a51f37'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:31.966859 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c478b951-6379-41a3-b441-1c7641635b85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a201245629544c6f85e0ca71b4a51f37'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:31.967611 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c478b951-6379-41a3-b441-1c7641635b85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a201245629544c6f85e0ca71b4a51f37'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:31.979308 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c478b951-6379-41a3-b441-1c7641635b85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a201245629544c6f85e0ca71b4a51f37'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:31.986143 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-c478b951-6379-41a3-b441-1c7641635b85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a201245629544c6f85e0ca71b4a51f37'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:32.060508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1363/2703] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:11:31 2022] DELETE /identity/v3/users/a201245629544c6f85e0ca71b4a51f37 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:32.068993 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1e9a6-590f-4c71-b8e3-05fd5b61e053 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:32.069321 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1e9a6-590f-4c71-b8e3-05fd5b61e053 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:32.069591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1e9a6-590f-4c71-b8e3-05fd5b61e053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:32.087174 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-aaa1e9a6-590f-4c71-b8e3-05fd5b61e053 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:32.088385 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-aaa1e9a6-590f-4c71-b8e3-05fd5b61e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:32.146387 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1341/2704] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:32.157067 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478b951-6379-41a3-b441-1c7641635b85 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:32.158512 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c478b951-6379-41a3-b441-1c7641635b85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:32.217598 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c478b951-6379-41a3-b441-1c7641635b85 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:32.221437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72884ac8-02d4-4ce5-be2f-9fd17f20c253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:32.222074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72884ac8-02d4-4ce5-be2f-9fd17f20c253 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:32.222352 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72884ac8-02d4-4ce5-be2f-9fd17f20c253 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:32.222622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72884ac8-02d4-4ce5-be2f-9fd17f20c253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:32.232734 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72884ac8-02d4-4ce5-be2f-9fd17f20c253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:32.234200 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72884ac8-02d4-4ce5-be2f-9fd17f20c253 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:32.244029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1364/2705] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:11:32.753286 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1e9a6-590f-4c71-b8e3-05fd5b61e053 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:32.754764 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-aaa1e9a6-590f-4c71-b8e3-05fd5b61e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:32.766589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1e9a6-590f-4c71-b8e3-05fd5b61e053 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:32.771447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:32.772323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:32.772687 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:32.772959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] PATH_INFO: `/v3/projects/fb1c6ea7002342b6a9d369cfa7d02001` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:32.774157 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb1c6ea7002342b6a9d369cfa7d02001)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:32.776077 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:32.859977 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb1c6ea7002342b6a9d369cfa7d02001', 'request_id': 'req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:32.865913 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb1c6ea7002342b6a9d369cfa7d02001', 'request_id': 'req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:32.871811 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb1c6ea7002342b6a9d369cfa7d02001', 'request_id': 'req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:32.916031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] The token cache is being invalidate because project fb1c6ea7002342b6a9d369cfa7d02001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:11:32.916318 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:32.916968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:32.918500 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1342/2706] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:11:32 2022] DELETE /identity/v3/projects/fb1c6ea7002342b6a9d369cfa7d02001 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:32.923007 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72884ac8-02d4-4ce5-be2f-9fd17f20c253 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:32.932595 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72884ac8-02d4-4ce5-be2f-9fd17f20c253 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:32.988490 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774be05-9a62-4f7c-a764-afa4f71396d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:32.989368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774be05-9a62-4f7c-a764-afa4f71396d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:32.989648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774be05-9a62-4f7c-a764-afa4f71396d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:32.989907 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774be05-9a62-4f7c-a764-afa4f71396d2 admin admin] PATH_INFO: `/v3/users/c85d00da24c2413da8dc9bedca4ae3f5` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:32.991128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774be05-9a62-4f7c-a764-afa4f71396d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c85d00da24c2413da8dc9bedca4ae3f5)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:32.993115 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774be05-9a62-4f7c-a764-afa4f71396d2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:33.139054 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e774be05-9a62-4f7c-a764-afa4f71396d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c85d00da24c2413da8dc9bedca4ae3f5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:33.139771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e774be05-9a62-4f7c-a764-afa4f71396d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c85d00da24c2413da8dc9bedca4ae3f5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:33.140703 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e774be05-9a62-4f7c-a764-afa4f71396d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c85d00da24c2413da8dc9bedca4ae3f5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:33.154343 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e774be05-9a62-4f7c-a764-afa4f71396d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c85d00da24c2413da8dc9bedca4ae3f5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:33.161390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e774be05-9a62-4f7c-a764-afa4f71396d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c85d00da24c2413da8dc9bedca4ae3f5'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:33.226372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1365/2707] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:11:32 2022] DELETE /identity/v3/users/c85d00da24c2413da8dc9bedca4ae3f5 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:34.005240 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:34.009695 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:34.023193 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23739d-eaea-4cf0-a5c9-c4ae05e81b5c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:34.096181 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:34.097232 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:34.097512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:34.097789 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] PATH_INFO: `/v3/projects/ac99e5e755c349f7977c51017ff5c331` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:34.099027 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac99e5e755c349f7977c51017ff5c331)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:34.101283 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:34.197352 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac99e5e755c349f7977c51017ff5c331', 'request_id': 'req-a1c71a12-a009-4470-b470-c6b2636c0b00'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:34.203765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac99e5e755c349f7977c51017ff5c331', 'request_id': 'req-a1c71a12-a009-4470-b470-c6b2636c0b00'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:34.210187 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac99e5e755c349f7977c51017ff5c331', 'request_id': 'req-a1c71a12-a009-4470-b470-c6b2636c0b00'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:34.270490 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] The token cache is being invalidate because project ac99e5e755c349f7977c51017ff5c331 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:11:34.271051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:34.271857 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:34.273922 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1343/2708] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:11:34 2022] DELETE /identity/v3/projects/ac99e5e755c349f7977c51017ff5c331 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:34.278123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774be05-9a62-4f7c-a764-afa4f71396d2 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:34.280017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e774be05-9a62-4f7c-a764-afa4f71396d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:34.293307 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774be05-9a62-4f7c-a764-afa4f71396d2 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:34.351197 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374a34d-a7d8-4f63-9a7e-2b59c2c10efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:34.352157 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a34d-a7d8-4f63-9a7e-2b59c2c10efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:34.352444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a34d-a7d8-4f63-9a7e-2b59c2c10efe admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:34.352726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374a34d-a7d8-4f63-9a7e-2b59c2c10efe admin admin] PATH_INFO: `/v3/users/d13f6dbedad944108bcde32c549c45cc` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:34.354025 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a34d-a7d8-4f63-9a7e-2b59c2c10efe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d13f6dbedad944108bcde32c549c45cc)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:34.356008 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374a34d-a7d8-4f63-9a7e-2b59c2c10efe admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:34.553336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8374a34d-a7d8-4f63-9a7e-2b59c2c10efe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd13f6dbedad944108bcde32c549c45cc'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:34.553984 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8374a34d-a7d8-4f63-9a7e-2b59c2c10efe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd13f6dbedad944108bcde32c549c45cc'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:34.554591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8374a34d-a7d8-4f63-9a7e-2b59c2c10efe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd13f6dbedad944108bcde32c549c45cc'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:34.566581 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8374a34d-a7d8-4f63-9a7e-2b59c2c10efe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd13f6dbedad944108bcde32c549c45cc'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:34.574273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-8374a34d-a7d8-4f63-9a7e-2b59c2c10efe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd13f6dbedad944108bcde32c549c45cc'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:34.642325 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1366/2709] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:11:34 2022] DELETE /identity/v3/users/d13f6dbedad944108bcde32c549c45cc => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:35.159568 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:35.160296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:35.174759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c71a12-a009-4470-b470-c6b2636c0b00 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:35.244980 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:35.245840 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:35.246132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:35.246486 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a admin admin] PATH_INFO: `/v3/projects/8816c959b1ad4e349b653144b62eaca9` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:35.248283 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8816c959b1ad4e349b653144b62eaca9)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:35.250608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:35.403330 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8816c959b1ad4e349b653144b62eaca9', 'request_id': 'req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:35.415532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8816c959b1ad4e349b653144b62eaca9', 'request_id': 'req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:35.430535 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8816c959b1ad4e349b653144b62eaca9', 'request_id': 'req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:35.522612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a admin admin] The token cache is being invalidate because project 8816c959b1ad4e349b653144b62eaca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:11:35.523808 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:35.524989 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-6eb2cd9f-dac4-49de-82ee-1badb3d6ac3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:35.526804 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1344/2710] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:11:35 2022] DELETE /identity/v3/projects/8816c959b1ad4e349b653144b62eaca9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:35.533273 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4130f-2992-4a74-9176-fd9568783a8d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:35.533767 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4130f-2992-4a74-9176-fd9568783a8d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:35.533888 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4130f-2992-4a74-9176-fd9568783a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:35.552642 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-ecd4130f-2992-4a74-9176-fd9568783a8d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:35.554159 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-ecd4130f-2992-4a74-9176-fd9568783a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:35.631434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1367/2711] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:35.686848 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a23c9f-372e-4439-9436-f20b369fcb08 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:35.687140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a23c9f-372e-4439-9436-f20b369fcb08 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:35.688202 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a23c9f-372e-4439-9436-f20b369fcb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:35.714543 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-a3a23c9f-372e-4439-9436-f20b369fcb08 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:35.715743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a3a23c9f-372e-4439-9436-f20b369fcb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:35.724073 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1345/2712] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:35.728288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4130f-2992-4a74-9176-fd9568783a8d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:35.739317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4130f-2992-4a74-9176-fd9568783a8d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:35.744934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad056cf8-dbbc-49ec-a974-0de9dc10a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:35.745633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad056cf8-dbbc-49ec-a974-0de9dc10a55a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:35.745919 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad056cf8-dbbc-49ec-a974-0de9dc10a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:35.746187 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad056cf8-dbbc-49ec-a974-0de9dc10a55a admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:35.747204 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad056cf8-dbbc-49ec-a974-0de9dc10a55a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:11:35.747558 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad056cf8-dbbc-49ec-a974-0de9dc10a55a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:35.749170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad056cf8-dbbc-49ec-a974-0de9dc10a55a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:35.761390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1368/2713] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:11:35.766390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a23c9f-372e-4439-9436-f20b369fcb08 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:35.785224 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a23c9f-372e-4439-9436-f20b369fcb08 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:35.790424 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81829-a980-4835-9fa0-6ac3c74745b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:35.791159 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81829-a980-4835-9fa0-6ac3c74745b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:35.791532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81829-a980-4835-9fa0-6ac3c74745b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:35.792044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81829-a980-4835-9fa0-6ac3c74745b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:35.792831 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b81829-a980-4835-9fa0-6ac3c74745b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:35.795563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b81829-a980-4835-9fa0-6ac3c74745b8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:35.882198 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1346/2714] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:11:35 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:11:35.883334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad056cf8-dbbc-49ec-a974-0de9dc10a55a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:35.899585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad056cf8-dbbc-49ec-a974-0de9dc10a55a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:35.959611 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d3b4e-2020-430d-8300-f6235a7f084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:35.960292 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d3b4e-2020-430d-8300-f6235a7f084b admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:35.960575 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d3b4e-2020-430d-8300-f6235a7f084b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:35.960924 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d3b4e-2020-430d-8300-f6235a7f084b admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:35.961680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d3b4e-2020-430d-8300-f6235a7f084b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:35.963672 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d3b4e-2020-430d-8300-f6235a7f084b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:36.054256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1369/2715] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:11:35 2022] POST /identity/v3/users => generated 295 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:11:36.058217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81829-a980-4835-9fa0-6ac3c74745b8 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:36.068907 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81829-a980-4835-9fa0-6ac3c74745b8 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:36.073557 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9d667-e6a4-4038-83f6-e97296885952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:36.074217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9d667-e6a4-4038-83f6-e97296885952 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:36.074493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9d667-e6a4-4038-83f6-e97296885952 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:36.074765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9d667-e6a4-4038-83f6-e97296885952 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:36.076134 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9d667-e6a4-4038-83f6-e97296885952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:36.077865 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9d667-e6a4-4038-83f6-e97296885952 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:36.088419 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1347/2716] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:11:36.092570 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d3b4e-2020-430d-8300-f6235a7f084b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:36.102688 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d3b4e-2020-430d-8300-f6235a7f084b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:36.107533 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa68b1f-87bc-4a3e-85d6-ecd4aa53d79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:36.108615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa68b1f-87bc-4a3e-85d6-ecd4aa53d79e admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:36.108615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa68b1f-87bc-4a3e-85d6-ecd4aa53d79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:36.108922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa68b1f-87bc-4a3e-85d6-ecd4aa53d79e admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:36.109720 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa68b1f-87bc-4a3e-85d6-ecd4aa53d79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:36.111412 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa68b1f-87bc-4a3e-85d6-ecd4aa53d79e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:36.121318 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1370/2717] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:11:36.125847 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9d667-e6a4-4038-83f6-e97296885952 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:36.135932 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9d667-e6a4-4038-83f6-e97296885952 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:36.140865 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde90b4-9552-4ef2-ab54-4ff2528e9386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:36.141732 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde90b4-9552-4ef2-ab54-4ff2528e9386 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:36.142016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde90b4-9552-4ef2-ab54-4ff2528e9386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:36.142287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde90b4-9552-4ef2-ab54-4ff2528e9386 admin admin] PATH_INFO: `/v3/projects/13773b84047249c4909c63a43016adb7/users/ce96617eceff434d81bc957b35bbfdc1/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:36.158590 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde90b4-9552-4ef2-ab54-4ff2528e9386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13773b84047249c4909c63a43016adb7, user_id=ce96617eceff434d81bc957b35bbfdc1, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:36.161223 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde90b4-9552-4ef2-ab54-4ff2528e9386 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:36.214834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1348/2718] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:11:36 2022] PUT /identity/v3/projects/13773b84047249c4909c63a43016adb7/users/ce96617eceff434d81bc957b35bbfdc1/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:36.226338 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc79c57-8699-4240-b611-891a7357f00f None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:36.226861 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc79c57-8699-4240-b611-891a7357f00f None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:36.227430 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc79c57-8699-4240-b611-891a7357f00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:36.257152 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-4fc79c57-8699-4240-b611-891a7357f00f None None] MFA Rules not processed for user `ce96617eceff434d81bc957b35bbfdc1`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:36.258365 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-4fc79c57-8699-4240-b611-891a7357f00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:36.321949 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1371/2719] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:36.326654 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde90b4-9552-4ef2-ab54-4ff2528e9386 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:36.385903 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde90b4-9552-4ef2-ab54-4ff2528e9386 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:36.391080 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b172c-a363-4008-8330-0775abe5fd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:36.391759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b172c-a363-4008-8330-0775abe5fd06 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:36.392037 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b172c-a363-4008-8330-0775abe5fd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:36.392308 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b172c-a363-4008-8330-0775abe5fd06 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:36.393041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b172c-a363-4008-8330-0775abe5fd06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:36.395425 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b172c-a363-4008-8330-0775abe5fd06 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:36.506626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1349/2720] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:11:36 2022] POST /identity/v3/projects => generated 389 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:11:36.510647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc79c57-8699-4240-b611-891a7357f00f None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:36.521491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc79c57-8699-4240-b611-891a7357f00f None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:36.578211 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a0edd-5711-46c2-974d-06683db95219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:36.578819 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a0edd-5711-46c2-974d-06683db95219 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:36.579070 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a0edd-5711-46c2-974d-06683db95219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:36.579383 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a0edd-5711-46c2-974d-06683db95219 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:36.580098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a0edd-5711-46c2-974d-06683db95219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:36.582294 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a0edd-5711-46c2-974d-06683db95219 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:36.645601 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1372/2721] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:11:36 2022] POST /identity/v3/users => generated 301 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:11:36.646955 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b172c-a363-4008-8330-0775abe5fd06 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:36.658834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b172c-a363-4008-8330-0775abe5fd06 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:36.663652 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55323e4c-6dd7-48a9-996a-00f7e27d007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:36.664299 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323e4c-6dd7-48a9-996a-00f7e27d007a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:36.664580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323e4c-6dd7-48a9-996a-00f7e27d007a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:36.664854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55323e4c-6dd7-48a9-996a-00f7e27d007a admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:36.665590 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55323e4c-6dd7-48a9-996a-00f7e27d007a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:36.667163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55323e4c-6dd7-48a9-996a-00f7e27d007a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:36.678319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1350/2722] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:11:36.682552 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a0edd-5711-46c2-974d-06683db95219 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:36.693137 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a0edd-5711-46c2-974d-06683db95219 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:36.697850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c0a67-635c-476b-aa1f-8d9729b539ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:36.698725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c0a67-635c-476b-aa1f-8d9729b539ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:36.699009 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c0a67-635c-476b-aa1f-8d9729b539ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:36.699331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c0a67-635c-476b-aa1f-8d9729b539ce admin admin] PATH_INFO: `/v3/projects/3767a650c71b47859a8bc2c49e3f0e21/users/f262e3d00d9c4260a8afe152d228bcb3/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:36.714028 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c0a67-635c-476b-aa1f-8d9729b539ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=3767a650c71b47859a8bc2c49e3f0e21, user_id=f262e3d00d9c4260a8afe152d228bcb3, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:36.716849 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c0a67-635c-476b-aa1f-8d9729b539ce admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:36.797537 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1373/2723] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:11:36 2022] PUT /identity/v3/projects/3767a650c71b47859a8bc2c49e3f0e21/users/f262e3d00d9c4260a8afe152d228bcb3/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:36.801189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55323e4c-6dd7-48a9-996a-00f7e27d007a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:36.811030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55323e4c-6dd7-48a9-996a-00f7e27d007a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:36.867838 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e0b04-fe0e-4e66-93fb-3e6b1726e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:36.868438 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e0b04-fe0e-4e66-93fb-3e6b1726e941 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:36.868719 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e0b04-fe0e-4e66-93fb-3e6b1726e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:36.868995 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e0b04-fe0e-4e66-93fb-3e6b1726e941 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:36.869813 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e0b04-fe0e-4e66-93fb-3e6b1726e941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:36.871401 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e0b04-fe0e-4e66-93fb-3e6b1726e941 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:36.880967 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1351/2724] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:11:36.885165 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c0a67-635c-476b-aa1f-8d9729b539ce admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:36.895654 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c0a67-635c-476b-aa1f-8d9729b539ce admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:36.900392 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db7613-ef0b-4a34-bd9f-12608beaf469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:36.901334 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db7613-ef0b-4a34-bd9f-12608beaf469 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:36.901812 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db7613-ef0b-4a34-bd9f-12608beaf469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:36.902152 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db7613-ef0b-4a34-bd9f-12608beaf469 admin admin] PATH_INFO: `/v3/projects/3767a650c71b47859a8bc2c49e3f0e21/users/f262e3d00d9c4260a8afe152d228bcb3/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:36.906248 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db7613-ef0b-4a34-bd9f-12608beaf469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3767a650c71b47859a8bc2c49e3f0e21, user_id=f262e3d00d9c4260a8afe152d228bcb3, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:36.909035 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db7613-ef0b-4a34-bd9f-12608beaf469 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:36.923881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1374/2725] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:11:36 2022] PUT /identity/v3/projects/3767a650c71b47859a8bc2c49e3f0e21/users/f262e3d00d9c4260a8afe152d228bcb3/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:36.937646 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd1b24-2cb3-4ec7-b7e5-1ce3dbf29ff8 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:36.937929 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd1b24-2cb3-4ec7-b7e5-1ce3dbf29ff8 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:36.938200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fd1b24-2cb3-4ec7-b7e5-1ce3dbf29ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:36.966993 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-46fd1b24-2cb3-4ec7-b7e5-1ce3dbf29ff8 None None] MFA Rules not processed for user `f262e3d00d9c4260a8afe152d228bcb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:36.968323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-46fd1b24-2cb3-4ec7-b7e5-1ce3dbf29ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:37.044553 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1352/2726] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:37.053923 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db7613-ef0b-4a34-bd9f-12608beaf469 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:37.055815 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-f8db7613-ef0b-4a34-bd9f-12608beaf469 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:37.124219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db7613-ef0b-4a34-bd9f-12608beaf469 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:37.127810 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53036796-3102-498c-9dc2-82e62ffab966 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:37.128474 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53036796-3102-498c-9dc2-82e62ffab966 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:37.129084 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53036796-3102-498c-9dc2-82e62ffab966 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:37.129365 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53036796-3102-498c-9dc2-82e62ffab966 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:37.138951 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53036796-3102-498c-9dc2-82e62ffab966 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:37.140408 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53036796-3102-498c-9dc2-82e62ffab966 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:37.150057 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1375/2727] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:11:37.288811 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd1b24-2cb3-4ec7-b7e5-1ce3dbf29ff8 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:37.369739 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fd1b24-2cb3-4ec7-b7e5-1ce3dbf29ff8 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:37.375402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382afbe-16ab-470b-80f7-cc5dca4ed4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:37.375932 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382afbe-16ab-470b-80f7-cc5dca4ed4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:37.376447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382afbe-16ab-470b-80f7-cc5dca4ed4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:37.376685 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382afbe-16ab-470b-80f7-cc5dca4ed4ec admin admin] PATH_INFO: `/v3/users/ce96617eceff434d81bc957b35bbfdc1` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:37.379641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382afbe-16ab-470b-80f7-cc5dca4ed4ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce96617eceff434d81bc957b35bbfdc1)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:37.381829 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382afbe-16ab-470b-80f7-cc5dca4ed4ec admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:37.576937 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9382afbe-16ab-470b-80f7-cc5dca4ed4ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce96617eceff434d81bc957b35bbfdc1'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:37.577756 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9382afbe-16ab-470b-80f7-cc5dca4ed4ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce96617eceff434d81bc957b35bbfdc1'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:37.578501 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9382afbe-16ab-470b-80f7-cc5dca4ed4ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce96617eceff434d81bc957b35bbfdc1'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:37.590543 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9382afbe-16ab-470b-80f7-cc5dca4ed4ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce96617eceff434d81bc957b35bbfdc1'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:37.598095 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-9382afbe-16ab-470b-80f7-cc5dca4ed4ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce96617eceff434d81bc957b35bbfdc1'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:37.673512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1353/2728] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:11:37 2022] DELETE /identity/v3/users/ce96617eceff434d81bc957b35bbfdc1 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:37.678146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f2d68-23e8-4e44-bd34-3916900df9ba None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:37.683413 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f2d68-23e8-4e44-bd34-3916900df9ba None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:37.683413 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f2d68-23e8-4e44-bd34-3916900df9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:37.700821 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-861f2d68-23e8-4e44-bd34-3916900df9ba None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:37.702191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-861f2d68-23e8-4e44-bd34-3916900df9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:37.900993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1376/2729] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:37.911126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382afbe-16ab-470b-80f7-cc5dca4ed4ec admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:37.912811 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9382afbe-16ab-470b-80f7-cc5dca4ed4ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:37.972146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382afbe-16ab-470b-80f7-cc5dca4ed4ec admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:37.975743 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c9ba2-bc3d-401d-8dee-8b414258c45f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:37.979383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c9ba2-bc3d-401d-8dee-8b414258c45f service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:37.979383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c9ba2-bc3d-401d-8dee-8b414258c45f service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:37.979383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c9ba2-bc3d-401d-8dee-8b414258c45f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:37.987048 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c9ba2-bc3d-401d-8dee-8b414258c45f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:37.989001 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71c9ba2-bc3d-401d-8dee-8b414258c45f service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:38.007424 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1354/2730] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:11:38.374337 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f2d68-23e8-4e44-bd34-3916900df9ba None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:38.375813 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-861f2d68-23e8-4e44-bd34-3916900df9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:38.390825 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f2d68-23e8-4e44-bd34-3916900df9ba None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:38.397564 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:38.398413 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:38.398688 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:38.398957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] PATH_INFO: `/v3/projects/13773b84047249c4909c63a43016adb7` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:38.400252 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=13773b84047249c4909c63a43016adb7)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:38.402087 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:38.505522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13773b84047249c4909c63a43016adb7', 'request_id': 'req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:38.557052 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13773b84047249c4909c63a43016adb7', 'request_id': 'req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:38.567491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13773b84047249c4909c63a43016adb7', 'request_id': 'req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:38.578513 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] The token cache is being invalidate because project 13773b84047249c4909c63a43016adb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:11:38.578909 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:38.579648 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:38.581704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1377/2731] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:11:38 2022] DELETE /identity/v3/projects/13773b84047249c4909c63a43016adb7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:38.585692 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c9ba2-bc3d-401d-8dee-8b414258c45f service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:38.596049 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c9ba2-bc3d-401d-8dee-8b414258c45f service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:38.653940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d1cc5-cf8a-4c25-a585-3b69f73f330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:38.654804 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d1cc5-cf8a-4c25-a585-3b69f73f330a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:38.655089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d1cc5-cf8a-4c25-a585-3b69f73f330a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:38.655400 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d1cc5-cf8a-4c25-a585-3b69f73f330a admin admin] PATH_INFO: `/v3/users/f262e3d00d9c4260a8afe152d228bcb3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:38.656606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d1cc5-cf8a-4c25-a585-3b69f73f330a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f262e3d00d9c4260a8afe152d228bcb3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:38.658664 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d1cc5-cf8a-4c25-a585-3b69f73f330a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:38.849838 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a54d1cc5-cf8a-4c25-a585-3b69f73f330a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f262e3d00d9c4260a8afe152d228bcb3'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:38.850567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a54d1cc5-cf8a-4c25-a585-3b69f73f330a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f262e3d00d9c4260a8afe152d228bcb3'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:38.851259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a54d1cc5-cf8a-4c25-a585-3b69f73f330a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f262e3d00d9c4260a8afe152d228bcb3'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:38.863545 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a54d1cc5-cf8a-4c25-a585-3b69f73f330a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f262e3d00d9c4260a8afe152d228bcb3'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:38.870439 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a54d1cc5-cf8a-4c25-a585-3b69f73f330a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f262e3d00d9c4260a8afe152d228bcb3'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:38.950615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1355/2732] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:11:38 2022] DELETE /identity/v3/users/f262e3d00d9c4260a8afe152d228bcb3 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:39.433230 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:39.433230 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:39.452624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f861c0-3e66-4ff5-87e9-44372cc8ce8b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:39.517323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabe278-e7b6-466e-adf1-80a74a21e6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:39.518179 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabe278-e7b6-466e-adf1-80a74a21e6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:39.518453 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabe278-e7b6-466e-adf1-80a74a21e6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:39.518914 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabe278-e7b6-466e-adf1-80a74a21e6a4 admin admin] PATH_INFO: `/v3/projects/3767a650c71b47859a8bc2c49e3f0e21` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:39.520306 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabe278-e7b6-466e-adf1-80a74a21e6a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3767a650c71b47859a8bc2c49e3f0e21)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:39.522366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabe278-e7b6-466e-adf1-80a74a21e6a4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:39.638394 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4dabe278-e7b6-466e-adf1-80a74a21e6a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3767a650c71b47859a8bc2c49e3f0e21', 'request_id': 'req-4dabe278-e7b6-466e-adf1-80a74a21e6a4'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:39.722037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4dabe278-e7b6-466e-adf1-80a74a21e6a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3767a650c71b47859a8bc2c49e3f0e21', 'request_id': 'req-4dabe278-e7b6-466e-adf1-80a74a21e6a4'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:39.729831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4dabe278-e7b6-466e-adf1-80a74a21e6a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3767a650c71b47859a8bc2c49e3f0e21', 'request_id': 'req-4dabe278-e7b6-466e-adf1-80a74a21e6a4'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:39.739158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d1cc5-cf8a-4c25-a585-3b69f73f330a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:39.739158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a54d1cc5-cf8a-4c25-a585-3b69f73f330a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:39.744109 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4dabe278-e7b6-466e-adf1-80a74a21e6a4 admin admin] The token cache is being invalidate because project 3767a650c71b47859a8bc2c49e3f0e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:11:39.744910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4dabe278-e7b6-466e-adf1-80a74a21e6a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:39.745722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-4dabe278-e7b6-466e-adf1-80a74a21e6a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:39.748421 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1378/2733] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:11:39 2022] DELETE /identity/v3/projects/3767a650c71b47859a8bc2c49e3f0e21 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:11:39.751479 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d1cc5-cf8a-4c25-a585-3b69f73f330a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:39.754017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3fda3-99cb-4165-8c53-67350e4d7fac None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:39.754631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3fda3-99cb-4165-8c53-67350e4d7fac None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:39.755030 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a3fda3-99cb-4165-8c53-67350e4d7fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:39.773111 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-b2a3fda3-99cb-4165-8c53-67350e4d7fac None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:39.774305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b2a3fda3-99cb-4165-8c53-67350e4d7fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:39.814997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d24e7e-4af4-4f15-b3d4-7429bff9d396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:39.816204 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24e7e-4af4-4f15-b3d4-7429bff9d396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:39.816488 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24e7e-4af4-4f15-b3d4-7429bff9d396 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:39.816765 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d24e7e-4af4-4f15-b3d4-7429bff9d396 admin admin] PATH_INFO: `/v3/users/182001be496c4437a532048933011a15` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:39.817998 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d24e7e-4af4-4f15-b3d4-7429bff9d396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=182001be496c4437a532048933011a15)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:39.820023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d24e7e-4af4-4f15-b3d4-7429bff9d396 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:39.832785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1379/2734] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:11:39.840427 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e7305-9f44-431b-845a-5184852b03c1 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:39.841305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e7305-9f44-431b-845a-5184852b03c1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:39.841577 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e7305-9f44-431b-845a-5184852b03c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:39.859410 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1f2e7305-9f44-431b-845a-5184852b03c1 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:39.860582 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1f2e7305-9f44-431b-845a-5184852b03c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:39.868390 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1380/2735] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:11:39.872621 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e7305-9f44-431b-845a-5184852b03c1 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:39.882190 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e7305-9f44-431b-845a-5184852b03c1 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:39.887152 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc5bee-356b-49d2-8eaa-507fc33e5f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:39.887910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc5bee-356b-49d2-8eaa-507fc33e5f87 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:39.888191 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc5bee-356b-49d2-8eaa-507fc33e5f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:39.888467 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc5bee-356b-49d2-8eaa-507fc33e5f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:39.889206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc5bee-356b-49d2-8eaa-507fc33e5f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:11:39.889514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc5bee-356b-49d2-8eaa-507fc33e5f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:39.891126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc5bee-356b-49d2-8eaa-507fc33e5f87 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:39.902479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1381/2736] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Feb 12 05:11:39.907247 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc5bee-356b-49d2-8eaa-507fc33e5f87 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:39.916711 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc5bee-356b-49d2-8eaa-507fc33e5f87 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:39.922278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a61a7-ef9a-4a04-aec2-d03447bce428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:39.922878 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a61a7-ef9a-4a04-aec2-d03447bce428 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:39.923154 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a61a7-ef9a-4a04-aec2-d03447bce428 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:39.923466 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a61a7-ef9a-4a04-aec2-d03447bce428 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:39.924143 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a61a7-ef9a-4a04-aec2-d03447bce428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:39.925984 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49a61a7-ef9a-4a04-aec2-d03447bce428 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:40.014904 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1382/2737] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:11:39 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:11:40.019058 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a61a7-ef9a-4a04-aec2-d03447bce428 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:40.025898 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e7d24e7e-4af4-4f15-b3d4-7429bff9d396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182001be496c4437a532048933011a15'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.026556 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e7d24e7e-4af4-4f15-b3d4-7429bff9d396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182001be496c4437a532048933011a15'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.027155 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e7d24e7e-4af4-4f15-b3d4-7429bff9d396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182001be496c4437a532048933011a15'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.039729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e7d24e7e-4af4-4f15-b3d4-7429bff9d396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182001be496c4437a532048933011a15'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.047299 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-e7d24e7e-4af4-4f15-b3d4-7429bff9d396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182001be496c4437a532048933011a15'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.078934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49a61a7-ef9a-4a04-aec2-d03447bce428 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:40.083908 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c95f01-197d-4155-a771-1900c6a44c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:40.084556 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c95f01-197d-4155-a771-1900c6a44c83 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:40.084836 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c95f01-197d-4155-a771-1900c6a44c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:40.085108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c95f01-197d-4155-a771-1900c6a44c83 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:40.085800 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c95f01-197d-4155-a771-1900c6a44c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:40.087781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c95f01-197d-4155-a771-1900c6a44c83 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:40.121726 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1356/2738] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:11:39 2022] DELETE /identity/v3/users/182001be496c4437a532048933011a15 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:40.198681 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1383/2739] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:11:40 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:11:40.201670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d24e7e-4af4-4f15-b3d4-7429bff9d396 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:40.203260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e7d24e7e-4af4-4f15-b3d4-7429bff9d396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:40.268685 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d24e7e-4af4-4f15-b3d4-7429bff9d396 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:40.274303 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159775ea-64a1-4feb-9da6-cbaa633ac019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:40.274960 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159775ea-64a1-4feb-9da6-cbaa633ac019 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:40.275250 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159775ea-64a1-4feb-9da6-cbaa633ac019 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:40.275538 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159775ea-64a1-4feb-9da6-cbaa633ac019 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:40.276276 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159775ea-64a1-4feb-9da6-cbaa633ac019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:40.277845 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159775ea-64a1-4feb-9da6-cbaa633ac019 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:40.288462 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1357/2740] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:11:40.292478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c95f01-197d-4155-a771-1900c6a44c83 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:40.302728 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c95f01-197d-4155-a771-1900c6a44c83 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:40.307457 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719515b-4d49-40c3-94bd-1b872ee11299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:40.308096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719515b-4d49-40c3-94bd-1b872ee11299 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:40.308375 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719515b-4d49-40c3-94bd-1b872ee11299 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:40.308647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719515b-4d49-40c3-94bd-1b872ee11299 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:40.309451 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719515b-4d49-40c3-94bd-1b872ee11299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:40.311021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b719515b-4d49-40c3-94bd-1b872ee11299 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:40.320549 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1384/2741] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:11:40.324467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159775ea-64a1-4feb-9da6-cbaa633ac019 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:40.335141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159775ea-64a1-4feb-9da6-cbaa633ac019 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:40.339786 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00693962-6329-47a7-a2e9-87be3aed6ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:40.341241 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693962-6329-47a7-a2e9-87be3aed6ac1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:40.341662 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693962-6329-47a7-a2e9-87be3aed6ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:40.341933 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00693962-6329-47a7-a2e9-87be3aed6ac1 admin admin] PATH_INFO: `/v3/projects/accb68f8f40049e8a62792a60afcb98f/users/0174657d8987456987d9a1f07a3445c9/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:40.357062 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00693962-6329-47a7-a2e9-87be3aed6ac1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=accb68f8f40049e8a62792a60afcb98f, user_id=0174657d8987456987d9a1f07a3445c9, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:40.358542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719515b-4d49-40c3-94bd-1b872ee11299 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:40.359899 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00693962-6329-47a7-a2e9-87be3aed6ac1 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:40.360864 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b719515b-4d49-40c3-94bd-1b872ee11299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:40.376042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719515b-4d49-40c3-94bd-1b872ee11299 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:40.380711 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:40.381568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:40.381963 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:40.382357 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] PATH_INFO: `/v3/projects/5202622e17a348e4bcb43c74abf37a6e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:40.383969 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5202622e17a348e4bcb43c74abf37a6e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:40.385612 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:40.419615 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1358/2742] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:11:40 2022] PUT /identity/v3/projects/accb68f8f40049e8a62792a60afcb98f/users/0174657d8987456987d9a1f07a3445c9/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:40.429777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4279ab-1e08-401d-9550-2f2a8a7a6466 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:40.430058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4279ab-1e08-401d-9550-2f2a8a7a6466 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:40.430332 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4279ab-1e08-401d-9550-2f2a8a7a6466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:40.457180 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-be4279ab-1e08-401d-9550-2f2a8a7a6466 None None] MFA Rules not processed for user `0174657d8987456987d9a1f07a3445c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:40.458389 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-be4279ab-1e08-401d-9550-2f2a8a7a6466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:40.484082 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5202622e17a348e4bcb43c74abf37a6e', 'request_id': 'req-16be27e9-4be5-4fad-a7df-dda369f04094'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.521802 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1359/2743] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:11:40.532150 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4279ab-1e08-401d-9550-2f2a8a7a6466 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:40.533453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-be4279ab-1e08-401d-9550-2f2a8a7a6466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:40.545089 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5202622e17a348e4bcb43c74abf37a6e', 'request_id': 'req-16be27e9-4be5-4fad-a7df-dda369f04094'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.550853 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5202622e17a348e4bcb43c74abf37a6e', 'request_id': 'req-16be27e9-4be5-4fad-a7df-dda369f04094'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.564018 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] The token cache is being invalidate because project 5202622e17a348e4bcb43c74abf37a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:11:40.564302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.565098 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.566671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1385/2744] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:11:40 2022] DELETE /identity/v3/projects/5202622e17a348e4bcb43c74abf37a6e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:11:40.570450 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:40.571736 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:40.589410 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4279ab-1e08-401d-9550-2f2a8a7a6466 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:40.634209 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be27e9-4be5-4fad-a7df-dda369f04094 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:40.636173 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7458c09-9e0d-4b1a-a4a9-1e989c14f082 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:40.636895 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458c09-9e0d-4b1a-a4a9-1e989c14f082 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:40.637243 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458c09-9e0d-4b1a-a4a9-1e989c14f082 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:40.637675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458c09-9e0d-4b1a-a4a9-1e989c14f082 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:40.638997 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf024cb1-3e2d-46bc-8d81-04780dd5a18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:40.639562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d7458c09-9e0d-4b1a-a4a9-1e989c14f082 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:40.639870 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf024cb1-3e2d-46bc-8d81-04780dd5a18e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:40.640148 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf024cb1-3e2d-46bc-8d81-04780dd5a18e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:40.640419 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf024cb1-3e2d-46bc-8d81-04780dd5a18e admin admin] PATH_INFO: `/v3/users/937a895d972d4142afdc7370d900b629` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:40.641664 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf024cb1-3e2d-46bc-8d81-04780dd5a18e admin admin] RBAC: Authorizing `identity:delete_user(user_id=937a895d972d4142afdc7370d900b629)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:40.644242 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf024cb1-3e2d-46bc-8d81-04780dd5a18e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:40.698065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7458c09-9e0d-4b1a-a4a9-1e989c14f082 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:40.699549 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7458c09-9e0d-4b1a-a4a9-1e989c14f082 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:40.709026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1360/2745] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:11:40.837922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-bf024cb1-3e2d-46bc-8d81-04780dd5a18e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937a895d972d4142afdc7370d900b629'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.838585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-bf024cb1-3e2d-46bc-8d81-04780dd5a18e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937a895d972d4142afdc7370d900b629'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.839203 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-bf024cb1-3e2d-46bc-8d81-04780dd5a18e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937a895d972d4142afdc7370d900b629'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.850858 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-bf024cb1-3e2d-46bc-8d81-04780dd5a18e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937a895d972d4142afdc7370d900b629'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.858287 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-bf024cb1-3e2d-46bc-8d81-04780dd5a18e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937a895d972d4142afdc7370d900b629'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:40.915879 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1386/2746] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:11:40 2022] DELETE /identity/v3/users/937a895d972d4142afdc7370d900b629 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:41.158403 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7458c09-9e0d-4b1a-a4a9-1e989c14f082 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:41.169030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7458c09-9e0d-4b1a-a4a9-1e989c14f082 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:41.225829 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb6de7-56e1-447e-a2a8-59da28708f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:41.226824 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb6de7-56e1-447e-a2a8-59da28708f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:41.226824 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb6de7-56e1-447e-a2a8-59da28708f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:41.227332 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb6de7-56e1-447e-a2a8-59da28708f81 admin admin] PATH_INFO: `/v3/projects/b1e42b33501b4016a6bffb95882c5876` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:41.228459 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb6de7-56e1-447e-a2a8-59da28708f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e42b33501b4016a6bffb95882c5876)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:41.230347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb6de7-56e1-447e-a2a8-59da28708f81 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:41.334151 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-bdcb6de7-56e1-447e-a2a8-59da28708f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e42b33501b4016a6bffb95882c5876', 'request_id': 'req-bdcb6de7-56e1-447e-a2a8-59da28708f81'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:41.340213 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-bdcb6de7-56e1-447e-a2a8-59da28708f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e42b33501b4016a6bffb95882c5876', 'request_id': 'req-bdcb6de7-56e1-447e-a2a8-59da28708f81'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:41.346190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-bdcb6de7-56e1-447e-a2a8-59da28708f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e42b33501b4016a6bffb95882c5876', 'request_id': 'req-bdcb6de7-56e1-447e-a2a8-59da28708f81'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:41.395494 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-bdcb6de7-56e1-447e-a2a8-59da28708f81 admin admin] The token cache is being invalidate because project b1e42b33501b4016a6bffb95882c5876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:11:41.395781 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-bdcb6de7-56e1-447e-a2a8-59da28708f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:41.396406 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-bdcb6de7-56e1-447e-a2a8-59da28708f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:41.397987 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1361/2747] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:11:41 2022] DELETE /identity/v3/projects/b1e42b33501b4016a6bffb95882c5876 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:43.608631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf024cb1-3e2d-46bc-8d81-04780dd5a18e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:43.614253 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-bf024cb1-3e2d-46bc-8d81-04780dd5a18e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:43.623994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf024cb1-3e2d-46bc-8d81-04780dd5a18e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:43.678438 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71841e7b-4c55-4e1d-85d5-dad0ddb79816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:43.679320 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71841e7b-4c55-4e1d-85d5-dad0ddb79816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:43.679603 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71841e7b-4c55-4e1d-85d5-dad0ddb79816 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:43.679874 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71841e7b-4c55-4e1d-85d5-dad0ddb79816 admin admin] PATH_INFO: `/v3/users/0174657d8987456987d9a1f07a3445c9` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:43.681091 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71841e7b-4c55-4e1d-85d5-dad0ddb79816 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0174657d8987456987d9a1f07a3445c9)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:43.683084 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71841e7b-4c55-4e1d-85d5-dad0ddb79816 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:43.814646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-71841e7b-4c55-4e1d-85d5-dad0ddb79816 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0174657d8987456987d9a1f07a3445c9'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:43.815355 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-71841e7b-4c55-4e1d-85d5-dad0ddb79816 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0174657d8987456987d9a1f07a3445c9'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:43.815959 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-71841e7b-4c55-4e1d-85d5-dad0ddb79816 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0174657d8987456987d9a1f07a3445c9'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:43.828197 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-71841e7b-4c55-4e1d-85d5-dad0ddb79816 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0174657d8987456987d9a1f07a3445c9'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:43.834981 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-71841e7b-4c55-4e1d-85d5-dad0ddb79816 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0174657d8987456987d9a1f07a3445c9'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:43.886854 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1387/2748] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:11:43 2022] DELETE /identity/v3/users/0174657d8987456987d9a1f07a3445c9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:43.896235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e7dbf-929e-4ee4-b570-c7424d060884 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:43.896692 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e7dbf-929e-4ee4-b570-c7424d060884 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:43.896779 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e7dbf-929e-4ee4-b570-c7424d060884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:43.914211 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-d95e7dbf-929e-4ee4-b570-c7424d060884 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:43.915439 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d95e7dbf-929e-4ee4-b570-c7424d060884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:43.971817 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1362/2749] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:43.981871 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71841e7b-4c55-4e1d-85d5-dad0ddb79816 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:43.983270 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-71841e7b-4c55-4e1d-85d5-dad0ddb79816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:44.038955 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71841e7b-4c55-4e1d-85d5-dad0ddb79816 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:44.042884 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ca1d1-51d9-46d8-a397-90efaf0e0ede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:44.043539 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ca1d1-51d9-46d8-a397-90efaf0e0ede service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:44.044319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ca1d1-51d9-46d8-a397-90efaf0e0ede service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:44.044592 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ca1d1-51d9-46d8-a397-90efaf0e0ede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:44.053387 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ca1d1-51d9-46d8-a397-90efaf0e0ede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:44.054796 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ca1d1-51d9-46d8-a397-90efaf0e0ede service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:44.064682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1388/2750] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:11:44.426900 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e7dbf-929e-4ee4-b570-c7424d060884 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:44.428428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d95e7dbf-929e-4ee4-b570-c7424d060884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:44.440588 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e7dbf-929e-4ee4-b570-c7424d060884 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:44.445484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af9cce-98d7-42af-adb6-265033858d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:44.448245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af9cce-98d7-42af-adb6-265033858d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:44.448245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af9cce-98d7-42af-adb6-265033858d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:44.448245 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af9cce-98d7-42af-adb6-265033858d85 admin admin] PATH_INFO: `/v3/projects/accb68f8f40049e8a62792a60afcb98f` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:44.449813 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af9cce-98d7-42af-adb6-265033858d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=accb68f8f40049e8a62792a60afcb98f)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:44.452049 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af9cce-98d7-42af-adb6-265033858d85 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:44.538678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-71af9cce-98d7-42af-adb6-265033858d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accb68f8f40049e8a62792a60afcb98f', 'request_id': 'req-71af9cce-98d7-42af-adb6-265033858d85'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:44.545405 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-71af9cce-98d7-42af-adb6-265033858d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accb68f8f40049e8a62792a60afcb98f', 'request_id': 'req-71af9cce-98d7-42af-adb6-265033858d85'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:44.550626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-71af9cce-98d7-42af-adb6-265033858d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accb68f8f40049e8a62792a60afcb98f', 'request_id': 'req-71af9cce-98d7-42af-adb6-265033858d85'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:44.613383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-71af9cce-98d7-42af-adb6-265033858d85 admin admin] The token cache is being invalidate because project accb68f8f40049e8a62792a60afcb98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:11:44.613695 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-71af9cce-98d7-42af-adb6-265033858d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:44.614310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-71af9cce-98d7-42af-adb6-265033858d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:11:44.615892 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1363/2751] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:11:44 2022] DELETE /identity/v3/projects/accb68f8f40049e8a62792a60afcb98f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:44.621063 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c4c88-6971-4f31-9f13-9b28695a004e None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:44.621526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c4c88-6971-4f31-9f13-9b28695a004e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:44.621627 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c4c88-6971-4f31-9f13-9b28695a004e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:44.639491 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-4f3c4c88-6971-4f31-9f13-9b28695a004e None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:44.640712 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-4f3c4c88-6971-4f31-9f13-9b28695a004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:44.700548 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1389/2752] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:44.709773 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778c41e-9e42-4ed1-97a1-58ce7a14d32b None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:44.710055 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778c41e-9e42-4ed1-97a1-58ce7a14d32b None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:44.710323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778c41e-9e42-4ed1-97a1-58ce7a14d32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:44.728938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-9778c41e-9e42-4ed1-97a1-58ce7a14d32b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:44.730133 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-9778c41e-9e42-4ed1-97a1-58ce7a14d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:44.738988 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1364/2753] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:44.743075 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c4c88-6971-4f31-9f13-9b28695a004e None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:44.752602 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c4c88-6971-4f31-9f13-9b28695a004e None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:44.757101 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd78721-6d48-40cb-8cc2-e2ead5111f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:44.757757 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd78721-6d48-40cb-8cc2-e2ead5111f50 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:44.758036 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd78721-6d48-40cb-8cc2-e2ead5111f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:44.758305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd78721-6d48-40cb-8cc2-e2ead5111f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:44.759031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd78721-6d48-40cb-8cc2-e2ead5111f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:11:44.759399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd78721-6d48-40cb-8cc2-e2ead5111f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:44.760968 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd78721-6d48-40cb-8cc2-e2ead5111f50 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:44.772997 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1390/2754] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:11:44.777263 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778c41e-9e42-4ed1-97a1-58ce7a14d32b None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:44.787180 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778c41e-9e42-4ed1-97a1-58ce7a14d32b None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:44.791903 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed51ac-f993-44e2-b2a8-e4c3666ec95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:44.792551 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed51ac-f993-44e2-b2a8-e4c3666ec95f admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:44.792834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed51ac-f993-44e2-b2a8-e4c3666ec95f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:44.793111 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed51ac-f993-44e2-b2a8-e4c3666ec95f admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:44.793815 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed51ac-f993-44e2-b2a8-e4c3666ec95f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:44.796339 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed51ac-f993-44e2-b2a8-e4c3666ec95f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:44.872161 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1365/2755] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:11:44 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:11:44.876344 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd78721-6d48-40cb-8cc2-e2ead5111f50 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:44.886348 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd78721-6d48-40cb-8cc2-e2ead5111f50 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:44.944229 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248041a9-de7a-4159-b3b8-eb3acef043dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:44.944814 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248041a9-de7a-4159-b3b8-eb3acef043dd admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:44.945093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248041a9-de7a-4159-b3b8-eb3acef043dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:44.945367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248041a9-de7a-4159-b3b8-eb3acef043dd admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:44.946067 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248041a9-de7a-4159-b3b8-eb3acef043dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:44.948119 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248041a9-de7a-4159-b3b8-eb3acef043dd admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:45.030418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1391/2756] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:11:44 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:11:45.034973 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed51ac-f993-44e2-b2a8-e4c3666ec95f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:45.045617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed51ac-f993-44e2-b2a8-e4c3666ec95f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:45.050486 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c9108-6843-4e6c-94e0-ec7212f6aa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:45.051126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c9108-6843-4e6c-94e0-ec7212f6aa39 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:45.051451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c9108-6843-4e6c-94e0-ec7212f6aa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:45.051725 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c9108-6843-4e6c-94e0-ec7212f6aa39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:45.052577 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c9108-6843-4e6c-94e0-ec7212f6aa39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:45.054163 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4c9108-6843-4e6c-94e0-ec7212f6aa39 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:45.064400 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1366/2757] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:11:45.068230 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248041a9-de7a-4159-b3b8-eb3acef043dd admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:45.078951 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248041a9-de7a-4159-b3b8-eb3acef043dd admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:45.083833 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e200b-ca6e-4422-a5eb-24cd17d1968a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:45.084475 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e200b-ca6e-4422-a5eb-24cd17d1968a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:45.084757 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e200b-ca6e-4422-a5eb-24cd17d1968a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:45.085030 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e200b-ca6e-4422-a5eb-24cd17d1968a admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:45.085764 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e200b-ca6e-4422-a5eb-24cd17d1968a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:45.087365 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113e200b-ca6e-4422-a5eb-24cd17d1968a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:45.097742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1392/2758] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:11:45.101826 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c9108-6843-4e6c-94e0-ec7212f6aa39 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:45.111644 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c9108-6843-4e6c-94e0-ec7212f6aa39 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:45.116162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d9b8c-9926-4d01-9f96-58a0b24b2439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:45.117043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d9b8c-9926-4d01-9f96-58a0b24b2439 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:45.117319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d9b8c-9926-4d01-9f96-58a0b24b2439 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:45.117591 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d9b8c-9926-4d01-9f96-58a0b24b2439 admin admin] PATH_INFO: `/v3/projects/432673fd8a4248ea9b8f1674c3c38668/users/268f9313ebc541e19a4ba6416e6da0ad/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:45.131318 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d9b8c-9926-4d01-9f96-58a0b24b2439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432673fd8a4248ea9b8f1674c3c38668, user_id=268f9313ebc541e19a4ba6416e6da0ad, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:45.133930 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d9b8c-9926-4d01-9f96-58a0b24b2439 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:45.224680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1367/2759] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:11:45 2022] PUT /identity/v3/projects/432673fd8a4248ea9b8f1674c3c38668/users/268f9313ebc541e19a4ba6416e6da0ad/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:45.233064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3eb7a1-990a-4689-89cd-b8d063ad4b3a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:45.233356 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3eb7a1-990a-4689-89cd-b8d063ad4b3a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:45.233637 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3eb7a1-990a-4689-89cd-b8d063ad4b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:45.251319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-7c3eb7a1-990a-4689-89cd-b8d063ad4b3a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:45.252831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-7c3eb7a1-990a-4689-89cd-b8d063ad4b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:45.310015 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1393/2760] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:45.319427 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d9b8c-9926-4d01-9f96-58a0b24b2439 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:45.321106 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-742d9b8c-9926-4d01-9f96-58a0b24b2439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:45.375214 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d9b8c-9926-4d01-9f96-58a0b24b2439 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:45.378869 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f955e-c0d6-4233-b957-795e59f417e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:45.379524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f955e-c0d6-4233-b957-795e59f417e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:45.379807 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f955e-c0d6-4233-b957-795e59f417e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:45.380083 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f955e-c0d6-4233-b957-795e59f417e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:45.389234 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f955e-c0d6-4233-b957-795e59f417e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:45.390629 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f955e-c0d6-4233-b957-795e59f417e2 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:45.399686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1368/2761] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:11:50.099805 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c7ccb-49ce-431c-9891-47ee055fde28 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:50.100634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c7ccb-49ce-431c-9891-47ee055fde28 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:50.101055 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c7ccb-49ce-431c-9891-47ee055fde28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:50.132688 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-6e5c7ccb-49ce-431c-9891-47ee055fde28 None None] MFA Rules not processed for user `268f9313ebc541e19a4ba6416e6da0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:50.134188 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-6e5c7ccb-49ce-431c-9891-47ee055fde28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:50.202215 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1394/2762] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:50.207041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f955e-c0d6-4233-b957-795e59f417e2 service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:50.216686 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f955e-c0d6-4233-b957-795e59f417e2 service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:50.221992 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16c19c-8cba-45bb-828a-d78bfd4182dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:50.222669 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16c19c-8cba-45bb-828a-d78bfd4182dc admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:50.222950 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16c19c-8cba-45bb-828a-d78bfd4182dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:50.223252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16c19c-8cba-45bb-828a-d78bfd4182dc admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:50.224141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16c19c-8cba-45bb-828a-d78bfd4182dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:50.226059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16c19c-8cba-45bb-828a-d78bfd4182dc admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:50.323493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1369/2763] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:11:50 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:11:50.327973 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c7ccb-49ce-431c-9891-47ee055fde28 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:50.339858 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c7ccb-49ce-431c-9891-47ee055fde28 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:50.397277 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f388e-bb7e-4e26-b343-8251bbdf96fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:50.397954 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f388e-bb7e-4e26-b343-8251bbdf96fd admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:50.398234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f388e-bb7e-4e26-b343-8251bbdf96fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:50.398510 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f388e-bb7e-4e26-b343-8251bbdf96fd admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:50.399250 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f388e-bb7e-4e26-b343-8251bbdf96fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:50.401174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f388e-bb7e-4e26-b343-8251bbdf96fd admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:50.499992 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1395/2764] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:11:50 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:11:50.504017 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16c19c-8cba-45bb-828a-d78bfd4182dc admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:50.514524 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16c19c-8cba-45bb-828a-d78bfd4182dc admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:50.519190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83f61d-c3a0-4278-a0ee-afb1d4f4ff98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:50.519864 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83f61d-c3a0-4278-a0ee-afb1d4f4ff98 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:50.520303 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83f61d-c3a0-4278-a0ee-afb1d4f4ff98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:50.520588 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83f61d-c3a0-4278-a0ee-afb1d4f4ff98 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:50.521322 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83f61d-c3a0-4278-a0ee-afb1d4f4ff98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:50.522890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83f61d-c3a0-4278-a0ee-afb1d4f4ff98 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:50.533424 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1370/2765] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:11:50.537528 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f388e-bb7e-4e26-b343-8251bbdf96fd admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:50.548514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f388e-bb7e-4e26-b343-8251bbdf96fd admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:50.553118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0062bf3-b8e3-42f9-8641-15426b331f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:50.553987 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062bf3-b8e3-42f9-8641-15426b331f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:50.554274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062bf3-b8e3-42f9-8641-15426b331f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:50.554550 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0062bf3-b8e3-42f9-8641-15426b331f46 admin admin] PATH_INFO: `/v3/projects/e71f3ecc02294cbab44ca20c91b27454/users/6853eb250ffa426189ca3c1ea9d49dd1/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:50.570962 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0062bf3-b8e3-42f9-8641-15426b331f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71f3ecc02294cbab44ca20c91b27454, user_id=6853eb250ffa426189ca3c1ea9d49dd1, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:50.573625 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0062bf3-b8e3-42f9-8641-15426b331f46 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:50.642196 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1396/2766] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:11:50 2022] PUT /identity/v3/projects/e71f3ecc02294cbab44ca20c91b27454/users/6853eb250ffa426189ca3c1ea9d49dd1/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:50.646265 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83f61d-c3a0-4278-a0ee-afb1d4f4ff98 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:50.656936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83f61d-c3a0-4278-a0ee-afb1d4f4ff98 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:50.711948 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2dc92-9815-4021-8dba-5c42e1b29607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:50.712603 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2dc92-9815-4021-8dba-5c42e1b29607 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:50.712887 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2dc92-9815-4021-8dba-5c42e1b29607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:50.713160 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2dc92-9815-4021-8dba-5c42e1b29607 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:50.713889 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2dc92-9815-4021-8dba-5c42e1b29607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:50.715505 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2dc92-9815-4021-8dba-5c42e1b29607 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:50.725367 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1371/2767] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:11:50.729479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0062bf3-b8e3-42f9-8641-15426b331f46 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:50.740448 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0062bf3-b8e3-42f9-8641-15426b331f46 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:50.744907 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4acf9e-2a02-40bf-82c8-c72f6b9885b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:50.745755 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4acf9e-2a02-40bf-82c8-c72f6b9885b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:50.746029 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4acf9e-2a02-40bf-82c8-c72f6b9885b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:50.746319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4acf9e-2a02-40bf-82c8-c72f6b9885b4 admin admin] PATH_INFO: `/v3/projects/e71f3ecc02294cbab44ca20c91b27454/users/6853eb250ffa426189ca3c1ea9d49dd1/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:50.748435 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4acf9e-2a02-40bf-82c8-c72f6b9885b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71f3ecc02294cbab44ca20c91b27454, user_id=6853eb250ffa426189ca3c1ea9d49dd1, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:50.751151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4acf9e-2a02-40bf-82c8-c72f6b9885b4 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:50.761138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1397/2768] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:11:50 2022] PUT /identity/v3/projects/e71f3ecc02294cbab44ca20c91b27454/users/6853eb250ffa426189ca3c1ea9d49dd1/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:11:56.359127 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c096-a768-49ff-87aa-ab65d55e9525 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:56.359646 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c096-a768-49ff-87aa-ab65d55e9525 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:56.359734 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c096-a768-49ff-87aa-ab65d55e9525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:56.387107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-2d80c096-a768-49ff-87aa-ab65d55e9525 None None] MFA Rules not processed for user `6853eb250ffa426189ca3c1ea9d49dd1`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:56.388406 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-2d80c096-a768-49ff-87aa-ab65d55e9525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:56.456376 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1372/2769] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:56 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:11:56.468381 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4acf9e-2a02-40bf-82c8-c72f6b9885b4 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:11:56.470141 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1d4acf9e-2a02-40bf-82c8-c72f6b9885b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:56.543138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4acf9e-2a02-40bf-82c8-c72f6b9885b4 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:11:56.549522 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ab99b-d6a6-4d57-b3d1-900f82a7e971 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:11:56.550157 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ab99b-d6a6-4d57-b3d1-900f82a7e971 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:56.550442 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ab99b-d6a6-4d57-b3d1-900f82a7e971 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:56.550717 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ab99b-d6a6-4d57-b3d1-900f82a7e971 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:56.603854 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ab99b-d6a6-4d57-b3d1-900f82a7e971 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:11:56.605422 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484ab99b-d6a6-4d57-b3d1-900f82a7e971 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:11:56.614235 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1398/2770] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:11:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:11:59.077896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2077b-efe0-40ee-9fd6-138734a82b65 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:11:59.079795 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2077b-efe0-40ee-9fd6-138734a82b65 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:11:59.080096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b2077b-efe0-40ee-9fd6-138734a82b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:11:59.098158 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-90b2077b-efe0-40ee-9fd6-138734a82b65 None None] MFA Rules not processed for user `268f9313ebc541e19a4ba6416e6da0ad`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:11:59.099382 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-90b2077b-efe0-40ee-9fd6-138734a82b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:11:59.106154 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1373/2771] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:11:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:12:09.438869 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ab99b-d6a6-4d57-b3d1-900f82a7e971 service nova] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:12:09.440489 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-484ab99b-d6a6-4d57-b3d1-900f82a7e971 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:12:09.507908 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484ab99b-d6a6-4d57-b3d1-900f82a7e971 service nova] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:12:09.512746 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4ec2b-f6b9-443c-957e-58d6da2c6227 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:12:09.513315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ec2b-f6b9-443c-957e-58d6da2c6227 service placement] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:12:09.513591 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ec2b-f6b9-443c-957e-58d6da2c6227 service placement] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:12:09.513862 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4ec2b-f6b9-443c-957e-58d6da2c6227 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:12:09.515610 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d7c4ec2b-f6b9-443c-957e-58d6da2c6227 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:12:09.526849 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4ec2b-f6b9-443c-957e-58d6da2c6227 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:12:09.528455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c4ec2b-f6b9-443c-957e-58d6da2c6227 service placement] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:12:09.538752 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1399/2772] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:12:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:12:14.907022 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2077b-efe0-40ee-9fd6-138734a82b65 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:12:14.960891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b2077b-efe0-40ee-9fd6-138734a82b65 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:12:14.964475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5d095-d591-4df3-8f4b-39f0baed850b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:12:14.965105 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5d095-d591-4df3-8f4b-39f0baed850b service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:12:14.965390 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5d095-d591-4df3-8f4b-39f0baed850b service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:12:14.965661 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5d095-d591-4df3-8f4b-39f0baed850b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:12:14.967485 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-b2f5d095-d591-4df3-8f4b-39f0baed850b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:12:14.976870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5d095-d591-4df3-8f4b-39f0baed850b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:12:14.978319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5d095-d591-4df3-8f4b-39f0baed850b service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:12:14.986056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1374/2773] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:12:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:12:15.689043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4ec2b-f6b9-443c-957e-58d6da2c6227 service placement] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:12:15.690404 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d7c4ec2b-f6b9-443c-957e-58d6da2c6227 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:12:15.702983 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4ec2b-f6b9-443c-957e-58d6da2c6227 service placement] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:12:15.708671 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c1068-5a95-4b90-984e-f7c2b41dc229 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:12:15.709323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c1068-5a95-4b90-984e-f7c2b41dc229 service placement] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:12:15.709599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c1068-5a95-4b90-984e-f7c2b41dc229 service placement] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:12:15.709874 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c1068-5a95-4b90-984e-f7c2b41dc229 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:12:15.711632 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-228c1068-5a95-4b90-984e-f7c2b41dc229 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:12:15.723674 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c1068-5a95-4b90-984e-f7c2b41dc229 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:12:15.725287 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c1068-5a95-4b90-984e-f7c2b41dc229 service placement] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:12:15.735162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1400/2774] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:12:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:12:29.621627 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5d095-d591-4df3-8f4b-39f0baed850b service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:12:29.635066 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5d095-d591-4df3-8f4b-39f0baed850b service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:12:29.640692 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a9690-c0c3-439e-a25a-ac94c50d51c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:12:29.641371 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a9690-c0c3-439e-a25a-ac94c50d51c3 service nova] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:12:29.641651 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a9690-c0c3-439e-a25a-ac94c50d51c3 service nova] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:12:29.641922 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a9690-c0c3-439e-a25a-ac94c50d51c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:12:29.643700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ef1a9690-c0c3-439e-a25a-ac94c50d51c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:12:29.655902 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a9690-c0c3-439e-a25a-ac94c50d51c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:12:29.657641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a9690-c0c3-439e-a25a-ac94c50d51c3 service nova] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:12:29.668915 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1375/2775] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:12:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:12:32.123923 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c1068-5a95-4b90-984e-f7c2b41dc229 service placement] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:12:32.133234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c1068-5a95-4b90-984e-f7c2b41dc229 service placement] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:12:32.136945 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e14040-03ce-4aad-a6d1-89b6906019f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:12:32.137571 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e14040-03ce-4aad-a6d1-89b6906019f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:12:32.137855 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e14040-03ce-4aad-a6d1-89b6906019f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:12:32.138128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e14040-03ce-4aad-a6d1-89b6906019f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:12:32.147655 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e14040-03ce-4aad-a6d1-89b6906019f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:12:32.149069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e14040-03ce-4aad-a6d1-89b6906019f6 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:12:32.158233 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1401/2776] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:12:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:13:24.575452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a9690-c0c3-439e-a25a-ac94c50d51c3 service nova] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:13:24.585366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a9690-c0c3-439e-a25a-ac94c50d51c3 service nova] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:13:24.589044 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a559b9-3b36-4464-bc33-d67e577a76d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:13:24.589675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a559b9-3b36-4464-bc33-d67e577a76d9 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:24.589959 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a559b9-3b36-4464-bc33-d67e577a76d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:24.590238 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a559b9-3b36-4464-bc33-d67e577a76d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:24.592026 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e2a559b9-3b36-4464-bc33-d67e577a76d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:13:24.651506 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a559b9-3b36-4464-bc33-d67e577a76d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:13:24.652912 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a559b9-3b36-4464-bc33-d67e577a76d9 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:13:24.662835 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1376/2777] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:13:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:13:28.344919 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e14040-03ce-4aad-a6d1-89b6906019f6 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:13:28.344919 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-73e14040-03ce-4aad-a6d1-89b6906019f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:13:28.358148 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e14040-03ce-4aad-a6d1-89b6906019f6 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:13:28.362839 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbfe5c-ba6e-453a-b0a4-90c5686ae916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:13:28.363715 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbfe5c-ba6e-453a-b0a4-90c5686ae916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:28.363994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbfe5c-ba6e-453a-b0a4-90c5686ae916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:28.364262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbfe5c-ba6e-453a-b0a4-90c5686ae916 admin admin] PATH_INFO: `/v3/users/b030acfe033d4d6d8cca6f79d02594a7` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:28.365426 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbfe5c-ba6e-453a-b0a4-90c5686ae916 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b030acfe033d4d6d8cca6f79d02594a7)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:13:28.367336 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbfe5c-ba6e-453a-b0a4-90c5686ae916 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:13:28.544379 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6dbbfe5c-ba6e-453a-b0a4-90c5686ae916 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b030acfe033d4d6d8cca6f79d02594a7'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:13:28.545049 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6dbbfe5c-ba6e-453a-b0a4-90c5686ae916 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b030acfe033d4d6d8cca6f79d02594a7'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:13:28.545657 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6dbbfe5c-ba6e-453a-b0a4-90c5686ae916 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b030acfe033d4d6d8cca6f79d02594a7'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:13:28.557691 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6dbbfe5c-ba6e-453a-b0a4-90c5686ae916 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b030acfe033d4d6d8cca6f79d02594a7'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:13:28.564563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6dbbfe5c-ba6e-453a-b0a4-90c5686ae916 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b030acfe033d4d6d8cca6f79d02594a7'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:13:28.629274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1402/2778] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:13:28 2022] DELETE /identity/v3/users/b030acfe033d4d6d8cca6f79d02594a7 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:13:28.875434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a559b9-3b36-4464-bc33-d67e577a76d9 service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:13:28.885731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a559b9-3b36-4464-bc33-d67e577a76d9 service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:13:28.947569 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e22f6-8cd5-44cb-8411-471b82f77421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:13:28.948413 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e22f6-8cd5-44cb-8411-471b82f77421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:28.948694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e22f6-8cd5-44cb-8411-471b82f77421 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:28.948966 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e22f6-8cd5-44cb-8411-471b82f77421 admin admin] PATH_INFO: `/v3/projects/d551ab6c12f94141ad2123a8c631e98d` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:28.950167 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e22f6-8cd5-44cb-8411-471b82f77421 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d551ab6c12f94141ad2123a8c631e98d)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:13:28.952084 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e22f6-8cd5-44cb-8411-471b82f77421 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:13:29.050923 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-c87e22f6-8cd5-44cb-8411-471b82f77421 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd551ab6c12f94141ad2123a8c631e98d', 'request_id': 'req-c87e22f6-8cd5-44cb-8411-471b82f77421'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:13:29.056925 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-c87e22f6-8cd5-44cb-8411-471b82f77421 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd551ab6c12f94141ad2123a8c631e98d', 'request_id': 'req-c87e22f6-8cd5-44cb-8411-471b82f77421'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:13:29.062223 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-c87e22f6-8cd5-44cb-8411-471b82f77421 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd551ab6c12f94141ad2123a8c631e98d', 'request_id': 'req-c87e22f6-8cd5-44cb-8411-471b82f77421'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:13:29.130824 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-c87e22f6-8cd5-44cb-8411-471b82f77421 admin admin] The token cache is being invalidate because project d551ab6c12f94141ad2123a8c631e98d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:13:29.131028 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-c87e22f6-8cd5-44cb-8411-471b82f77421 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:13:29.131674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-c87e22f6-8cd5-44cb-8411-471b82f77421 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:13:29.133209 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1377/2779] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:13:28 2022] DELETE /identity/v3/projects/d551ab6c12f94141ad2123a8c631e98d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:13:29.138933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a237d64-5e35-479c-b68a-a6f1a0422b4f None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:29.140822 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a237d64-5e35-479c-b68a-a6f1a0422b4f None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:29.140822 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a237d64-5e35-479c-b68a-a6f1a0422b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:29.157352 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-8a237d64-5e35-479c-b68a-a6f1a0422b4f None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:13:29.159403 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-8a237d64-5e35-479c-b68a-a6f1a0422b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:13:29.216234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1403/2780] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:13:29.225116 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ce1a1-9bae-4272-a742-91d89c43b8b2 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:29.225402 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ce1a1-9bae-4272-a742-91d89c43b8b2 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:29.225704 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020ce1a1-9bae-4272-a742-91d89c43b8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:29.244048 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-020ce1a1-9bae-4272-a742-91d89c43b8b2 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:13:29.245232 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-020ce1a1-9bae-4272-a742-91d89c43b8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:13:29.253139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1378/2781] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:13:29.257259 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a237d64-5e35-479c-b68a-a6f1a0422b4f None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:13:29.266602 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a237d64-5e35-479c-b68a-a6f1a0422b4f None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:13:29.271835 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c0711-b63d-4459-9c28-b029ef1e305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:13:29.272509 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c0711-b63d-4459-9c28-b029ef1e305b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:29.272793 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c0711-b63d-4459-9c28-b029ef1e305b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:29.273065 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c0711-b63d-4459-9c28-b029ef1e305b admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:29.273798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c0711-b63d-4459-9c28-b029ef1e305b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:13:29.274102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c0711-b63d-4459-9c28-b029ef1e305b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:13:29.275722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c0711-b63d-4459-9c28-b029ef1e305b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:13:29.287835 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1404/2782] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:13:29.292311 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ce1a1-9bae-4272-a742-91d89c43b8b2 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:13:29.301428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020ce1a1-9bae-4272-a742-91d89c43b8b2 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:13:29.306114 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aed58-c5ce-41a0-8928-33001da26987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:13:29.306747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aed58-c5ce-41a0-8928-33001da26987 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:29.307027 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aed58-c5ce-41a0-8928-33001da26987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:29.307335 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404aed58-c5ce-41a0-8928-33001da26987 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:29.308096 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404aed58-c5ce-41a0-8928-33001da26987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:13:29.309964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404aed58-c5ce-41a0-8928-33001da26987 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:13:29.384614 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1379/2783] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:13:29 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:13:29.388795 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c0711-b63d-4459-9c28-b029ef1e305b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:13:29.400118 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c0711-b63d-4459-9c28-b029ef1e305b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:13:29.457297 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6f2e6-b878-4932-b809-c8061928045e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:13:29.457953 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6f2e6-b878-4932-b809-c8061928045e admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:29.458234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6f2e6-b878-4932-b809-c8061928045e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:29.458506 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6f2e6-b878-4932-b809-c8061928045e admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:29.459208 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6f2e6-b878-4932-b809-c8061928045e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:13:29.461153 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6f2e6-b878-4932-b809-c8061928045e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:13:29.542192 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1405/2784] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:13:29 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:13:29.546295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aed58-c5ce-41a0-8928-33001da26987 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:13:29.556641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404aed58-c5ce-41a0-8928-33001da26987 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:13:29.561398 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183d5b2-2696-4589-ab6a-94addc7db061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:13:29.562051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183d5b2-2696-4589-ab6a-94addc7db061 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:29.562336 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183d5b2-2696-4589-ab6a-94addc7db061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:29.562613 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2183d5b2-2696-4589-ab6a-94addc7db061 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:29.563397 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183d5b2-2696-4589-ab6a-94addc7db061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:13:29.565501 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2183d5b2-2696-4589-ab6a-94addc7db061 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:13:29.575851 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1380/2785] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:13:29.580620 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6f2e6-b878-4932-b809-c8061928045e admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:13:29.590299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6f2e6-b878-4932-b809-c8061928045e admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:13:29.594975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b003207-b636-40e3-8aa1-0c4643cada40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:13:29.595653 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003207-b636-40e3-8aa1-0c4643cada40 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:29.595935 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003207-b636-40e3-8aa1-0c4643cada40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:29.596207 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b003207-b636-40e3-8aa1-0c4643cada40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:29.596933 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b003207-b636-40e3-8aa1-0c4643cada40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:13:29.598501 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b003207-b636-40e3-8aa1-0c4643cada40 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:13:29.608020 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1406/2786] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:13:29.612310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183d5b2-2696-4589-ab6a-94addc7db061 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:13:29.621776 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2183d5b2-2696-4589-ab6a-94addc7db061 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:13:29.629269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319bd5b-5593-4573-8730-99534e0fbb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:13:29.629269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319bd5b-5593-4573-8730-99534e0fbb17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:29.629269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319bd5b-5593-4573-8730-99534e0fbb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:29.629269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5319bd5b-5593-4573-8730-99534e0fbb17 admin admin] PATH_INFO: `/v3/projects/99775d25a0644bedaa6fde643ac9b2b7/users/4c2bedfa52e44f068a6e7bb46ba3ba26/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:29.644882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319bd5b-5593-4573-8730-99534e0fbb17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99775d25a0644bedaa6fde643ac9b2b7, user_id=4c2bedfa52e44f068a6e7bb46ba3ba26, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:13:29.647533 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5319bd5b-5593-4573-8730-99534e0fbb17 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:13:29.731463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1381/2787] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:13:29 2022] PUT /identity/v3/projects/99775d25a0644bedaa6fde643ac9b2b7/users/4c2bedfa52e44f068a6e7bb46ba3ba26/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:13:29.737018 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144c67-9879-4647-9cc5-60dae1d204d4 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:29.737327 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144c67-9879-4647-9cc5-60dae1d204d4 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:29.737615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c144c67-9879-4647-9cc5-60dae1d204d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:29.755585 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-2c144c67-9879-4647-9cc5-60dae1d204d4 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:13:29.756785 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2c144c67-9879-4647-9cc5-60dae1d204d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:13:29.812227 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1407/2788] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:13:29.822401 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319bd5b-5593-4573-8730-99534e0fbb17 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:13:29.824093 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-5319bd5b-5593-4573-8730-99534e0fbb17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:13:29.879638 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5319bd5b-5593-4573-8730-99534e0fbb17 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:13:29.883522 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ee91e-892c-4452-8d28-b05c80a91ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:13:29.884156 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ee91e-892c-4452-8d28-b05c80a91ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:29.884434 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ee91e-892c-4452-8d28-b05c80a91ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:29.884706 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ee91e-892c-4452-8d28-b05c80a91ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:29.893650 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ee91e-892c-4452-8d28-b05c80a91ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:13:29.895103 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ee91e-892c-4452-8d28-b05c80a91ae4 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:13:29.904099 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1382/2789] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:13:31.084706 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f1f37-ff52-4dff-bc8e-1ddbec6a11ae None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:31.085160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f1f37-ff52-4dff-bc8e-1ddbec6a11ae None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:31.085160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3f1f37-ff52-4dff-bc8e-1ddbec6a11ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:31.111951 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1a3f1f37-ff52-4dff-bc8e-1ddbec6a11ae None None] MFA Rules not processed for user `4c2bedfa52e44f068a6e7bb46ba3ba26`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:13:31.113205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1a3f1f37-ff52-4dff-bc8e-1ddbec6a11ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:13:31.175924 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1408/2790] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:13:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:13:31.186274 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08753b8-bb49-480a-85d7-4545204e30b8 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:31.186756 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08753b8-bb49-480a-85d7-4545204e30b8 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:31.186862 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08753b8-bb49-480a-85d7-4545204e30b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:31.205310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-e08753b8-bb49-480a-85d7-4545204e30b8 None None] MFA Rules not processed for user `4c2bedfa52e44f068a6e7bb46ba3ba26`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:13:31.206502 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e08753b8-bb49-480a-85d7-4545204e30b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:13:31.213344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1383/2791] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:13:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:13:31.223903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f1f37-ff52-4dff-bc8e-1ddbec6a11ae None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:13:31.225251 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1a3f1f37-ff52-4dff-bc8e-1ddbec6a11ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:13:31.295650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3f1f37-ff52-4dff-bc8e-1ddbec6a11ae None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:13:31.302021 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f0189-b8a0-493b-80e0-74e849981d25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '362ab4aeb88746d8b8a14a238c877a53', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:13:31.302650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0189-b8a0-493b-80e0-74e849981d25 service nova] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:31.302929 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0189-b8a0-493b-80e0-74e849981d25 service nova] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:31.303200 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0189-b8a0-493b-80e0-74e849981d25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:31.310630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f0189-b8a0-493b-80e0-74e849981d25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:13:31.312219 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f0189-b8a0-493b-80e0-74e849981d25 service nova] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:13:31.320607 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1409/2792] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:13:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:13:54.548170 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf86f3-bb7d-43cf-8cdb-e0d56bef2148 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:13:54.548684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf86f3-bb7d-43cf-8cdb-e0d56bef2148 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:13:54.548777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf86f3-bb7d-43cf-8cdb-e0d56bef2148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:13:54.567168 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-91bf86f3-bb7d-43cf-8cdb-e0d56bef2148 None None] MFA Rules not processed for user `4c2bedfa52e44f068a6e7bb46ba3ba26`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:13:54.568370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-91bf86f3-bb7d-43cf-8cdb-e0d56bef2148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:13:54.575055 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1384/2793] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:13:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:14:08.744682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5d963-30cb-44d8-9dea-8fb6479a59d5 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:14:08.745205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5d963-30cb-44d8-9dea-8fb6479a59d5 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:14:08.745205 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5d963-30cb-44d8-9dea-8fb6479a59d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:14:08.762434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-12f5d963-30cb-44d8-9dea-8fb6479a59d5 None None] MFA Rules not processed for user `4c2bedfa52e44f068a6e7bb46ba3ba26`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:14:08.763649 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-12f5d963-30cb-44d8-9dea-8fb6479a59d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:14:08.770527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1410/2794] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:14:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:14:29.744742 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf86f3-bb7d-43cf-8cdb-e0d56bef2148 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:14:29.754710 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf86f3-bb7d-43cf-8cdb-e0d56bef2148 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:14:29.758260 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe14791-bb73-4dce-bb90-0c3004f007e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:14:29.758890 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe14791-bb73-4dce-bb90-0c3004f007e5 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:14:29.759169 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe14791-bb73-4dce-bb90-0c3004f007e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:14:29.759472 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe14791-bb73-4dce-bb90-0c3004f007e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:14:29.761252 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0fe14791-bb73-4dce-bb90-0c3004f007e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:14:29.788766 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe14791-bb73-4dce-bb90-0c3004f007e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:14:29.790187 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe14791-bb73-4dce-bb90-0c3004f007e5 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:14:29.801149 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1385/2795] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:14:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:14:32.611547 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbac895-fc94-4ef5-bf8c-2eb531e2eb7d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:14:32.612036 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbac895-fc94-4ef5-bf8c-2eb531e2eb7d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:14:32.612122 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbac895-fc94-4ef5-bf8c-2eb531e2eb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:14:32.631095 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-3bbac895-fc94-4ef5-bf8c-2eb531e2eb7d None None] MFA Rules not processed for user `4c2bedfa52e44f068a6e7bb46ba3ba26`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:14:32.632366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3bbac895-fc94-4ef5-bf8c-2eb531e2eb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:14:32.639134 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1411/2796] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:14:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:14:44.672828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2d428-9e36-475b-a79f-2af5d088f0a4 None None] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:14:44.673636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2d428-9e36-475b-a79f-2af5d088f0a4 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:14:44.673636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2d428-9e36-475b-a79f-2af5d088f0a4 None None] PATH_INFO: `/` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:14:44.675443 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1386/2797] 10.222.0.35 () {54 vars in 921 bytes} [Sat Feb 12 05:14:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 05:14:44.682577 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f170a7-d8af-425f-96ec-aed57a6cb16e None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:14:44.683092 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f170a7-d8af-425f-96ec-aed57a6cb16e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:14:44.683216 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f170a7-d8af-425f-96ec-aed57a6cb16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:14:44.720262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-d4f170a7-d8af-425f-96ec-aed57a6cb16e None None] MFA Rules not processed for user `d9c5541a29cf42f6ab394133baa05fae`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:14:44.721480 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-d4f170a7-d8af-425f-96ec-aed57a6cb16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:14:44.728415 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1412/2798] 10.222.0.35 () {58 vars in 1018 bytes} [Sat Feb 12 05:14:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:14:44.740387 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2d428-9e36-475b-a79f-2af5d088f0a4 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:14:44.750969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2d428-9e36-475b-a79f-2af5d088f0a4 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:14:44.754754 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c279ac-9bd4-4589-9ac0-ac02e3f26c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:14:44.755463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c279ac-9bd4-4589-9ac0-ac02e3f26c8f service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:14:44.755749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c279ac-9bd4-4589-9ac0-ac02e3f26c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:14:44.756027 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c279ac-9bd4-4589-9ac0-ac02e3f26c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:14:44.762900 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c279ac-9bd4-4589-9ac0-ac02e3f26c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:14:44.764355 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c279ac-9bd4-4589-9ac0-ac02e3f26c8f service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:14:44.772407 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1387/2799] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:14:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:14:44.857443 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c267e1e-db59-40ba-8a76-2c144ddec8c8 None None] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:14:44.857726 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c267e1e-db59-40ba-8a76-2c144ddec8c8 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:14:44.858001 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c267e1e-db59-40ba-8a76-2c144ddec8c8 None None] PATH_INFO: `/` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:14:44.859804 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1413/2800] 10.222.0.35 () {54 vars in 921 bytes} [Sat Feb 12 05:14:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Feb 12 05:14:44.865204 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd45cf-8f20-440c-b079-d4a2b11b597d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:14:44.865487 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd45cf-8f20-440c-b079-d4a2b11b597d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:14:44.865777 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fd45cf-8f20-440c-b079-d4a2b11b597d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:14:44.900791 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-03fd45cf-8f20-440c-b079-d4a2b11b597d None None] MFA Rules not processed for user `362ab4aeb88746d8b8a14a238c877a53`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:14:44.901969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-03fd45cf-8f20-440c-b079-d4a2b11b597d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:14:44.911059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1388/2801] 10.222.0.35 () {58 vars in 1018 bytes} [Sat Feb 12 05:14:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:14:44.921140 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c267e1e-db59-40ba-8a76-2c144ddec8c8 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:14:44.932399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c267e1e-db59-40ba-8a76-2c144ddec8c8 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:14:44.935985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7f878-5145-406e-a858-aa9390901645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:14:44.936616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7f878-5145-406e-a858-aa9390901645 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:14:44.936897 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7f878-5145-406e-a858-aa9390901645 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:14:44.937186 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7f878-5145-406e-a858-aa9390901645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:14:44.948114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7f878-5145-406e-a858-aa9390901645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:14:44.949530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7f878-5145-406e-a858-aa9390901645 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:14:44.960588 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1414/2802] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:14:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:15:17.406842 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd45cf-8f20-440c-b079-d4a2b11b597d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:17.417939 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fd45cf-8f20-440c-b079-d4a2b11b597d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:17.422589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e4294-879e-48da-a2ad-e1ea60d64b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:17.423489 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e4294-879e-48da-a2ad-e1ea60d64b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:17.423770 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e4294-879e-48da-a2ad-e1ea60d64b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:17.424068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e4294-879e-48da-a2ad-e1ea60d64b78 admin admin] PATH_INFO: `/v3/users/4c2bedfa52e44f068a6e7bb46ba3ba26` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:17.425264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e4294-879e-48da-a2ad-e1ea60d64b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2bedfa52e44f068a6e7bb46ba3ba26)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:17.427159 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e4294-879e-48da-a2ad-e1ea60d64b78 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:17.572716 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d86e4294-879e-48da-a2ad-e1ea60d64b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2bedfa52e44f068a6e7bb46ba3ba26'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:17.573392 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d86e4294-879e-48da-a2ad-e1ea60d64b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2bedfa52e44f068a6e7bb46ba3ba26'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:17.574011 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d86e4294-879e-48da-a2ad-e1ea60d64b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2bedfa52e44f068a6e7bb46ba3ba26'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:17.586432 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d86e4294-879e-48da-a2ad-e1ea60d64b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2bedfa52e44f068a6e7bb46ba3ba26'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:17.593065 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-d86e4294-879e-48da-a2ad-e1ea60d64b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2bedfa52e44f068a6e7bb46ba3ba26'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:17.644523 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1389/2803] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:15:17 2022] DELETE /identity/v3/users/4c2bedfa52e44f068a6e7bb46ba3ba26 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:17.887345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7f878-5145-406e-a858-aa9390901645 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:17.901674 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7f878-5145-406e-a858-aa9390901645 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:17.957494 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b92fa8-766c-417b-9c2e-8d825629517a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:17.958335 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b92fa8-766c-417b-9c2e-8d825629517a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:17.958616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b92fa8-766c-417b-9c2e-8d825629517a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:17.958890 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b92fa8-766c-417b-9c2e-8d825629517a admin admin] PATH_INFO: `/v3/projects/99775d25a0644bedaa6fde643ac9b2b7` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:17.960622 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b92fa8-766c-417b-9c2e-8d825629517a admin admin] RBAC: Authorizing `identity:delete_project(project_id=99775d25a0644bedaa6fde643ac9b2b7)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:17.962618 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b92fa8-766c-417b-9c2e-8d825629517a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:18.071644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e6b92fa8-766c-417b-9c2e-8d825629517a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99775d25a0644bedaa6fde643ac9b2b7', 'request_id': 'req-e6b92fa8-766c-417b-9c2e-8d825629517a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:18.140286 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e6b92fa8-766c-417b-9c2e-8d825629517a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99775d25a0644bedaa6fde643ac9b2b7', 'request_id': 'req-e6b92fa8-766c-417b-9c2e-8d825629517a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:18.146225 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e6b92fa8-766c-417b-9c2e-8d825629517a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99775d25a0644bedaa6fde643ac9b2b7', 'request_id': 'req-e6b92fa8-766c-417b-9c2e-8d825629517a'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:18.157650 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e6b92fa8-766c-417b-9c2e-8d825629517a admin admin] The token cache is being invalidate because project 99775d25a0644bedaa6fde643ac9b2b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:15:18.157935 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e6b92fa8-766c-417b-9c2e-8d825629517a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:18.158563 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-e6b92fa8-766c-417b-9c2e-8d825629517a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:18.160083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1415/2804] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:15:17 2022] DELETE /identity/v3/projects/99775d25a0644bedaa6fde643ac9b2b7 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:18.165043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a315bf-2a16-4553-a07f-be5f8624c0e5 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:18.165356 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a315bf-2a16-4553-a07f-be5f8624c0e5 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:18.165631 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a315bf-2a16-4553-a07f-be5f8624c0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:18.183566 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-e4a315bf-2a16-4553-a07f-be5f8624c0e5 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:18.184768 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e4a315bf-2a16-4553-a07f-be5f8624c0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:18.242003 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1390/2805] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:15:18.249493 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c162-7a99-4cf6-b56b-7bcbe5a95a9a None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:18.249867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c162-7a99-4cf6-b56b-7bcbe5a95a9a None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:18.250151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9c162-7a99-4cf6-b56b-7bcbe5a95a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:18.268715 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-efe9c162-7a99-4cf6-b56b-7bcbe5a95a9a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:18.269868 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-efe9c162-7a99-4cf6-b56b-7bcbe5a95a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:18.278246 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1416/2806] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:18.282479 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a315bf-2a16-4553-a07f-be5f8624c0e5 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:18.293064 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a315bf-2a16-4553-a07f-be5f8624c0e5 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:18.297697 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49942c54-3e8c-4371-9390-10d399e0e265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:18.298344 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49942c54-3e8c-4371-9390-10d399e0e265 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:18.298626 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49942c54-3e8c-4371-9390-10d399e0e265 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:18.298903 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49942c54-3e8c-4371-9390-10d399e0e265 admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:18.299662 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49942c54-3e8c-4371-9390-10d399e0e265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:15:18.299962 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49942c54-3e8c-4371-9390-10d399e0e265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:18.301537 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49942c54-3e8c-4371-9390-10d399e0e265 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:18.313308 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1391/2807] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:15:18.317516 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9c162-7a99-4cf6-b56b-7bcbe5a95a9a None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:18.329194 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9c162-7a99-4cf6-b56b-7bcbe5a95a9a None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:18.333796 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6b612-69d5-46ab-8c51-3155f5d5fa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:18.334429 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6b612-69d5-46ab-8c51-3155f5d5fa94 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:18.335323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6b612-69d5-46ab-8c51-3155f5d5fa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:18.335615 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6b612-69d5-46ab-8c51-3155f5d5fa94 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:18.336299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6b612-69d5-46ab-8c51-3155f5d5fa94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:18.338162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e6b612-69d5-46ab-8c51-3155f5d5fa94 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:18.457758 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1417/2808] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:15:18 2022] POST /identity/v3/projects => generated 355 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:18.462031 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49942c54-3e8c-4371-9390-10d399e0e265 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:18.471969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49942c54-3e8c-4371-9390-10d399e0e265 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:18.527574 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957327de-592e-410a-b2fc-0f1c7000db19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:18.528219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957327de-592e-410a-b2fc-0f1c7000db19 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:18.528496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957327de-592e-410a-b2fc-0f1c7000db19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:18.528768 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957327de-592e-410a-b2fc-0f1c7000db19 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:18.529456 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957327de-592e-410a-b2fc-0f1c7000db19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:18.531370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957327de-592e-410a-b2fc-0f1c7000db19 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:18.622588 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1392/2809] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:15:18 2022] POST /identity/v3/users => generated 278 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:18.626666 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6b612-69d5-46ab-8c51-3155f5d5fa94 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:18.637444 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6b612-69d5-46ab-8c51-3155f5d5fa94 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:18.642110 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7ec13-cee3-4f25-b979-c6c46f21c48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:18.642756 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ec13-cee3-4f25-b979-c6c46f21c48d admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:18.643036 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ec13-cee3-4f25-b979-c6c46f21c48d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:18.643341 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd7ec13-cee3-4f25-b979-c6c46f21c48d admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:18.644112 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7ec13-cee3-4f25-b979-c6c46f21c48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:18.645705 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd7ec13-cee3-4f25-b979-c6c46f21c48d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:18.655892 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1418/2810] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:15:18.666296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957327de-592e-410a-b2fc-0f1c7000db19 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:18.676191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957327de-592e-410a-b2fc-0f1c7000db19 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:18.681441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df3cd3-dc94-4c01-9558-f2b912e86479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:18.682085 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3cd3-dc94-4c01-9558-f2b912e86479 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:18.682370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3cd3-dc94-4c01-9558-f2b912e86479 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:18.682648 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df3cd3-dc94-4c01-9558-f2b912e86479 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:18.683425 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df3cd3-dc94-4c01-9558-f2b912e86479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:18.685077 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68df3cd3-dc94-4c01-9558-f2b912e86479 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:18.695605 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1393/2811] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:15:18.699634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7ec13-cee3-4f25-b979-c6c46f21c48d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:18.709611 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd7ec13-cee3-4f25-b979-c6c46f21c48d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:18.714288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5811ab-dc1a-4423-b342-c1350bfc5d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:18.715142 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5811ab-dc1a-4423-b342-c1350bfc5d6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:18.715478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5811ab-dc1a-4423-b342-c1350bfc5d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:18.715756 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5811ab-dc1a-4423-b342-c1350bfc5d6c admin admin] PATH_INFO: `/v3/projects/0f914aecd2d34800ac7c7c04601e4083/users/29fd92850f844f95b6f703786715ffaa/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:18.730221 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5811ab-dc1a-4423-b342-c1350bfc5d6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f914aecd2d34800ac7c7c04601e4083, user_id=29fd92850f844f95b6f703786715ffaa, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:18.732903 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5811ab-dc1a-4423-b342-c1350bfc5d6c admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:18.833567 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1419/2812] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:15:18 2022] PUT /identity/v3/projects/0f914aecd2d34800ac7c7c04601e4083/users/29fd92850f844f95b6f703786715ffaa/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:18.844141 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3534a7a-e550-4c5f-8771-a78b05b16fcc None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:18.844428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3534a7a-e550-4c5f-8771-a78b05b16fcc None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:18.844729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3534a7a-e550-4c5f-8771-a78b05b16fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:18.871071 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-c3534a7a-e550-4c5f-8771-a78b05b16fcc None None] MFA Rules not processed for user `29fd92850f844f95b6f703786715ffaa`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:18.872291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c3534a7a-e550-4c5f-8771-a78b05b16fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:18.932363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1394/2813] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:18 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:18.937048 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5811ab-dc1a-4423-b342-c1350bfc5d6c admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:18.996123 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5811ab-dc1a-4423-b342-c1350bfc5d6c admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:19.000715 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0165dde-faea-4817-9ca7-2422af805316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:19.001354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0165dde-faea-4817-9ca7-2422af805316 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:19.001635 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0165dde-faea-4817-9ca7-2422af805316 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:19.001910 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0165dde-faea-4817-9ca7-2422af805316 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:19.002609 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0165dde-faea-4817-9ca7-2422af805316 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:19.004511 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0165dde-faea-4817-9ca7-2422af805316 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:19.090856 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1420/2814] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:15:18 2022] POST /identity/v3/projects => generated 357 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:19.094910 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3534a7a-e550-4c5f-8771-a78b05b16fcc None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:19.105926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3534a7a-e550-4c5f-8771-a78b05b16fcc None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:19.158240 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcce78-8167-499a-adfe-77af8ba0657b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:19.158891 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcce78-8167-499a-adfe-77af8ba0657b admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:19.159174 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcce78-8167-499a-adfe-77af8ba0657b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:19.159475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcce78-8167-499a-adfe-77af8ba0657b admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:19.160160 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcce78-8167-499a-adfe-77af8ba0657b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:19.162035 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcce78-8167-499a-adfe-77af8ba0657b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:19.255009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1395/2815] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:15:19 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:19.259163 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0165dde-faea-4817-9ca7-2422af805316 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:19.269421 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0165dde-faea-4817-9ca7-2422af805316 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:19.274762 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52633e11-6d0f-4b41-bfea-74ba7fde453b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:19.275441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52633e11-6d0f-4b41-bfea-74ba7fde453b admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:19.275725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52633e11-6d0f-4b41-bfea-74ba7fde453b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:19.276001 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52633e11-6d0f-4b41-bfea-74ba7fde453b admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:19.276774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52633e11-6d0f-4b41-bfea-74ba7fde453b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:19.278351 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52633e11-6d0f-4b41-bfea-74ba7fde453b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:19.289965 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1421/2816] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:15:19.294238 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcce78-8167-499a-adfe-77af8ba0657b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:19.304387 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcce78-8167-499a-adfe-77af8ba0657b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:19.309230 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc84ea5-7eec-44e4-8cf0-4b54c02e8027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:19.310130 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc84ea5-7eec-44e4-8cf0-4b54c02e8027 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:19.310441 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc84ea5-7eec-44e4-8cf0-4b54c02e8027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:19.310715 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc84ea5-7eec-44e4-8cf0-4b54c02e8027 admin admin] PATH_INFO: `/v3/projects/ffdbfbe089844e9790cc121105894896/users/65a20f4383ef42a1b474c17580ec5a40/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:19.324632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc84ea5-7eec-44e4-8cf0-4b54c02e8027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdbfbe089844e9790cc121105894896, user_id=65a20f4383ef42a1b474c17580ec5a40, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:19.327520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc84ea5-7eec-44e4-8cf0-4b54c02e8027 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:19.427985 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1396/2817] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:15:19 2022] PUT /identity/v3/projects/ffdbfbe089844e9790cc121105894896/users/65a20f4383ef42a1b474c17580ec5a40/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:15:19.432095 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52633e11-6d0f-4b41-bfea-74ba7fde453b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:19.441860 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52633e11-6d0f-4b41-bfea-74ba7fde453b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:19.496924 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6724b2-1e4b-4d06-b71a-501bd73328a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:19.497578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6724b2-1e4b-4d06-b71a-501bd73328a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:19.497859 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6724b2-1e4b-4d06-b71a-501bd73328a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:19.498138 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6724b2-1e4b-4d06-b71a-501bd73328a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:19.498866 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6724b2-1e4b-4d06-b71a-501bd73328a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:19.500518 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6724b2-1e4b-4d06-b71a-501bd73328a0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:19.510517 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1422/2818] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:15:19.514550 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc84ea5-7eec-44e4-8cf0-4b54c02e8027 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:19.525297 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc84ea5-7eec-44e4-8cf0-4b54c02e8027 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:19.529882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd0d72-a27e-42e6-a84b-52a9baed05ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:19.530747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd0d72-a27e-42e6-a84b-52a9baed05ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:19.531025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd0d72-a27e-42e6-a84b-52a9baed05ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:19.534343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd0d72-a27e-42e6-a84b-52a9baed05ef admin admin] PATH_INFO: `/v3/projects/ffdbfbe089844e9790cc121105894896/users/65a20f4383ef42a1b474c17580ec5a40/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:19.534343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd0d72-a27e-42e6-a84b-52a9baed05ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdbfbe089844e9790cc121105894896, user_id=65a20f4383ef42a1b474c17580ec5a40, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:19.536003 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd0d72-a27e-42e6-a84b-52a9baed05ef admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:19.546162 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1397/2819] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:15:19 2022] PUT /identity/v3/projects/ffdbfbe089844e9790cc121105894896/users/65a20f4383ef42a1b474c17580ec5a40/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:19.555992 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72778c3-0414-40d1-b369-6a642a370c93 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:19.556280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72778c3-0414-40d1-b369-6a642a370c93 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:19.556559 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72778c3-0414-40d1-b369-6a642a370c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:19.582678 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-c72778c3-0414-40d1-b369-6a642a370c93 None None] MFA Rules not processed for user `65a20f4383ef42a1b474c17580ec5a40`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:19.583882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-c72778c3-0414-40d1-b369-6a642a370c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:19.649479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1423/2820] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:19 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:19.659559 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd0d72-a27e-42e6-a84b-52a9baed05ef admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:19.661330 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-cafd0d72-a27e-42e6-a84b-52a9baed05ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:19.730954 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd0d72-a27e-42e6-a84b-52a9baed05ef admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:19.734581 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701d698-61d0-4718-88dd-0ae5e92be6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:19.735694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701d698-61d0-4718-88dd-0ae5e92be6da service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:19.736009 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701d698-61d0-4718-88dd-0ae5e92be6da service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:19.736281 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3701d698-61d0-4718-88dd-0ae5e92be6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:19.745503 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701d698-61d0-4718-88dd-0ae5e92be6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:19.746954 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3701d698-61d0-4718-88dd-0ae5e92be6da service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:19.756264 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1398/2821] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:15:19 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:15:19.930890 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72778c3-0414-40d1-b369-6a642a370c93 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:19.940433 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72778c3-0414-40d1-b369-6a642a370c93 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:19.944057 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4e3b5-4c4a-487d-8d4a-1cf144e38310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:19.945271 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4e3b5-4c4a-487d-8d4a-1cf144e38310 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:19.945555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4e3b5-4c4a-487d-8d4a-1cf144e38310 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:19.945826 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4e3b5-4c4a-487d-8d4a-1cf144e38310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:20.001103 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4e3b5-4c4a-487d-8d4a-1cf144e38310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:20.002529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4e3b5-4c4a-487d-8d4a-1cf144e38310 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:20.012028 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1424/2822] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:15:19 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:15:38.084259 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701d698-61d0-4718-88dd-0ae5e92be6da service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:38.147775 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3701d698-61d0-4718-88dd-0ae5e92be6da service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:38.153287 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83950aa-2f57-47ac-b6c0-b5939c618ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:38.154160 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83950aa-2f57-47ac-b6c0-b5939c618ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:38.154439 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83950aa-2f57-47ac-b6c0-b5939c618ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:38.154712 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83950aa-2f57-47ac-b6c0-b5939c618ed1 admin admin] PATH_INFO: `/v3/users/29fd92850f844f95b6f703786715ffaa` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:38.156023 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83950aa-2f57-47ac-b6c0-b5939c618ed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29fd92850f844f95b6f703786715ffaa)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:38.157927 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83950aa-2f57-47ac-b6c0-b5939c618ed1 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:38.371139 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a83950aa-2f57-47ac-b6c0-b5939c618ed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29fd92850f844f95b6f703786715ffaa'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:38.371749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a83950aa-2f57-47ac-b6c0-b5939c618ed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29fd92850f844f95b6f703786715ffaa'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:38.372347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a83950aa-2f57-47ac-b6c0-b5939c618ed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29fd92850f844f95b6f703786715ffaa'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:38.384253 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a83950aa-2f57-47ac-b6c0-b5939c618ed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29fd92850f844f95b6f703786715ffaa'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:38.390763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-a83950aa-2f57-47ac-b6c0-b5939c618ed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29fd92850f844f95b6f703786715ffaa'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:38.466471 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1399/2823] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:15:38 2022] DELETE /identity/v3/users/29fd92850f844f95b6f703786715ffaa => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:38.470850 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2d842-e21f-4817-969f-5a13fa767231 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:38.471354 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2d842-e21f-4817-969f-5a13fa767231 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:38.471464 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2d842-e21f-4817-969f-5a13fa767231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:38.490798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-a0b2d842-e21f-4817-969f-5a13fa767231 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:38.492043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a0b2d842-e21f-4817-969f-5a13fa767231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:38.549518 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1425/2824] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:38.559582 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83950aa-2f57-47ac-b6c0-b5939c618ed1 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:38.560998 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-a83950aa-2f57-47ac-b6c0-b5939c618ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:38.614573 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83950aa-2f57-47ac-b6c0-b5939c618ed1 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:38.618759 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586929a-cd26-4cdd-9d9c-dffda2f20ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:38.619422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586929a-cd26-4cdd-9d9c-dffda2f20ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:38.619708 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586929a-cd26-4cdd-9d9c-dffda2f20ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:38.620013 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586929a-cd26-4cdd-9d9c-dffda2f20ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:38.633476 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586929a-cd26-4cdd-9d9c-dffda2f20ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:38.633476 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e586929a-cd26-4cdd-9d9c-dffda2f20ef6 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:38.641824 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1400/2825] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:15:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:15:39.041080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2d842-e21f-4817-969f-5a13fa767231 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:39.042573 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-a0b2d842-e21f-4817-969f-5a13fa767231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:39.056274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2d842-e21f-4817-969f-5a13fa767231 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:39.061770 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:39.062635 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:39.062942 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:39.063214 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] PATH_INFO: `/v3/projects/0f914aecd2d34800ac7c7c04601e4083` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:39.064483 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f914aecd2d34800ac7c7c04601e4083)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:39.066479 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:39.152069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f914aecd2d34800ac7c7c04601e4083', 'request_id': 'req-9e7cd583-9d56-4992-bdef-4d4ef92645c1'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:39.198155 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f914aecd2d34800ac7c7c04601e4083', 'request_id': 'req-9e7cd583-9d56-4992-bdef-4d4ef92645c1'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:39.204018 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f914aecd2d34800ac7c7c04601e4083', 'request_id': 'req-9e7cd583-9d56-4992-bdef-4d4ef92645c1'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:39.215102 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] The token cache is being invalidate because project 0f914aecd2d34800ac7c7c04601e4083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:15:39.215413 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:39.216034 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:39.217537 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1426/2826] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:15:39 2022] DELETE /identity/v3/projects/0f914aecd2d34800ac7c7c04601e4083 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:39.221514 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586929a-cd26-4cdd-9d9c-dffda2f20ef6 service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:39.231700 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586929a-cd26-4cdd-9d9c-dffda2f20ef6 service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:39.285613 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9b5ac-af18-41e5-b96a-d61712ad2b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:39.286462 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b5ac-af18-41e5-b96a-d61712ad2b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:39.286740 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b5ac-af18-41e5-b96a-d61712ad2b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:39.287010 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9b5ac-af18-41e5-b96a-d61712ad2b30 admin admin] PATH_INFO: `/v3/users/65a20f4383ef42a1b474c17580ec5a40` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:39.288223 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9b5ac-af18-41e5-b96a-d61712ad2b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65a20f4383ef42a1b474c17580ec5a40)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:39.290897 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9b5ac-af18-41e5-b96a-d61712ad2b30 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:39.446128 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-44b9b5ac-af18-41e5-b96a-d61712ad2b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65a20f4383ef42a1b474c17580ec5a40'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:39.446870 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-44b9b5ac-af18-41e5-b96a-d61712ad2b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65a20f4383ef42a1b474c17580ec5a40'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:39.447485 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-44b9b5ac-af18-41e5-b96a-d61712ad2b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65a20f4383ef42a1b474c17580ec5a40'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:39.458888 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-44b9b5ac-af18-41e5-b96a-d61712ad2b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65a20f4383ef42a1b474c17580ec5a40'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:39.466025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-44b9b5ac-af18-41e5-b96a-d61712ad2b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65a20f4383ef42a1b474c17580ec5a40'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:39.517964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1401/2827] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:15:39 2022] DELETE /identity/v3/users/65a20f4383ef42a1b474c17580ec5a40 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:39.914398 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:39.915971 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:39.934033 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7cd583-9d56-4992-bdef-4d4ef92645c1 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:39.990225 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aab0e2-c657-436f-b38b-293ca921bf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:39.991114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aab0e2-c657-436f-b38b-293ca921bf6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:39.991437 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aab0e2-c657-436f-b38b-293ca921bf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:39.991717 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aab0e2-c657-436f-b38b-293ca921bf6f admin admin] PATH_INFO: `/v3/projects/ffdbfbe089844e9790cc121105894896` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:39.992972 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aab0e2-c657-436f-b38b-293ca921bf6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffdbfbe089844e9790cc121105894896)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:39.994865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aab0e2-c657-436f-b38b-293ca921bf6f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:40.112033 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-67aab0e2-c657-436f-b38b-293ca921bf6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffdbfbe089844e9790cc121105894896', 'request_id': 'req-67aab0e2-c657-436f-b38b-293ca921bf6f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:40.175486 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-67aab0e2-c657-436f-b38b-293ca921bf6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffdbfbe089844e9790cc121105894896', 'request_id': 'req-67aab0e2-c657-436f-b38b-293ca921bf6f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:40.181000 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-67aab0e2-c657-436f-b38b-293ca921bf6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffdbfbe089844e9790cc121105894896', 'request_id': 'req-67aab0e2-c657-436f-b38b-293ca921bf6f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:40.191976 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-67aab0e2-c657-436f-b38b-293ca921bf6f admin admin] The token cache is being invalidate because project ffdbfbe089844e9790cc121105894896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:15:40.192202 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-67aab0e2-c657-436f-b38b-293ca921bf6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:40.192830 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-67aab0e2-c657-436f-b38b-293ca921bf6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:40.194348 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1427/2828] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:15:39 2022] DELETE /identity/v3/projects/ffdbfbe089844e9790cc121105894896 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:40.199630 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7c31-b140-4194-a016-6bea232da50b None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:40.199922 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7c31-b140-4194-a016-6bea232da50b None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:40.200199 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2d7c31-b140-4194-a016-6bea232da50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:40.247407 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-0f2d7c31-b140-4194-a016-6bea232da50b None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:40.248597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-0f2d7c31-b140-4194-a016-6bea232da50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:40.304567 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1402/2829] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:40.313018 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b68fd-114d-4083-bc77-93a0730f1f5c None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:40.313302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b68fd-114d-4083-bc77-93a0730f1f5c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:40.313608 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b68fd-114d-4083-bc77-93a0730f1f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:40.332114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-677b68fd-114d-4083-bc77-93a0730f1f5c None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:40.333292 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-677b68fd-114d-4083-bc77-93a0730f1f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:40.341168 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1428/2830] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:40.345216 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d7c31-b140-4194-a016-6bea232da50b None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:40.354730 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2d7c31-b140-4194-a016-6bea232da50b None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:40.359399 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b3ad3-4e4d-44ed-bdb0-42c0f087b2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:40.360042 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b3ad3-4e4d-44ed-bdb0-42c0f087b2ce admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:40.360326 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b3ad3-4e4d-44ed-bdb0-42c0f087b2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:40.360600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b3ad3-4e4d-44ed-bdb0-42c0f087b2ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:40.361323 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b3ad3-4e4d-44ed-bdb0-42c0f087b2ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:15:40.361620 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b3ad3-4e4d-44ed-bdb0-42c0f087b2ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:40.363178 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b3ad3-4e4d-44ed-bdb0-42c0f087b2ce admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:40.375291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1403/2831] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:15:40.379774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b68fd-114d-4083-bc77-93a0730f1f5c None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:40.389997 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b68fd-114d-4083-bc77-93a0730f1f5c None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:40.394963 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210061d8-c0d8-4a5a-9bc5-9847350bd699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:40.395808 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210061d8-c0d8-4a5a-9bc5-9847350bd699 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:40.396093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210061d8-c0d8-4a5a-9bc5-9847350bd699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:40.396368 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210061d8-c0d8-4a5a-9bc5-9847350bd699 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:40.397114 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210061d8-c0d8-4a5a-9bc5-9847350bd699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:40.399014 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210061d8-c0d8-4a5a-9bc5-9847350bd699 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:40.515528 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1429/2832] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:15:40 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:40.519775 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b3ad3-4e4d-44ed-bdb0-42c0f087b2ce admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:40.530055 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b3ad3-4e4d-44ed-bdb0-42c0f087b2ce admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:40.585289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904482c-969a-4e46-bd81-506dd0a2322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:40.585957 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904482c-969a-4e46-bd81-506dd0a2322f admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:40.586235 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904482c-969a-4e46-bd81-506dd0a2322f admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:40.586507 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904482c-969a-4e46-bd81-506dd0a2322f admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:40.587207 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904482c-969a-4e46-bd81-506dd0a2322f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:40.589237 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a904482c-969a-4e46-bd81-506dd0a2322f admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:40.684271 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1404/2833] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:15:40 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:40.688434 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210061d8-c0d8-4a5a-9bc5-9847350bd699 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:40.699578 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210061d8-c0d8-4a5a-9bc5-9847350bd699 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:40.704577 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0624-ad3d-4d4d-82fc-408597393641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:40.705232 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0624-ad3d-4d4d-82fc-408597393641 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:40.705519 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0624-ad3d-4d4d-82fc-408597393641 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:40.705794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf0624-ad3d-4d4d-82fc-408597393641 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:40.706565 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf0624-ad3d-4d4d-82fc-408597393641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:40.708183 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf0624-ad3d-4d4d-82fc-408597393641 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:40.718316 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1430/2834] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:15:40.722200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904482c-969a-4e46-bd81-506dd0a2322f admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:40.732799 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904482c-969a-4e46-bd81-506dd0a2322f admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:40.737331 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6217e4-518f-4c34-812b-09e5f00acfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:40.737966 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6217e4-518f-4c34-812b-09e5f00acfc3 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:40.738242 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6217e4-518f-4c34-812b-09e5f00acfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:40.738513 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6217e4-518f-4c34-812b-09e5f00acfc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:40.739247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6217e4-518f-4c34-812b-09e5f00acfc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:40.740824 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6217e4-518f-4c34-812b-09e5f00acfc3 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:40.751481 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1405/2835] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:15:40.755396 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0624-ad3d-4d4d-82fc-408597393641 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:40.765056 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf0624-ad3d-4d4d-82fc-408597393641 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:40.769796 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d1131-cfdc-4699-b340-c45c778ae56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:40.770606 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d1131-cfdc-4699-b340-c45c778ae56d admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:40.770882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d1131-cfdc-4699-b340-c45c778ae56d admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:40.771152 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d1131-cfdc-4699-b340-c45c778ae56d admin admin] PATH_INFO: `/v3/projects/95ccfb4467504429984c653a5cbf3fff/users/671bba9afbef4b71a0c9b4dbf7051f69/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:40.785616 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d1131-cfdc-4699-b340-c45c778ae56d admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ccfb4467504429984c653a5cbf3fff, user_id=671bba9afbef4b71a0c9b4dbf7051f69, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:40.788309 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d1131-cfdc-4699-b340-c45c778ae56d admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:40.854108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1431/2836] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:15:40 2022] PUT /identity/v3/projects/95ccfb4467504429984c653a5cbf3fff/users/671bba9afbef4b71a0c9b4dbf7051f69/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:15:40.865542 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d716f-bb80-4480-aad8-ea9650c18140 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:40.865832 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d716f-bb80-4480-aad8-ea9650c18140 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:40.866109 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1d716f-bb80-4480-aad8-ea9650c18140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:40.892056 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-ab1d716f-bb80-4480-aad8-ea9650c18140 None None] MFA Rules not processed for user `671bba9afbef4b71a0c9b4dbf7051f69`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:40.893254 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-ab1d716f-bb80-4480-aad8-ea9650c18140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:40.954296 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1406/2837] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:40.958721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d1131-cfdc-4699-b340-c45c778ae56d admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:41.017942 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d1131-cfdc-4699-b340-c45c778ae56d admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:41.022667 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0f625-f22c-4992-9033-891cae5efd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:41.023274 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f625-f22c-4992-9033-891cae5efd61 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:41.023565 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f625-f22c-4992-9033-891cae5efd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:41.023838 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0f625-f22c-4992-9033-891cae5efd61 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:41.024546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0f625-f22c-4992-9033-891cae5efd61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:41.026420 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0f625-f22c-4992-9033-891cae5efd61 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:41.108560 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1432/2838] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:15:40 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:15:41.112604 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d716f-bb80-4480-aad8-ea9650c18140 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:41.124069 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1d716f-bb80-4480-aad8-ea9650c18140 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:41.177951 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3610e13-2b7d-4dac-8e7e-dea28f258974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:41.178600 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3610e13-2b7d-4dac-8e7e-dea28f258974 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:41.178877 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3610e13-2b7d-4dac-8e7e-dea28f258974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:41.179144 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3610e13-2b7d-4dac-8e7e-dea28f258974 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:41.179871 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3610e13-2b7d-4dac-8e7e-dea28f258974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:41.181751 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3610e13-2b7d-4dac-8e7e-dea28f258974 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:41.255875 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1407/2839] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:15:41 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:41.259766 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0f625-f22c-4992-9033-891cae5efd61 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:41.269941 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0f625-f22c-4992-9033-891cae5efd61 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:41.277276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1faf4-1b52-44f0-8dc6-a8951c52d81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:41.277276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1faf4-1b52-44f0-8dc6-a8951c52d81f admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:41.277276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1faf4-1b52-44f0-8dc6-a8951c52d81f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:41.277276 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1faf4-1b52-44f0-8dc6-a8951c52d81f admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:41.277658 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1faf4-1b52-44f0-8dc6-a8951c52d81f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:41.278675 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad1faf4-1b52-44f0-8dc6-a8951c52d81f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:41.289127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1433/2840] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:15:41.293855 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3610e13-2b7d-4dac-8e7e-dea28f258974 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:41.303763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3610e13-2b7d-4dac-8e7e-dea28f258974 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:41.308455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7515f-8957-491c-b296-31d60e173a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:41.309322 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7515f-8957-491c-b296-31d60e173a5b admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:41.309606 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7515f-8957-491c-b296-31d60e173a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:41.309882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7515f-8957-491c-b296-31d60e173a5b admin admin] PATH_INFO: `/v3/projects/713d900131bd45efbc8d5608594b9dd9/users/961b31f184c846b8a0c30d0d7692267f/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:41.324292 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7515f-8957-491c-b296-31d60e173a5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=713d900131bd45efbc8d5608594b9dd9, user_id=961b31f184c846b8a0c30d0d7692267f, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:41.326945 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7515f-8957-491c-b296-31d60e173a5b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:41.392926 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1408/2841] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:15:41 2022] PUT /identity/v3/projects/713d900131bd45efbc8d5608594b9dd9/users/961b31f184c846b8a0c30d0d7692267f/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:15:41.396834 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1faf4-1b52-44f0-8dc6-a8951c52d81f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:41.407554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1faf4-1b52-44f0-8dc6-a8951c52d81f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:41.461520 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039dc2a-a847-439b-9e25-df2c6c2aaab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:41.462181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039dc2a-a847-439b-9e25-df2c6c2aaab2 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:41.462463 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039dc2a-a847-439b-9e25-df2c6c2aaab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:41.462740 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039dc2a-a847-439b-9e25-df2c6c2aaab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:41.463505 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039dc2a-a847-439b-9e25-df2c6c2aaab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:41.465594 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039dc2a-a847-439b-9e25-df2c6c2aaab2 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:41.474934 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1434/2842] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:15:41.479048 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7515f-8957-491c-b296-31d60e173a5b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:41.489896 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7515f-8957-491c-b296-31d60e173a5b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:41.494451 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053b73a-ed6f-47bc-b810-30bce98cf574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:41.495360 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053b73a-ed6f-47bc-b810-30bce98cf574 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:41.495668 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053b73a-ed6f-47bc-b810-30bce98cf574 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:41.495945 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053b73a-ed6f-47bc-b810-30bce98cf574 admin admin] PATH_INFO: `/v3/projects/713d900131bd45efbc8d5608594b9dd9/users/961b31f184c846b8a0c30d0d7692267f/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:41.497918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053b73a-ed6f-47bc-b810-30bce98cf574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=713d900131bd45efbc8d5608594b9dd9, user_id=961b31f184c846b8a0c30d0d7692267f, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:41.500580 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053b73a-ed6f-47bc-b810-30bce98cf574 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:41.510731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1409/2843] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:15:41 2022] PUT /identity/v3/projects/713d900131bd45efbc8d5608594b9dd9/users/961b31f184c846b8a0c30d0d7692267f/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:41.521256 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7833861-2e18-4c34-9bbe-374b74e5c91e None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:41.521542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7833861-2e18-4c34-9bbe-374b74e5c91e None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:41.521820 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7833861-2e18-4c34-9bbe-374b74e5c91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:41.547815 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-e7833861-2e18-4c34-9bbe-374b74e5c91e None None] MFA Rules not processed for user `961b31f184c846b8a0c30d0d7692267f`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:41.548943 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e7833861-2e18-4c34-9bbe-374b74e5c91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:41.615331 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1435/2844] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:41.631682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053b73a-ed6f-47bc-b810-30bce98cf574 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:41.633326 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-3053b73a-ed6f-47bc-b810-30bce98cf574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:41.689589 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053b73a-ed6f-47bc-b810-30bce98cf574 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:41.693499 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79b580-1f17-4bcf-a29c-0280662ac2ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:41.694124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79b580-1f17-4bcf-a29c-0280662ac2ec service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:41.694403 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79b580-1f17-4bcf-a29c-0280662ac2ec service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:41.694674 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79b580-1f17-4bcf-a29c-0280662ac2ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:41.704321 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79b580-1f17-4bcf-a29c-0280662ac2ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:41.705801 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79b580-1f17-4bcf-a29c-0280662ac2ec service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:41.715557 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1410/2845] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:15:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:15:41.778032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7833861-2e18-4c34-9bbe-374b74e5c91e None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:41.837197 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7833861-2e18-4c34-9bbe-374b74e5c91e None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:41.842461 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa579a8-bcda-40d1-a7b8-a3bd20902744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:41.843339 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa579a8-bcda-40d1-a7b8-a3bd20902744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:41.843619 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa579a8-bcda-40d1-a7b8-a3bd20902744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:41.843888 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa579a8-bcda-40d1-a7b8-a3bd20902744 admin admin] PATH_INFO: `/v3/users/671bba9afbef4b71a0c9b4dbf7051f69` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:41.845088 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa579a8-bcda-40d1-a7b8-a3bd20902744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=671bba9afbef4b71a0c9b4dbf7051f69)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:41.846985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa579a8-bcda-40d1-a7b8-a3bd20902744 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:41.993514 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-efa579a8-bcda-40d1-a7b8-a3bd20902744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '671bba9afbef4b71a0c9b4dbf7051f69'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:41.994174 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-efa579a8-bcda-40d1-a7b8-a3bd20902744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '671bba9afbef4b71a0c9b4dbf7051f69'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:41.995995 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-efa579a8-bcda-40d1-a7b8-a3bd20902744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '671bba9afbef4b71a0c9b4dbf7051f69'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:42.007311 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-efa579a8-bcda-40d1-a7b8-a3bd20902744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '671bba9afbef4b71a0c9b4dbf7051f69'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:42.014631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-efa579a8-bcda-40d1-a7b8-a3bd20902744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '671bba9afbef4b71a0c9b4dbf7051f69'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:42.088327 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1436/2846] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:15:41 2022] DELETE /identity/v3/users/671bba9afbef4b71a0c9b4dbf7051f69 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:42.092849 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5eaa5-b9e3-4ea3-b8a9-3b9dcf93b1d0 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:42.093140 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5eaa5-b9e3-4ea3-b8a9-3b9dcf93b1d0 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:42.093421 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5eaa5-b9e3-4ea3-b8a9-3b9dcf93b1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:42.111007 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-d7a5eaa5-b9e3-4ea3-b8a9-3b9dcf93b1d0 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:42.113036 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d7a5eaa5-b9e3-4ea3-b8a9-3b9dcf93b1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:42.171332 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1411/2847] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:42.180966 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa579a8-bcda-40d1-a7b8-a3bd20902744 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:42.182342 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-efa579a8-bcda-40d1-a7b8-a3bd20902744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:42.238780 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa579a8-bcda-40d1-a7b8-a3bd20902744 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:42.242451 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1d0dd-ee19-449f-ae89-f62bdf665f56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:42.243085 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1d0dd-ee19-449f-ae89-f62bdf665f56 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:42.243417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1d0dd-ee19-449f-ae89-f62bdf665f56 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:42.243693 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1d0dd-ee19-449f-ae89-f62bdf665f56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:42.253159 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1d0dd-ee19-449f-ae89-f62bdf665f56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:42.254624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1d0dd-ee19-449f-ae89-f62bdf665f56 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:42.264158 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1437/2848] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:15:42.669714 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5eaa5-b9e3-4ea3-b8a9-3b9dcf93b1d0 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:42.671169 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d7a5eaa5-b9e3-4ea3-b8a9-3b9dcf93b1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:42.684355 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5eaa5-b9e3-4ea3-b8a9-3b9dcf93b1d0 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:42.689195 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:42.690075 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:42.690883 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:42.691391 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] PATH_INFO: `/v3/projects/95ccfb4467504429984c653a5cbf3fff` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:42.692667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ccfb4467504429984c653a5cbf3fff)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:42.694579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:42.804366 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ccfb4467504429984c653a5cbf3fff', 'request_id': 'req-74ad622c-5404-42e3-8326-7b67729f41c7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:42.810683 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ccfb4467504429984c653a5cbf3fff', 'request_id': 'req-74ad622c-5404-42e3-8326-7b67729f41c7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:42.816135 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ccfb4467504429984c653a5cbf3fff', 'request_id': 'req-74ad622c-5404-42e3-8326-7b67729f41c7'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:42.901119 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] The token cache is being invalidate because project 95ccfb4467504429984c653a5cbf3fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:15:42.901466 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:42.903048 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:42.904664 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1412/2849] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:15:42 2022] DELETE /identity/v3/projects/95ccfb4467504429984c653a5cbf3fff => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:42.908708 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1d0dd-ee19-449f-ae89-f62bdf665f56 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:42.918992 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1d0dd-ee19-449f-ae89-f62bdf665f56 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:42.974634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da59c8f-9784-4b32-880d-60ba089718ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:42.975531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da59c8f-9784-4b32-880d-60ba089718ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:42.975809 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da59c8f-9784-4b32-880d-60ba089718ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:42.976079 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da59c8f-9784-4b32-880d-60ba089718ca admin admin] PATH_INFO: `/v3/users/961b31f184c846b8a0c30d0d7692267f` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:42.977281 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da59c8f-9784-4b32-880d-60ba089718ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=961b31f184c846b8a0c30d0d7692267f)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:42.979176 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da59c8f-9784-4b32-880d-60ba089718ca admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:43.166280 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6da59c8f-9784-4b32-880d-60ba089718ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '961b31f184c846b8a0c30d0d7692267f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:43.166922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6da59c8f-9784-4b32-880d-60ba089718ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '961b31f184c846b8a0c30d0d7692267f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:43.167546 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6da59c8f-9784-4b32-880d-60ba089718ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '961b31f184c846b8a0c30d0d7692267f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:43.179080 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6da59c8f-9784-4b32-880d-60ba089718ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '961b31f184c846b8a0c30d0d7692267f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:43.185702 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-6da59c8f-9784-4b32-880d-60ba089718ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '961b31f184c846b8a0c30d0d7692267f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:43.231989 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1438/2850] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:15:42 2022] DELETE /identity/v3/users/961b31f184c846b8a0c30d0d7692267f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:43.582727 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:43.584275 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:43.598457 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad622c-5404-42e3-8326-7b67729f41c7 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:43.655249 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b19e4a-4a57-4837-8d45-c8ef42032837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:43.656248 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b19e4a-4a57-4837-8d45-c8ef42032837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:43.656536 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b19e4a-4a57-4837-8d45-c8ef42032837 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:43.656810 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b19e4a-4a57-4837-8d45-c8ef42032837 admin admin] PATH_INFO: `/v3/projects/713d900131bd45efbc8d5608594b9dd9` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:43.658001 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b19e4a-4a57-4837-8d45-c8ef42032837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=713d900131bd45efbc8d5608594b9dd9)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:43.660014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b19e4a-4a57-4837-8d45-c8ef42032837 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:43.757537 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-30b19e4a-4a57-4837-8d45-c8ef42032837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '713d900131bd45efbc8d5608594b9dd9', 'request_id': 'req-30b19e4a-4a57-4837-8d45-c8ef42032837'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:43.764261 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-30b19e4a-4a57-4837-8d45-c8ef42032837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '713d900131bd45efbc8d5608594b9dd9', 'request_id': 'req-30b19e4a-4a57-4837-8d45-c8ef42032837'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:43.769512 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-30b19e4a-4a57-4837-8d45-c8ef42032837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '713d900131bd45efbc8d5608594b9dd9', 'request_id': 'req-30b19e4a-4a57-4837-8d45-c8ef42032837'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:43.844291 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-30b19e4a-4a57-4837-8d45-c8ef42032837 admin admin] The token cache is being invalidate because project 713d900131bd45efbc8d5608594b9dd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:15:43.844572 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-30b19e4a-4a57-4837-8d45-c8ef42032837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:43.845194 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-30b19e4a-4a57-4837-8d45-c8ef42032837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:43.846771 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1413/2851] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:15:43 2022] DELETE /identity/v3/projects/713d900131bd45efbc8d5608594b9dd9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:43.851799 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27b10d-0154-4492-9c28-678dffcee098 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:43.852089 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27b10d-0154-4492-9c28-678dffcee098 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:43.852366 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27b10d-0154-4492-9c28-678dffcee098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:43.871175 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-fb27b10d-0154-4492-9c28-678dffcee098 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:43.872417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-fb27b10d-0154-4492-9c28-678dffcee098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:43.929204 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1439/2852] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:43.938079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec6c6a-b6b4-44da-9436-0788fab5ac1d None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:43.938364 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec6c6a-b6b4-44da-9436-0788fab5ac1d None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:43.938643 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec6c6a-b6b4-44da-9436-0788fab5ac1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:43.957281 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-61ec6c6a-b6b4-44da-9436-0788fab5ac1d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:43.958463 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-61ec6c6a-b6b4-44da-9436-0788fab5ac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:43.967027 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1414/2853] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:43.971076 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27b10d-0154-4492-9c28-678dffcee098 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:43.980467 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb27b10d-0154-4492-9c28-678dffcee098 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:43.984942 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd62534-c628-407c-ba13-4eb6c76fb535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:43.985569 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd62534-c628-407c-ba13-4eb6c76fb535 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:43.985845 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd62534-c628-407c-ba13-4eb6c76fb535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:43.986113 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd62534-c628-407c-ba13-4eb6c76fb535 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:43.986832 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd62534-c628-407c-ba13-4eb6c76fb535 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:15:43.987132 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd62534-c628-407c-ba13-4eb6c76fb535 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:43.988736 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd62534-c628-407c-ba13-4eb6c76fb535 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:43.999721 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1440/2854] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:15:44.003976 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec6c6a-b6b4-44da-9436-0788fab5ac1d None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:44.013677 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec6c6a-b6b4-44da-9436-0788fab5ac1d None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:44.018295 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edcf9a-2f8b-4de2-9eb1-7c9375bb5253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:44.018932 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edcf9a-2f8b-4de2-9eb1-7c9375bb5253 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:44.019215 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edcf9a-2f8b-4de2-9eb1-7c9375bb5253 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:44.019520 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edcf9a-2f8b-4de2-9eb1-7c9375bb5253 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:44.020220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edcf9a-2f8b-4de2-9eb1-7c9375bb5253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:44.022089 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edcf9a-2f8b-4de2-9eb1-7c9375bb5253 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:44.085039 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1415/2855] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:15:44 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:44.089260 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd62534-c628-407c-ba13-4eb6c76fb535 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:44.098960 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd62534-c628-407c-ba13-4eb6c76fb535 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:44.154045 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686cbd4-55b6-4d2e-b906-df12aafffb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:44.154735 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686cbd4-55b6-4d2e-b906-df12aafffb4b admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:44.155014 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686cbd4-55b6-4d2e-b906-df12aafffb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:44.155319 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686cbd4-55b6-4d2e-b906-df12aafffb4b admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:44.156047 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686cbd4-55b6-4d2e-b906-df12aafffb4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:44.157957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686cbd4-55b6-4d2e-b906-df12aafffb4b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:44.216332 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1441/2856] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:15:44 2022] POST /identity/v3/users => generated 292 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:44.220609 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edcf9a-2f8b-4de2-9eb1-7c9375bb5253 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:44.231338 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edcf9a-2f8b-4de2-9eb1-7c9375bb5253 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:44.236312 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af1735-6a8d-4584-a84c-75562510449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:44.236984 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af1735-6a8d-4584-a84c-75562510449a admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:44.237329 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af1735-6a8d-4584-a84c-75562510449a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:44.237612 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af1735-6a8d-4584-a84c-75562510449a admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:44.238388 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af1735-6a8d-4584-a84c-75562510449a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:44.240117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af1735-6a8d-4584-a84c-75562510449a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:44.250565 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1416/2857] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:15:44.254557 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686cbd4-55b6-4d2e-b906-df12aafffb4b admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:44.264323 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686cbd4-55b6-4d2e-b906-df12aafffb4b admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:44.268946 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e807c2-c827-4b98-a13c-dc24bb2092a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:44.269592 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e807c2-c827-4b98-a13c-dc24bb2092a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:44.269877 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e807c2-c827-4b98-a13c-dc24bb2092a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:44.270156 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e807c2-c827-4b98-a13c-dc24bb2092a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:44.270887 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e807c2-c827-4b98-a13c-dc24bb2092a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:44.272503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e807c2-c827-4b98-a13c-dc24bb2092a9 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:44.282673 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1442/2858] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:15:44.286797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af1735-6a8d-4584-a84c-75562510449a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:44.297067 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af1735-6a8d-4584-a84c-75562510449a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:44.301632 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f141c7b-bf9c-486b-9288-7cd867a0eea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:44.302516 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f141c7b-bf9c-486b-9288-7cd867a0eea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:44.302794 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f141c7b-bf9c-486b-9288-7cd867a0eea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:44.303068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f141c7b-bf9c-486b-9288-7cd867a0eea0 admin admin] PATH_INFO: `/v3/projects/0bd6ca050b9649c0aa48680adbfbe802/users/f77dac315eff468bb306b30412956d8f/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:44.317059 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f141c7b-bf9c-486b-9288-7cd867a0eea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd6ca050b9649c0aa48680adbfbe802, user_id=f77dac315eff468bb306b30412956d8f, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:44.319726 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f141c7b-bf9c-486b-9288-7cd867a0eea0 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:44.386510 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1417/2859] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:15:44 2022] PUT /identity/v3/projects/0bd6ca050b9649c0aa48680adbfbe802/users/f77dac315eff468bb306b30412956d8f/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:44.440133 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12ebe0-4bc4-4547-876d-ec8b83f1d6cc None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:44.440420 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12ebe0-4bc4-4547-876d-ec8b83f1d6cc None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:44.440700 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d12ebe0-4bc4-4547-876d-ec8b83f1d6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:44.467164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-1d12ebe0-4bc4-4547-876d-ec8b83f1d6cc None None] MFA Rules not processed for user `f77dac315eff468bb306b30412956d8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:44.468386 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-1d12ebe0-4bc4-4547-876d-ec8b83f1d6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:44.529986 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1443/2860] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:44.534319 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f141c7b-bf9c-486b-9288-7cd867a0eea0 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:44.593187 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f141c7b-bf9c-486b-9288-7cd867a0eea0 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:44.597847 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d635385-8130-423e-9ac6-1243af928f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:44.598486 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d635385-8130-423e-9ac6-1243af928f66 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:44.598767 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d635385-8130-423e-9ac6-1243af928f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:44.599041 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d635385-8130-423e-9ac6-1243af928f66 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:44.599761 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d635385-8130-423e-9ac6-1243af928f66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:44.601635 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d635385-8130-423e-9ac6-1243af928f66 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:44.669030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1418/2861] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:15:44 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:44.673126 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12ebe0-4bc4-4547-876d-ec8b83f1d6cc None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:44.684151 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d12ebe0-4bc4-4547-876d-ec8b83f1d6cc None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:44.738076 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98374736-51c6-4583-a1ef-004342dca2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:44.738735 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98374736-51c6-4583-a1ef-004342dca2ce admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:44.739017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98374736-51c6-4583-a1ef-004342dca2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:44.739326 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98374736-51c6-4583-a1ef-004342dca2ce admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:44.740129 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98374736-51c6-4583-a1ef-004342dca2ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:44.742043 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98374736-51c6-4583-a1ef-004342dca2ce admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:44.815087 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1444/2862] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:15:44 2022] POST /identity/v3/users => generated 297 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:44.818726 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d635385-8130-423e-9ac6-1243af928f66 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:44.830219 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d635385-8130-423e-9ac6-1243af928f66 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:44.834792 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88fe43-9b2f-4d7e-9945-7df632a65887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:44.835471 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88fe43-9b2f-4d7e-9945-7df632a65887 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:44.835757 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88fe43-9b2f-4d7e-9945-7df632a65887 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:44.836025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88fe43-9b2f-4d7e-9945-7df632a65887 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:44.836828 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88fe43-9b2f-4d7e-9945-7df632a65887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:44.838357 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88fe43-9b2f-4d7e-9945-7df632a65887 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:44.849701 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1419/2863] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:15:44.853882 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98374736-51c6-4583-a1ef-004342dca2ce admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:44.863968 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98374736-51c6-4583-a1ef-004342dca2ce admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:44.868682 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18453b0f-1c8e-4242-bb18-de5e18f9ef04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:44.869560 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18453b0f-1c8e-4242-bb18-de5e18f9ef04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:44.869846 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18453b0f-1c8e-4242-bb18-de5e18f9ef04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:44.870125 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18453b0f-1c8e-4242-bb18-de5e18f9ef04 admin admin] PATH_INFO: `/v3/projects/cddd6e4a287941869376a852002994a7/users/14843b9e75d64cd398542d44c8adb8d3/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:44.887121 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18453b0f-1c8e-4242-bb18-de5e18f9ef04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cddd6e4a287941869376a852002994a7, user_id=14843b9e75d64cd398542d44c8adb8d3, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:44.889799 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18453b0f-1c8e-4242-bb18-de5e18f9ef04 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:44.969373 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1445/2864] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:15:44 2022] PUT /identity/v3/projects/cddd6e4a287941869376a852002994a7/users/14843b9e75d64cd398542d44c8adb8d3/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:44.973383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88fe43-9b2f-4d7e-9945-7df632a65887 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:44.983486 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88fe43-9b2f-4d7e-9945-7df632a65887 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:45.038310 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78b61e-5ec1-493a-889f-ddf9e49760f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:45.038970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78b61e-5ec1-493a-889f-ddf9e49760f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:45.039343 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78b61e-5ec1-493a-889f-ddf9e49760f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:45.039627 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78b61e-5ec1-493a-889f-ddf9e49760f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:45.040359 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78b61e-5ec1-493a-889f-ddf9e49760f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:45.041938 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78b61e-5ec1-493a-889f-ddf9e49760f8 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:45.052025 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1420/2865] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:15:45.056305 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18453b0f-1c8e-4242-bb18-de5e18f9ef04 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:45.066709 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18453b0f-1c8e-4242-bb18-de5e18f9ef04 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:45.071128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e250c-783a-4798-b1d5-e9e63f3555b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:45.072017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e250c-783a-4798-b1d5-e9e63f3555b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:45.072295 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e250c-783a-4798-b1d5-e9e63f3555b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:45.072561 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e250c-783a-4798-b1d5-e9e63f3555b7 admin admin] PATH_INFO: `/v3/projects/cddd6e4a287941869376a852002994a7/users/14843b9e75d64cd398542d44c8adb8d3/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:45.074919 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e250c-783a-4798-b1d5-e9e63f3555b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cddd6e4a287941869376a852002994a7, user_id=14843b9e75d64cd398542d44c8adb8d3, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:45.077542 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e250c-783a-4798-b1d5-e9e63f3555b7 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:45.087338 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1446/2866] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:15:45 2022] PUT /identity/v3/projects/cddd6e4a287941869376a852002994a7/users/14843b9e75d64cd398542d44c8adb8d3/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:15:45.097737 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2346f-5fab-4882-9b05-dc7315fb94b0 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:45.098057 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2346f-5fab-4882-9b05-dc7315fb94b0 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:45.098363 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2346f-5fab-4882-9b05-dc7315fb94b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:45.125017 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-6fc2346f-5fab-4882-9b05-dc7315fb94b0 None None] MFA Rules not processed for user `14843b9e75d64cd398542d44c8adb8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:45.126216 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-6fc2346f-5fab-4882-9b05-dc7315fb94b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:45.190678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1421/2867] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:45.200149 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e250c-783a-4798-b1d5-e9e63f3555b7 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:45.201859 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-116e250c-783a-4798-b1d5-e9e63f3555b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:45.256774 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e250c-783a-4798-b1d5-e9e63f3555b7 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:45.260350 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ecd5e-d07d-40c0-8f91-05164c36c5cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:45.261508 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ecd5e-d07d-40c0-8f91-05164c36c5cf service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:45.261781 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ecd5e-d07d-40c0-8f91-05164c36c5cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:45.262050 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ecd5e-d07d-40c0-8f91-05164c36c5cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:45.270656 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ecd5e-d07d-40c0-8f91-05164c36c5cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:45.272096 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ecd5e-d07d-40c0-8f91-05164c36c5cf service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:45.281827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1447/2868] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:15:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:15:45.376943 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2346f-5fab-4882-9b05-dc7315fb94b0 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:45.387068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2346f-5fab-4882-9b05-dc7315fb94b0 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:45.390680 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03caf70-9439-46a3-9ec0-c614758d1dcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:45.391398 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03caf70-9439-46a3-9ec0-c614758d1dcc service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:45.391682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03caf70-9439-46a3-9ec0-c614758d1dcc service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:45.391955 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03caf70-9439-46a3-9ec0-c614758d1dcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:45.445975 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03caf70-9439-46a3-9ec0-c614758d1dcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:45.447413 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03caf70-9439-46a3-9ec0-c614758d1dcc service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:45.457058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1422/2869] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:15:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:15:48.465418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ecd5e-d07d-40c0-8f91-05164c36c5cf service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:48.524923 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ecd5e-d07d-40c0-8f91-05164c36c5cf service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:48.529713 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1c866-dc22-4ad3-ac1c-a2c2677d99cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:48.530594 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1c866-dc22-4ad3-ac1c-a2c2677d99cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:48.530814 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1c866-dc22-4ad3-ac1c-a2c2677d99cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:48.531077 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a1c866-dc22-4ad3-ac1c-a2c2677d99cf admin admin] PATH_INFO: `/v3/users/f77dac315eff468bb306b30412956d8f` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:48.532302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1c866-dc22-4ad3-ac1c-a2c2677d99cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f77dac315eff468bb306b30412956d8f)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:48.534181 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a1c866-dc22-4ad3-ac1c-a2c2677d99cf admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:48.748045 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b2a1c866-dc22-4ad3-ac1c-a2c2677d99cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f77dac315eff468bb306b30412956d8f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:48.748742 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b2a1c866-dc22-4ad3-ac1c-a2c2677d99cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f77dac315eff468bb306b30412956d8f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:48.749299 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b2a1c866-dc22-4ad3-ac1c-a2c2677d99cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f77dac315eff468bb306b30412956d8f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:48.760418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b2a1c866-dc22-4ad3-ac1c-a2c2677d99cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f77dac315eff468bb306b30412956d8f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:48.767399 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-b2a1c866-dc22-4ad3-ac1c-a2c2677d99cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f77dac315eff468bb306b30412956d8f'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:48.838093 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1448/2870] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:15:48 2022] DELETE /identity/v3/users/f77dac315eff468bb306b30412956d8f => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:48.843028 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d76177-d755-4f6c-a1fd-c866376b69b9 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:48.843496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d76177-d755-4f6c-a1fd-c866376b69b9 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:48.846079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d76177-d755-4f6c-a1fd-c866376b69b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:48.860927 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-18d76177-d755-4f6c-a1fd-c866376b69b9 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:48.862107 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-18d76177-d755-4f6c-a1fd-c866376b69b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:48.916175 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1423/2871] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:48.926529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1c866-dc22-4ad3-ac1c-a2c2677d99cf admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:48.927957 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b2a1c866-dc22-4ad3-ac1c-a2c2677d99cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:48.983415 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a1c866-dc22-4ad3-ac1c-a2c2677d99cf admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:48.986932 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df9a32-65bd-4893-a29b-1e2ab8356b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:48.987586 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df9a32-65bd-4893-a29b-1e2ab8356b4d service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:48.987865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df9a32-65bd-4893-a29b-1e2ab8356b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:48.988135 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df9a32-65bd-4893-a29b-1e2ab8356b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:48.996974 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df9a32-65bd-4893-a29b-1e2ab8356b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:48.998372 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df9a32-65bd-4893-a29b-1e2ab8356b4d service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:49.007526 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1449/2872] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:15:49.393940 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d76177-d755-4f6c-a1fd-c866376b69b9 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:49.398533 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-18d76177-d755-4f6c-a1fd-c866376b69b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:49.407731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d76177-d755-4f6c-a1fd-c866376b69b9 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:49.412816 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:49.413844 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:49.414126 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:49.414539 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] PATH_INFO: `/v3/projects/0bd6ca050b9649c0aa48680adbfbe802` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:49.415762 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bd6ca050b9649c0aa48680adbfbe802)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:49.418447 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:49.529559 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd6ca050b9649c0aa48680adbfbe802', 'request_id': 'req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:49.535750 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd6ca050b9649c0aa48680adbfbe802', 'request_id': 'req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:49.541122 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd6ca050b9649c0aa48680adbfbe802', 'request_id': 'req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:49.597351 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] The token cache is being invalidate because project 0bd6ca050b9649c0aa48680adbfbe802 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:15:49.597652 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:49.598254 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:49.599812 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1424/2873] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:15:49 2022] DELETE /identity/v3/projects/0bd6ca050b9649c0aa48680adbfbe802 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:49.603828 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df9a32-65bd-4893-a29b-1e2ab8356b4d service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:49.613794 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df9a32-65bd-4893-a29b-1e2ab8356b4d service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:49.668262 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa7607c-75ee-4200-afd5-f594ea2d5c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:49.669124 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7607c-75ee-4200-afd5-f594ea2d5c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:49.669421 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7607c-75ee-4200-afd5-f594ea2d5c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:49.669684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa7607c-75ee-4200-afd5-f594ea2d5c0f admin admin] PATH_INFO: `/v3/users/14843b9e75d64cd398542d44c8adb8d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:49.670926 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7607c-75ee-4200-afd5-f594ea2d5c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=14843b9e75d64cd398542d44c8adb8d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:49.673064 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa7607c-75ee-4200-afd5-f594ea2d5c0f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:49.835011 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1aa7607c-75ee-4200-afd5-f594ea2d5c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14843b9e75d64cd398542d44c8adb8d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:49.835695 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1aa7607c-75ee-4200-afd5-f594ea2d5c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14843b9e75d64cd398542d44c8adb8d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:49.836293 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1aa7607c-75ee-4200-afd5-f594ea2d5c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14843b9e75d64cd398542d44c8adb8d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:49.848298 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1aa7607c-75ee-4200-afd5-f594ea2d5c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14843b9e75d64cd398542d44c8adb8d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:49.855074 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-1aa7607c-75ee-4200-afd5-f594ea2d5c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14843b9e75d64cd398542d44c8adb8d3'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:49.900435 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1450/2874] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:15:49 2022] DELETE /identity/v3/users/14843b9e75d64cd398542d44c8adb8d3 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:15:50.279752 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:50.281209 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:50.295944 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9b1446-8d50-4c1e-bc82-fff65d1c9c62 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:50.355925 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a686f4-3bd0-400c-992a-486651ca279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:50.356786 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a686f4-3bd0-400c-992a-486651ca279b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:50.357069 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a686f4-3bd0-400c-992a-486651ca279b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:50.357342 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a686f4-3bd0-400c-992a-486651ca279b admin admin] PATH_INFO: `/v3/projects/cddd6e4a287941869376a852002994a7` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:50.358548 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a686f4-3bd0-400c-992a-486651ca279b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cddd6e4a287941869376a852002994a7)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:50.360496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a686f4-3bd0-400c-992a-486651ca279b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:50.489330 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-77a686f4-3bd0-400c-992a-486651ca279b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cddd6e4a287941869376a852002994a7', 'request_id': 'req-77a686f4-3bd0-400c-992a-486651ca279b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:50.495996 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-77a686f4-3bd0-400c-992a-486651ca279b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cddd6e4a287941869376a852002994a7', 'request_id': 'req-77a686f4-3bd0-400c-992a-486651ca279b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:50.501346 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-77a686f4-3bd0-400c-992a-486651ca279b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cddd6e4a287941869376a852002994a7', 'request_id': 'req-77a686f4-3bd0-400c-992a-486651ca279b'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:50.551766 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-77a686f4-3bd0-400c-992a-486651ca279b admin admin] The token cache is being invalidate because project cddd6e4a287941869376a852002994a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:15:50.551969 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-77a686f4-3bd0-400c-992a-486651ca279b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:50.552659 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-77a686f4-3bd0-400c-992a-486651ca279b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:50.554210 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1425/2875] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:15:50 2022] DELETE /identity/v3/projects/cddd6e4a287941869376a852002994a7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:50.559956 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd11b20-bb71-4fd2-a651-855cbee65940 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:50.560249 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd11b20-bb71-4fd2-a651-855cbee65940 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:50.560527 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd11b20-bb71-4fd2-a651-855cbee65940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:50.578409 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-dfd11b20-bb71-4fd2-a651-855cbee65940 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:50.579670 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-dfd11b20-bb71-4fd2-a651-855cbee65940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:50.636737 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1451/2876] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:50.645821 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c69e8c-72c6-4326-988f-fd19639d89ed None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:50.646124 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c69e8c-72c6-4326-988f-fd19639d89ed None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:50.646398 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c69e8c-72c6-4326-988f-fd19639d89ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:50.664731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-c5c69e8c-72c6-4326-988f-fd19639d89ed None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:50.665906 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c5c69e8c-72c6-4326-988f-fd19639d89ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:50.674203 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1426/2877] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:15:50.678347 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd11b20-bb71-4fd2-a651-855cbee65940 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:50.688599 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd11b20-bb71-4fd2-a651-855cbee65940 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:50.693238 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2ee5a-ef2f-448c-a3f4-3ef9a60a0d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:50.693879 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2ee5a-ef2f-448c-a3f4-3ef9a60a0d31 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:50.694162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2ee5a-ef2f-448c-a3f4-3ef9a60a0d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:50.694438 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b2ee5a-ef2f-448c-a3f4-3ef9a60a0d31 admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:50.695169 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2ee5a-ef2f-448c-a3f4-3ef9a60a0d31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:15:50.695507 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2ee5a-ef2f-448c-a3f4-3ef9a60a0d31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:50.697088 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b2ee5a-ef2f-448c-a3f4-3ef9a60a0d31 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:50.708660 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1452/2878] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:15:50.712876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c69e8c-72c6-4326-988f-fd19639d89ed None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:50.722082 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c69e8c-72c6-4326-988f-fd19639d89ed None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:50.726819 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24409ee-74df-4232-8d52-4c5db6867831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:50.727484 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24409ee-74df-4232-8d52-4c5db6867831 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:50.727767 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24409ee-74df-4232-8d52-4c5db6867831 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:50.728042 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24409ee-74df-4232-8d52-4c5db6867831 admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:50.728748 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24409ee-74df-4232-8d52-4c5db6867831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:50.731462 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24409ee-74df-4232-8d52-4c5db6867831 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:50.811148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1427/2879] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:15:50 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:15:50.815913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2ee5a-ef2f-448c-a3f4-3ef9a60a0d31 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:50.829278 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b2ee5a-ef2f-448c-a3f4-3ef9a60a0d31 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:50.886234 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936743f-8e7f-4dcb-bb8f-03fcdd04e833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:50.886881 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936743f-8e7f-4dcb-bb8f-03fcdd04e833 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:50.887162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936743f-8e7f-4dcb-bb8f-03fcdd04e833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:50.887467 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4936743f-8e7f-4dcb-bb8f-03fcdd04e833 admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:50.888160 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936743f-8e7f-4dcb-bb8f-03fcdd04e833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:50.890066 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4936743f-8e7f-4dcb-bb8f-03fcdd04e833 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:50.974313 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1453/2880] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:15:50 2022] POST /identity/v3/users => generated 291 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:50.978452 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24409ee-74df-4232-8d52-4c5db6867831 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:50.988853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24409ee-74df-4232-8d52-4c5db6867831 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:50.993408 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb9018-1db4-486a-ba11-4835d0a59fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:50.994051 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb9018-1db4-486a-ba11-4835d0a59fdd admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:50.994328 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb9018-1db4-486a-ba11-4835d0a59fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:50.994598 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb9018-1db4-486a-ba11-4835d0a59fdd admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:50.996079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb9018-1db4-486a-ba11-4835d0a59fdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:50.997696 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb9018-1db4-486a-ba11-4835d0a59fdd admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:51.008106 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1428/2881] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:15:51.012537 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936743f-8e7f-4dcb-bb8f-03fcdd04e833 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:51.022247 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4936743f-8e7f-4dcb-bb8f-03fcdd04e833 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:51.026760 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b620de-0168-4e6a-b0be-1db62735cf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:51.027429 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b620de-0168-4e6a-b0be-1db62735cf50 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:51.027709 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b620de-0168-4e6a-b0be-1db62735cf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:51.027981 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b620de-0168-4e6a-b0be-1db62735cf50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:51.028716 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b620de-0168-4e6a-b0be-1db62735cf50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:51.030268 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b620de-0168-4e6a-b0be-1db62735cf50 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:51.039680 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1454/2882] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:15:51.043617 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb9018-1db4-486a-ba11-4835d0a59fdd admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:51.053297 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb9018-1db4-486a-ba11-4835d0a59fdd admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:51.058384 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117cde6-f4bf-4afd-a955-6d987a9c3c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:51.059422 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117cde6-f4bf-4afd-a955-6d987a9c3c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:51.059702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117cde6-f4bf-4afd-a955-6d987a9c3c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:51.059973 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117cde6-f4bf-4afd-a955-6d987a9c3c3d admin admin] PATH_INFO: `/v3/projects/381905b98b8f404fa010e6627a35ed16/users/0b2466c95bb54c778a19ac8412de2efa/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:51.074853 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117cde6-f4bf-4afd-a955-6d987a9c3c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=381905b98b8f404fa010e6627a35ed16, user_id=0b2466c95bb54c778a19ac8412de2efa, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:51.077460 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117cde6-f4bf-4afd-a955-6d987a9c3c3d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:51.146702 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1429/2883] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:15:51 2022] PUT /identity/v3/projects/381905b98b8f404fa010e6627a35ed16/users/0b2466c95bb54c778a19ac8412de2efa/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:51.156870 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfd446-dbea-423b-ac00-a00cb243cffd None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:51.157704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfd446-dbea-423b-ac00-a00cb243cffd None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:51.157704 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfd446-dbea-423b-ac00-a00cb243cffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:51.188265 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-31cfd446-dbea-423b-ac00-a00cb243cffd None None] MFA Rules not processed for user `0b2466c95bb54c778a19ac8412de2efa`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:51.189676 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-31cfd446-dbea-423b-ac00-a00cb243cffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:51.254513 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1455/2884] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:15:51.258906 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117cde6-f4bf-4afd-a955-6d987a9c3c3d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:51.317754 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117cde6-f4bf-4afd-a955-6d987a9c3c3d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:51.322377 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79ae9d-4eee-4705-aec5-04fc098d5d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:51.323017 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79ae9d-4eee-4705-aec5-04fc098d5d5c admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:51.323532 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79ae9d-4eee-4705-aec5-04fc098d5d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:51.324070 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79ae9d-4eee-4705-aec5-04fc098d5d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:51.324755 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79ae9d-4eee-4705-aec5-04fc098d5d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:51.326675 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb79ae9d-4eee-4705-aec5-04fc098d5d5c admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:51.404715 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1430/2885] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:15:51 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:51.408887 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfd446-dbea-423b-ac00-a00cb243cffd None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:51.420058 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cfd446-dbea-423b-ac00-a00cb243cffd None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:51.475497 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd39cf-beba-4260-bc2e-c0a0d2bf004f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:51.476647 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd39cf-beba-4260-bc2e-c0a0d2bf004f admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:51.477100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd39cf-beba-4260-bc2e-c0a0d2bf004f admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:51.477385 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd39cf-beba-4260-bc2e-c0a0d2bf004f admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:51.478115 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd39cf-beba-4260-bc2e-c0a0d2bf004f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:51.480529 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd39cf-beba-4260-bc2e-c0a0d2bf004f admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:51.575848 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1456/2886] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:15:51 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:51.579984 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79ae9d-4eee-4705-aec5-04fc098d5d5c admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:51.590684 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79ae9d-4eee-4705-aec5-04fc098d5d5c admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:51.595397 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0595fba-3433-4509-a802-0483bc09e7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:51.596043 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0595fba-3433-4509-a802-0483bc09e7df admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:51.596326 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0595fba-3433-4509-a802-0483bc09e7df admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:51.596634 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0595fba-3433-4509-a802-0483bc09e7df admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:51.597362 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0595fba-3433-4509-a802-0483bc09e7df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:51.598967 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0595fba-3433-4509-a802-0483bc09e7df admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:51.609428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1431/2887] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:15:51.613486 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd39cf-beba-4260-bc2e-c0a0d2bf004f admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:51.624083 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd39cf-beba-4260-bc2e-c0a0d2bf004f admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:51.628629 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6c33b-bf7a-47da-85fd-aaa0c7504a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:51.629487 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c33b-bf7a-47da-85fd-aaa0c7504a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:51.629767 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c33b-bf7a-47da-85fd-aaa0c7504a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:51.630037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6c33b-bf7a-47da-85fd-aaa0c7504a26 admin admin] PATH_INFO: `/v3/projects/585d63b5c09740f880dbeca73bc70834/users/6c88188f566a426b88d074403bbc7b7e/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:51.645994 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6c33b-bf7a-47da-85fd-aaa0c7504a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585d63b5c09740f880dbeca73bc70834, user_id=6c88188f566a426b88d074403bbc7b7e, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:51.648631 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e6c33b-bf7a-47da-85fd-aaa0c7504a26 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:51.723454 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1457/2888] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:15:51 2022] PUT /identity/v3/projects/585d63b5c09740f880dbeca73bc70834/users/6c88188f566a426b88d074403bbc7b7e/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:51.727507 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0595fba-3433-4509-a802-0483bc09e7df admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:51.737370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0595fba-3433-4509-a802-0483bc09e7df admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:51.790650 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b069f-e444-4160-bbd2-922741ae9fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:51.791383 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b069f-e444-4160-bbd2-922741ae9fda admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:51.791690 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b069f-e444-4160-bbd2-922741ae9fda admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:51.792138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b069f-e444-4160-bbd2-922741ae9fda admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:51.792927 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b069f-e444-4160-bbd2-922741ae9fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:51.794780 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b069f-e444-4160-bbd2-922741ae9fda admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:51.804355 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1432/2889] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:51 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Feb 12 05:15:51.809190 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6c33b-bf7a-47da-85fd-aaa0c7504a26 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:51.819202 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6c33b-bf7a-47da-85fd-aaa0c7504a26 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:51.824727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea043f-53a1-4ca9-92ad-dc1ab24cd5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:51.825581 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea043f-53a1-4ca9-92ad-dc1ab24cd5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:51.825856 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea043f-53a1-4ca9-92ad-dc1ab24cd5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:51.826128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea043f-53a1-4ca9-92ad-dc1ab24cd5f5 admin admin] PATH_INFO: `/v3/projects/585d63b5c09740f880dbeca73bc70834/users/6c88188f566a426b88d074403bbc7b7e/roles/31f3de1096c0476b99b7ac4d719eaa14` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:51.828119 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea043f-53a1-4ca9-92ad-dc1ab24cd5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=585d63b5c09740f880dbeca73bc70834, user_id=6c88188f566a426b88d074403bbc7b7e, role_id=31f3de1096c0476b99b7ac4d719eaa14)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:51.830765 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea043f-53a1-4ca9-92ad-dc1ab24cd5f5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:51.841803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1458/2890] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:15:51 2022] PUT /identity/v3/projects/585d63b5c09740f880dbeca73bc70834/users/6c88188f566a426b88d074403bbc7b7e/roles/31f3de1096c0476b99b7ac4d719eaa14 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Feb 12 05:15:51.851914 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ff14-d9ce-48d4-9241-6734727c1518 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:51.852201 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ff14-d9ce-48d4-9241-6734727c1518 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:51.852477 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb36ff14-d9ce-48d4-9241-6734727c1518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:51.878528 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-bb36ff14-d9ce-48d4-9241-6734727c1518 None None] MFA Rules not processed for user `6c88188f566a426b88d074403bbc7b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:51.879747 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-bb36ff14-d9ce-48d4-9241-6734727c1518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:51.948313 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1433/2891] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:51 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:51.958553 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea043f-53a1-4ca9-92ad-dc1ab24cd5f5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:51.960233 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-faea043f-53a1-4ca9-92ad-dc1ab24cd5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:52.015658 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea043f-53a1-4ca9-92ad-dc1ab24cd5f5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:52.019285 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e0a23-595f-48f6-8358-36f2c7e69cd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:52.019906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e0a23-595f-48f6-8358-36f2c7e69cd4 service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:52.020184 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e0a23-595f-48f6-8358-36f2c7e69cd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:52.020455 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095e0a23-595f-48f6-8358-36f2c7e69cd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:52.029751 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e0a23-595f-48f6-8358-36f2c7e69cd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:52.031165 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095e0a23-595f-48f6-8358-36f2c7e69cd4 service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:52.040257 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1459/2892] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:15:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:15:52.207753 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36ff14-d9ce-48d4-9241-6734727c1518 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:52.217970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb36ff14-d9ce-48d4-9241-6734727c1518 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:52.221637 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c848851-130c-4431-8397-b25efc2e86fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:52.222266 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c848851-130c-4431-8397-b25efc2e86fd service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:52.222547 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c848851-130c-4431-8397-b25efc2e86fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:52.222825 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c848851-130c-4431-8397-b25efc2e86fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:52.277188 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c848851-130c-4431-8397-b25efc2e86fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:52.278749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c848851-130c-4431-8397-b25efc2e86fd service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:52.287705 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1434/2893] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:15:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:15:52.724391 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e0a23-595f-48f6-8358-36f2c7e69cd4 service cinder] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:52.784592 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095e0a23-595f-48f6-8358-36f2c7e69cd4 service cinder] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:52.789042 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9b907-b65b-4562-b802-c63e51691ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:52.789874 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9b907-b65b-4562-b802-c63e51691ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:52.790150 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9b907-b65b-4562-b802-c63e51691ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:52.790417 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9b907-b65b-4562-b802-c63e51691ba0 admin admin] PATH_INFO: `/v3/users/0b2466c95bb54c778a19ac8412de2efa` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:52.791609 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9b907-b65b-4562-b802-c63e51691ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b2466c95bb54c778a19ac8412de2efa)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:52.793523 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9b907-b65b-4562-b802-c63e51691ba0 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:53.006432 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fef9b907-b65b-4562-b802-c63e51691ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b2466c95bb54c778a19ac8412de2efa'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:53.007015 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fef9b907-b65b-4562-b802-c63e51691ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b2466c95bb54c778a19ac8412de2efa'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:53.007633 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fef9b907-b65b-4562-b802-c63e51691ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b2466c95bb54c778a19ac8412de2efa'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:53.019714 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fef9b907-b65b-4562-b802-c63e51691ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b2466c95bb54c778a19ac8412de2efa'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:53.026341 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-fef9b907-b65b-4562-b802-c63e51691ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b2466c95bb54c778a19ac8412de2efa'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:53.112110 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1460/2894] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:15:52 2022] DELETE /identity/v3/users/0b2466c95bb54c778a19ac8412de2efa => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:53.116779 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458c584-d923-44b1-acd8-c1953bd1c98a None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:53.117269 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458c584-d923-44b1-acd8-c1953bd1c98a None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:53.117387 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5458c584-d923-44b1-acd8-c1953bd1c98a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:53.134538 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-5458c584-d923-44b1-acd8-c1953bd1c98a None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:53.135820 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-5458c584-d923-44b1-acd8-c1953bd1c98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:53.191100 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1435/2895] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:53.201657 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9b907-b65b-4562-b802-c63e51691ba0 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:53.203045 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-fef9b907-b65b-4562-b802-c63e51691ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:53.257838 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9b907-b65b-4562-b802-c63e51691ba0 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:53.261288 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6831e-0753-4432-942b-6babf89e36f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:53.262530 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6831e-0753-4432-942b-6babf89e36f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:53.262803 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6831e-0753-4432-942b-6babf89e36f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:53.263069 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6831e-0753-4432-942b-6babf89e36f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:53.271778 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6831e-0753-4432-942b-6babf89e36f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:53.273182 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6831e-0753-4432-942b-6babf89e36f6 service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:53.282473 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1461/2896] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:15:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:15:53.685179 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458c584-d923-44b1-acd8-c1953bd1c98a None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:53.687132 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-5458c584-d923-44b1-acd8-c1953bd1c98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:53.701275 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5458c584-d923-44b1-acd8-c1953bd1c98a None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:53.706561 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:53.707621 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:53.707884 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:53.708148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] PATH_INFO: `/v3/projects/381905b98b8f404fa010e6627a35ed16` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:53.709453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=381905b98b8f404fa010e6627a35ed16)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:53.711428 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:53.808117 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381905b98b8f404fa010e6627a35ed16', 'request_id': 'req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:53.814191 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381905b98b8f404fa010e6627a35ed16', 'request_id': 'req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:53.819610 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381905b98b8f404fa010e6627a35ed16', 'request_id': 'req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:53.882830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] The token cache is being invalidate because project 381905b98b8f404fa010e6627a35ed16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:15:53.883120 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:53.883792 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:53.885312 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1436/2897] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:15:53 2022] DELETE /identity/v3/projects/381905b98b8f404fa010e6627a35ed16 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:53.890861 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6831e-0753-4432-942b-6babf89e36f6 service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:53.900326 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6831e-0753-4432-942b-6babf89e36f6 service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:53.954690 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1211b85-2363-45e2-a353-e5f955e27c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:53.955568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1211b85-2363-45e2-a353-e5f955e27c7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:53.955848 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1211b85-2363-45e2-a353-e5f955e27c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:53.956120 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1211b85-2363-45e2-a353-e5f955e27c7a admin admin] PATH_INFO: `/v3/users/6c88188f566a426b88d074403bbc7b7e` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:53.957293 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1211b85-2363-45e2-a353-e5f955e27c7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c88188f566a426b88d074403bbc7b7e)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:53.959189 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1211b85-2363-45e2-a353-e5f955e27c7a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:54.176769 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f1211b85-2363-45e2-a353-e5f955e27c7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c88188f566a426b88d074403bbc7b7e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:54.177427 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f1211b85-2363-45e2-a353-e5f955e27c7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c88188f566a426b88d074403bbc7b7e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:54.178031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f1211b85-2363-45e2-a353-e5f955e27c7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c88188f566a426b88d074403bbc7b7e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:54.190006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f1211b85-2363-45e2-a353-e5f955e27c7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c88188f566a426b88d074403bbc7b7e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:54.197024 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-f1211b85-2363-45e2-a353-e5f955e27c7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c88188f566a426b88d074403bbc7b7e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:54.283788 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1462/2898] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:15:53 2022] DELETE /identity/v3/users/6c88188f566a426b88d074403bbc7b7e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:54.662331 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:54.663936 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:54.677053 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9b161-a9b8-4ebd-b4d6-fc0a83245335 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:54.732127 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:54.732902 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:54.733183 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:54.733454 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653 admin admin] PATH_INFO: `/v3/projects/585d63b5c09740f880dbeca73bc70834` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:54.734641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653 admin admin] RBAC: Authorizing `identity:delete_project(project_id=585d63b5c09740f880dbeca73bc70834)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:54.736558 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:54.837262 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585d63b5c09740f880dbeca73bc70834', 'request_id': 'req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:54.843467 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585d63b5c09740f880dbeca73bc70834', 'request_id': 'req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:54.848601 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585d63b5c09740f880dbeca73bc70834', 'request_id': 'req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:54.905745 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653 admin admin] The token cache is being invalidate because project 585d63b5c09740f880dbeca73bc70834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79267) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:15:54.906016 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:54.906641 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-4f6d0433-7bd4-4d1c-9127-df0cf9f34653 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:15:54.908217 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1437/2899] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:15:54 2022] DELETE /identity/v3/projects/585d63b5c09740f880dbeca73bc70834 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:54.913027 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5d350-f89e-483b-b739-a1948a4432e8 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:54.913493 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5d350-f89e-483b-b739-a1948a4432e8 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:54.913592 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df5d350-f89e-483b-b739-a1948a4432e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:54.930905 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-4df5d350-f89e-483b-b739-a1948a4432e8 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:54.932127 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-4df5d350-f89e-483b-b739-a1948a4432e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:54.989827 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1463/2900] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:54.998190 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df2c68-a616-4c4f-8288-bdcddc193f08 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:54.998473 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df2c68-a616-4c4f-8288-bdcddc193f08 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:54.998749 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df2c68-a616-4c4f-8288-bdcddc193f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:55.016712 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-83df2c68-a616-4c4f-8288-bdcddc193f08 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:55.017907 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-83df2c68-a616-4c4f-8288-bdcddc193f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:55.025830 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1438/2901] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:55.030162 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5d350-f89e-483b-b739-a1948a4432e8 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:55.039805 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df5d350-f89e-483b-b739-a1948a4432e8 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:55.045026 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac41481-5558-4471-bc23-09292ccd6d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:55.045665 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac41481-5558-4471-bc23-09292ccd6d4a admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:55.045943 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac41481-5558-4471-bc23-09292ccd6d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:55.046213 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac41481-5558-4471-bc23-09292ccd6d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:55.046939 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac41481-5558-4471-bc23-09292ccd6d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79266) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:15:55.047265 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac41481-5558-4471-bc23-09292ccd6d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:55.048831 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac41481-5558-4471-bc23-09292ccd6d4a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:55.060777 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1464/2902] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:15:55.064970 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df2c68-a616-4c4f-8288-bdcddc193f08 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:55.074189 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df2c68-a616-4c4f-8288-bdcddc193f08 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:55.079040 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8f980-2c31-4a8a-ac99-caebbb59768b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:55.079731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f980-2c31-4a8a-ac99-caebbb59768b admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:55.080014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f980-2c31-4a8a-ac99-caebbb59768b admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:55.080289 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8f980-2c31-4a8a-ac99-caebbb59768b admin admin] PATH_INFO: `/v3/projects` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:55.080997 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8f980-2c31-4a8a-ac99-caebbb59768b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:55.082869 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8f980-2c31-4a8a-ac99-caebbb59768b admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:55.147694 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1439/2903] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:15:55 2022] POST /identity/v3/projects => generated 363 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:15:55.151867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac41481-5558-4471-bc23-09292ccd6d4a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:55.161727 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac41481-5558-4471-bc23-09292ccd6d4a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:55.215389 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4adfab-9ae7-448a-9474-4a0decedbd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:55.216037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4adfab-9ae7-448a-9474-4a0decedbd7a admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:55.216317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4adfab-9ae7-448a-9474-4a0decedbd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:55.216586 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4adfab-9ae7-448a-9474-4a0decedbd7a admin admin] PATH_INFO: `/v3/users` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:55.217284 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4adfab-9ae7-448a-9474-4a0decedbd7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:55.219165 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4adfab-9ae7-448a-9474-4a0decedbd7a admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:55.278880 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1465/2904] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:15:55 2022] POST /identity/v3/users => generated 282 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:15:55.282521 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8f980-2c31-4a8a-ac99-caebbb59768b admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:55.293461 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8f980-2c31-4a8a-ac99-caebbb59768b admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:55.298040 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418806f-2ec4-4b9c-b8e8-6e77bc2f1195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:55.298708 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418806f-2ec4-4b9c-b8e8-6e77bc2f1195 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:55.299014 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418806f-2ec4-4b9c-b8e8-6e77bc2f1195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:55.299320 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418806f-2ec4-4b9c-b8e8-6e77bc2f1195 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:55.300111 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418806f-2ec4-4b9c-b8e8-6e77bc2f1195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:55.301671 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418806f-2ec4-4b9c-b8e8-6e77bc2f1195 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:55.313076 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1440/2905] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:15:55.316947 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4adfab-9ae7-448a-9474-4a0decedbd7a admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:55.327815 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4adfab-9ae7-448a-9474-4a0decedbd7a admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:55.332572 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f232eec-21f6-443d-83ac-09a7fd6e6d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:55.333218 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f232eec-21f6-443d-83ac-09a7fd6e6d58 admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:55.333503 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f232eec-21f6-443d-83ac-09a7fd6e6d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:55.333865 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f232eec-21f6-443d-83ac-09a7fd6e6d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:55.334603 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f232eec-21f6-443d-83ac-09a7fd6e6d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:55.336214 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f232eec-21f6-443d-83ac-09a7fd6e6d58 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:55.346782 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1466/2906] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:15:55.350735 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418806f-2ec4-4b9c-b8e8-6e77bc2f1195 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:55.361839 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418806f-2ec4-4b9c-b8e8-6e77bc2f1195 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:55.366538 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f208d-3d87-44f6-9f6b-9dde28f0ea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:55.367442 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f208d-3d87-44f6-9f6b-9dde28f0ea48 admin admin] REQUEST_METHOD: `PUT` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:55.367728 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f208d-3d87-44f6-9f6b-9dde28f0ea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:55.368004 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f208d-3d87-44f6-9f6b-9dde28f0ea48 admin admin] PATH_INFO: `/v3/projects/2e9e57ca2c0b468098f91529e523eca0/users/f2638df651ca45718e18b21f6c7519bb/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:55.382148 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f208d-3d87-44f6-9f6b-9dde28f0ea48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9e57ca2c0b468098f91529e523eca0, user_id=f2638df651ca45718e18b21f6c7519bb, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:55.384834 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f208d-3d87-44f6-9f6b-9dde28f0ea48 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:55.460797 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1441/2907] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:15:55 2022] PUT /identity/v3/projects/2e9e57ca2c0b468098f91529e523eca0/users/f2638df651ca45718e18b21f6c7519bb/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:15:55.471412 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2ed65-d6e4-4c6a-9eaf-d20d527e07a1 None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:55.471699 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2ed65-d6e4-4c6a-9eaf-d20d527e07a1 None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:55.471975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2ed65-d6e4-4c6a-9eaf-d20d527e07a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:55.498266 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-60f2ed65-d6e4-4c6a-9eaf-d20d527e07a1 None None] MFA Rules not processed for user `f2638df651ca45718e18b21f6c7519bb`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:15:55.499498 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-60f2ed65-d6e4-4c6a-9eaf-d20d527e07a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:55.560630 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1467/2908] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:15:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:15:55.570562 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f208d-3d87-44f6-9f6b-9dde28f0ea48 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:15:55.572440 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-d89f208d-3d87-44f6-9f6b-9dde28f0ea48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:15:55.628118 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f208d-3d87-44f6-9f6b-9dde28f0ea48 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:15:55.631859 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35991c-cdaa-4795-a538-854753d184a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:15:55.632496 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35991c-cdaa-4795-a538-854753d184a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:15:55.632778 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35991c-cdaa-4795-a538-854753d184a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:15:55.633054 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35991c-cdaa-4795-a538-854753d184a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:15:55.641200 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35991c-cdaa-4795-a538-854753d184a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:15:55.642639 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35991c-cdaa-4795-a538-854753d184a7 service cinder] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:15:55.651270 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1442/2909] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:15:55 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:16:15.041206 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2ed65-d6e4-4c6a-9eaf-d20d527e07a1 None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:15.043416 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-60f2ed65-d6e4-4c6a-9eaf-d20d527e07a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:15.132384 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2ed65-d6e4-4c6a-9eaf-d20d527e07a1 None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:15.137108 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642debe5-ec14-4c67-8d9e-e9e58f1b2e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:15.139906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642debe5-ec14-4c67-8d9e-e9e58f1b2e7a service neutron] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:15.139906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642debe5-ec14-4c67-8d9e-e9e58f1b2e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:15.139906 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642debe5-ec14-4c67-8d9e-e9e58f1b2e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:15.140902 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-642debe5-ec14-4c67-8d9e-e9e58f1b2e7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:15.153100 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642debe5-ec14-4c67-8d9e-e9e58f1b2e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:15.154568 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642debe5-ec14-4c67-8d9e-e9e58f1b2e7a service neutron] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:15.164077 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1468/2910] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:16:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:16:28.267409 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35991c-cdaa-4795-a538-854753d184a7 service cinder] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:28.268881 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-fb35991c-cdaa-4795-a538-854753d184a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:28.334563 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35991c-cdaa-4795-a538-854753d184a7 service cinder] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:28.339079 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26309137-aa33-43e8-b5ac-07cca9906499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:28.339919 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26309137-aa33-43e8-b5ac-07cca9906499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:28.340202 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26309137-aa33-43e8-b5ac-07cca9906499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:28.340475 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26309137-aa33-43e8-b5ac-07cca9906499 admin admin] PATH_INFO: `/v3/users/268f9313ebc541e19a4ba6416e6da0ad` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:28.341667 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26309137-aa33-43e8-b5ac-07cca9906499 admin admin] RBAC: Authorizing `identity:delete_user(user_id=268f9313ebc541e19a4ba6416e6da0ad)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:28.343597 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26309137-aa33-43e8-b5ac-07cca9906499 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:28.477974 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-26309137-aa33-43e8-b5ac-07cca9906499 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '268f9313ebc541e19a4ba6416e6da0ad'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:28.478622 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-26309137-aa33-43e8-b5ac-07cca9906499 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '268f9313ebc541e19a4ba6416e6da0ad'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:28.479758 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-26309137-aa33-43e8-b5ac-07cca9906499 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '268f9313ebc541e19a4ba6416e6da0ad'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:28.491030 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-26309137-aa33-43e8-b5ac-07cca9906499 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '268f9313ebc541e19a4ba6416e6da0ad'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:28.498608 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-26309137-aa33-43e8-b5ac-07cca9906499 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '268f9313ebc541e19a4ba6416e6da0ad'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:28.555955 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1443/2911] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:16:28 2022] DELETE /identity/v3/users/268f9313ebc541e19a4ba6416e6da0ad => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:16:28.827767 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642debe5-ec14-4c67-8d9e-e9e58f1b2e7a service neutron] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:28.841037 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642debe5-ec14-4c67-8d9e-e9e58f1b2e7a service neutron] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:28.899408 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:28.900275 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:28.900550 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:28.901344 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] PATH_INFO: `/v3/projects/432673fd8a4248ea9b8f1674c3c38668` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:28.902624 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432673fd8a4248ea9b8f1674c3c38668)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:28.904580 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:29.019178 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432673fd8a4248ea9b8f1674c3c38668', 'request_id': 'req-2b9e0239-84bc-408d-bc19-a3078bc6f376'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.093798 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432673fd8a4248ea9b8f1674c3c38668', 'request_id': 'req-2b9e0239-84bc-408d-bc19-a3078bc6f376'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.099566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432673fd8a4248ea9b8f1674c3c38668', 'request_id': 'req-2b9e0239-84bc-408d-bc19-a3078bc6f376'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.111094 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] The token cache is being invalidate because project 432673fd8a4248ea9b8f1674c3c38668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:16:29.111347 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.111984 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.113504 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1469/2912] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:16:28 2022] DELETE /identity/v3/projects/432673fd8a4248ea9b8f1674c3c38668 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:16:29.117460 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26309137-aa33-43e8-b5ac-07cca9906499 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:29.118876 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-26309137-aa33-43e8-b5ac-07cca9906499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:29.131482 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26309137-aa33-43e8-b5ac-07cca9906499 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:29.184707 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a4cf7-25eb-497f-b4a3-a3a8ce7a2c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:29.185560 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a4cf7-25eb-497f-b4a3-a3a8ce7a2c6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:29.185840 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a4cf7-25eb-497f-b4a3-a3a8ce7a2c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:29.186109 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a4cf7-25eb-497f-b4a3-a3a8ce7a2c6a admin admin] PATH_INFO: `/v3/users/6853eb250ffa426189ca3c1ea9d49dd1` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:29.187314 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a4cf7-25eb-497f-b4a3-a3a8ce7a2c6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6853eb250ffa426189ca3c1ea9d49dd1)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:29.189187 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a4cf7-25eb-497f-b4a3-a3a8ce7a2c6a admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:29.358774 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-dc4a4cf7-25eb-497f-b4a3-a3a8ce7a2c6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6853eb250ffa426189ca3c1ea9d49dd1'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.359446 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-dc4a4cf7-25eb-497f-b4a3-a3a8ce7a2c6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6853eb250ffa426189ca3c1ea9d49dd1'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.360058 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-dc4a4cf7-25eb-497f-b4a3-a3a8ce7a2c6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6853eb250ffa426189ca3c1ea9d49dd1'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.371509 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-dc4a4cf7-25eb-497f-b4a3-a3a8ce7a2c6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6853eb250ffa426189ca3c1ea9d49dd1'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.377961 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-dc4a4cf7-25eb-497f-b4a3-a3a8ce7a2c6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6853eb250ffa426189ca3c1ea9d49dd1'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.437369 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1444/2913] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:16:29 2022] DELETE /identity/v3/users/6853eb250ffa426189ca3c1ea9d49dd1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:16:29.678400 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:29.679863 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:29.693771 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e0239-84bc-408d-bc19-a3078bc6f376 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:29.750914 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9026c68-dee4-482e-a896-afa17f69636b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:29.751888 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026c68-dee4-482e-a896-afa17f69636b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:29.752170 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026c68-dee4-482e-a896-afa17f69636b admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:29.752447 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026c68-dee4-482e-a896-afa17f69636b admin admin] PATH_INFO: `/v3/projects/e71f3ecc02294cbab44ca20c91b27454` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:29.753635 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9026c68-dee4-482e-a896-afa17f69636b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71f3ecc02294cbab44ca20c91b27454)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:29.755579 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9026c68-dee4-482e-a896-afa17f69636b admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:29.894269 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-a9026c68-dee4-482e-a896-afa17f69636b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71f3ecc02294cbab44ca20c91b27454', 'request_id': 'req-a9026c68-dee4-482e-a896-afa17f69636b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.974258 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-a9026c68-dee4-482e-a896-afa17f69636b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71f3ecc02294cbab44ca20c91b27454', 'request_id': 'req-a9026c68-dee4-482e-a896-afa17f69636b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.980992 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-a9026c68-dee4-482e-a896-afa17f69636b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71f3ecc02294cbab44ca20c91b27454', 'request_id': 'req-a9026c68-dee4-482e-a896-afa17f69636b'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.991993 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-a9026c68-dee4-482e-a896-afa17f69636b admin admin] The token cache is being invalidate because project e71f3ecc02294cbab44ca20c91b27454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:16:29.992281 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-a9026c68-dee4-482e-a896-afa17f69636b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.992913 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-a9026c68-dee4-482e-a896-afa17f69636b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:29.994418 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1470/2914] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:16:29 2022] DELETE /identity/v3/projects/e71f3ecc02294cbab44ca20c91b27454 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:16:35.489530 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a4cf7-25eb-497f-b4a3-a3a8ce7a2c6a admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:35.490935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-dc4a4cf7-25eb-497f-b4a3-a3a8ce7a2c6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:35.503495 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a4cf7-25eb-497f-b4a3-a3a8ce7a2c6a admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:35.558394 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dda1bc-ece3-4235-ae10-9ca8141f3847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:35.559293 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda1bc-ece3-4235-ae10-9ca8141f3847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:35.559585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda1bc-ece3-4235-ae10-9ca8141f3847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:35.559918 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dda1bc-ece3-4235-ae10-9ca8141f3847 admin admin] PATH_INFO: `/v3/users/f2638df651ca45718e18b21f6c7519bb` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:35.561097 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dda1bc-ece3-4235-ae10-9ca8141f3847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2638df651ca45718e18b21f6c7519bb)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:35.563020 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dda1bc-ece3-4235-ae10-9ca8141f3847 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:35.769636 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-80dda1bc-ece3-4235-ae10-9ca8141f3847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2638df651ca45718e18b21f6c7519bb'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:35.770283 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-80dda1bc-ece3-4235-ae10-9ca8141f3847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2638df651ca45718e18b21f6c7519bb'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:35.770882 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-80dda1bc-ece3-4235-ae10-9ca8141f3847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2638df651ca45718e18b21f6c7519bb'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:35.782619 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-80dda1bc-ece3-4235-ae10-9ca8141f3847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2638df651ca45718e18b21f6c7519bb'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:35.789146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-80dda1bc-ece3-4235-ae10-9ca8141f3847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2638df651ca45718e18b21f6c7519bb'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:35.853307 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1445/2915] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:16:35 2022] DELETE /identity/v3/users/f2638df651ca45718e18b21f6c7519bb => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:16:35.858228 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d113d0-f6d9-4db1-8e81-8be77261bc9d None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:35.859473 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d113d0-f6d9-4db1-8e81-8be77261bc9d None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:35.859473 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d113d0-f6d9-4db1-8e81-8be77261bc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:35.878242 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-b8d113d0-f6d9-4db1-8e81-8be77261bc9d None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:16:35.879722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b8d113d0-f6d9-4db1-8e81-8be77261bc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:35.942317 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1471/2916] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:16:35.952854 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dda1bc-ece3-4235-ae10-9ca8141f3847 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:35.954249 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-80dda1bc-ece3-4235-ae10-9ca8141f3847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:36.008358 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dda1bc-ece3-4235-ae10-9ca8141f3847 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:36.012584 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8188c77-3ad5-43b3-ba05-a2a75b68b266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:36.013214 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8188c77-3ad5-43b3-ba05-a2a75b68b266 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:36.013493 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8188c77-3ad5-43b3-ba05-a2a75b68b266 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:36.013763 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8188c77-3ad5-43b3-ba05-a2a75b68b266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:36.022994 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8188c77-3ad5-43b3-ba05-a2a75b68b266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:36.024453 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8188c77-3ad5-43b3-ba05-a2a75b68b266 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:36.034572 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1446/2917] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:16:36.415006 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d113d0-f6d9-4db1-8e81-8be77261bc9d None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:36.416478 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b8d113d0-f6d9-4db1-8e81-8be77261bc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:36.430061 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d113d0-f6d9-4db1-8e81-8be77261bc9d None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:36.435249 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:36.436097 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:36.436927 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:36.437220 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e admin admin] PATH_INFO: `/v3/projects/2e9e57ca2c0b468098f91529e523eca0` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:36.439012 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9e57ca2c0b468098f91529e523eca0)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:36.440414 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:36.530031 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9e57ca2c0b468098f91529e523eca0', 'request_id': 'req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:36.579164 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9e57ca2c0b468098f91529e523eca0', 'request_id': 'req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:36.584773 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9e57ca2c0b468098f91529e523eca0', 'request_id': 'req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:36.595634 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e admin admin] The token cache is being invalidate because project 2e9e57ca2c0b468098f91529e523eca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:16:36.595922 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:36.596596 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-ce813f3f-7f7b-49e1-a04f-9d91cf09d04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:36.598166 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1472/2918] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:16:36 2022] DELETE /identity/v3/projects/2e9e57ca2c0b468098f91529e523eca0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:16:36.603035 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb29d6-312e-4504-a089-eb2c52a951e6 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:36.603539 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb29d6-312e-4504-a089-eb2c52a951e6 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:36.603681 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb29d6-312e-4504-a089-eb2c52a951e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:36.622468 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-87fb29d6-312e-4504-a089-eb2c52a951e6 None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:16:36.623734 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-87fb29d6-312e-4504-a089-eb2c52a951e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:36.679799 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1447/2919] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:16:36.688998 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d5dba-5c61-4dad-b113-d57e7c9976ba None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:36.698787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d5dba-5c61-4dad-b113-d57e7c9976ba None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:36.698787 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d5dba-5c61-4dad-b113-d57e7c9976ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:36.708146 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-b35d5dba-5c61-4dad-b113-d57e7c9976ba None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:16:36.709324 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-b35d5dba-5c61-4dad-b113-d57e7c9976ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:36.717128 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1473/2920] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:16:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Feb 12 05:16:36.721346 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb29d6-312e-4504-a089-eb2c52a951e6 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:36.731982 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb29d6-312e-4504-a089-eb2c52a951e6 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:36.736619 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d2476-5dae-40f6-8694-7d925f6d770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:36.741347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d2476-5dae-40f6-8694-7d925f6d770d admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:36.741347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d2476-5dae-40f6-8694-7d925f6d770d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:36.741347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d2476-5dae-40f6-8694-7d925f6d770d admin admin] PATH_INFO: `/v3/domains` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:36.741347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d2476-5dae-40f6-8694-7d925f6d770d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79267) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Feb 12 05:16:36.741347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d2476-5dae-40f6-8694-7d925f6d770d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:36.741347 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d2476-5dae-40f6-8694-7d925f6d770d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:36.752537 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1448/2921] 10.222.0.35 () {58 vars in 1152 bytes} [Sat Feb 12 05:16:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Feb 12 05:16:36.756807 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d5dba-5c61-4dad-b113-d57e7c9976ba None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:36.765997 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d5dba-5c61-4dad-b113-d57e7c9976ba None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:36.770722 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2602d-4dae-484a-ab06-ca1d3d73dbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:36.771402 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2602d-4dae-484a-ab06-ca1d3d73dbc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:36.771683 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2602d-4dae-484a-ab06-ca1d3d73dbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:36.771958 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2602d-4dae-484a-ab06-ca1d3d73dbc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:36.772689 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2602d-4dae-484a-ab06-ca1d3d73dbc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:36.774581 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2602d-4dae-484a-ab06-ca1d3d73dbc5 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:36.860684 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1474/2922] 10.222.0.35 () {60 vars in 1152 bytes} [Sat Feb 12 05:16:36 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Feb 12 05:16:36.865068 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d2476-5dae-40f6-8694-7d925f6d770d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:36.874978 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d2476-5dae-40f6-8694-7d925f6d770d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:36.930002 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b52ee-4b51-40b9-9c4f-0163fe3b8a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:36.930579 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b52ee-4b51-40b9-9c4f-0163fe3b8a14 admin admin] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:36.930860 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b52ee-4b51-40b9-9c4f-0163fe3b8a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:36.931131 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94b52ee-4b51-40b9-9c4f-0163fe3b8a14 admin admin] PATH_INFO: `/v3/users` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:36.931866 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b52ee-4b51-40b9-9c4f-0163fe3b8a14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:36.934284 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94b52ee-4b51-40b9-9c4f-0163fe3b8a14 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:37.019935 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1449/2923] 10.222.0.35 () {60 vars in 1143 bytes} [Sat Feb 12 05:16:36 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Feb 12 05:16:37.024342 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2602d-4dae-484a-ab06-ca1d3d73dbc5 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:37.034975 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2602d-4dae-484a-ab06-ca1d3d73dbc5 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:37.039646 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7261b-d1b0-43af-a8ee-641b59e5f6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:37.040286 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7261b-d1b0-43af-a8ee-641b59e5f6fc admin admin] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:37.040566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7261b-d1b0-43af-a8ee-641b59e5f6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:37.040841 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7261b-d1b0-43af-a8ee-641b59e5f6fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:37.041625 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7261b-d1b0-43af-a8ee-641b59e5f6fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:37.043199 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7261b-d1b0-43af-a8ee-641b59e5f6fc admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:37.053281 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1475/2924] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:16:37.057298 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b52ee-4b51-40b9-9c4f-0163fe3b8a14 admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:37.067718 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94b52ee-4b51-40b9-9c4f-0163fe3b8a14 admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:37.073018 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dc388-b075-4f6f-b334-87433a3b2a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:37.075814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc388-b075-4f6f-b334-87433a3b2a76 admin admin] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:37.075814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc388-b075-4f6f-b334-87433a3b2a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:37.075814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dc388-b075-4f6f-b334-87433a3b2a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:37.075814 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dc388-b075-4f6f-b334-87433a3b2a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:37.077277 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dc388-b075-4f6f-b334-87433a3b2a76 admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:37.087315 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1450/2925] 10.222.0.35 () {58 vars in 1121 bytes} [Sat Feb 12 05:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Feb 12 05:16:37.091566 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7261b-d1b0-43af-a8ee-641b59e5f6fc admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:37.101315 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7261b-d1b0-43af-a8ee-641b59e5f6fc admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:37.105867 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470101a-d13c-4818-9d4f-f3bdebde6e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:37.106719 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470101a-d13c-4818-9d4f-f3bdebde6e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:37.107000 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470101a-d13c-4818-9d4f-f3bdebde6e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:37.107302 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470101a-d13c-4818-9d4f-f3bdebde6e63 admin admin] PATH_INFO: `/v3/projects/e7746d226514475a8cf350c31a233eff/users/c0727f362a0f430babea36753636523c/roles/ca6edcc85e3841d9bebb1b58cecb96d3` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:37.121923 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470101a-d13c-4818-9d4f-f3bdebde6e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7746d226514475a8cf350c31a233eff, user_id=c0727f362a0f430babea36753636523c, role_id=ca6edcc85e3841d9bebb1b58cecb96d3)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:37.124614 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470101a-d13c-4818-9d4f-f3bdebde6e63 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:37.167531 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1476/2926] 10.222.0.35 () {60 vars in 1482 bytes} [Sat Feb 12 05:16:37 2022] PUT /identity/v3/projects/e7746d226514475a8cf350c31a233eff/users/c0727f362a0f430babea36753636523c/roles/ca6edcc85e3841d9bebb1b58cecb96d3 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:16:37.177682 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d4eef-cc35-48a9-9384-d58884089d72 None None] REQUEST_METHOD: `POST` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:37.177968 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d4eef-cc35-48a9-9384-d58884089d72 None None] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:37.181917 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d4eef-cc35-48a9-9384-d58884089d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:37.205458 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.auth.core [None req-bc3d4eef-cc35-48a9-9384-d58884089d72 None None] MFA Rules not processed for user `c0727f362a0f430babea36753636523c`. Rule list: `[]` (Enabled: `True`). {{(pid=79267) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:16:37.206676 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-bc3d4eef-cc35-48a9-9384-d58884089d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:37.268138 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1451/2927] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:16:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:16:37.278046 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470101a-d13c-4818-9d4f-f3bdebde6e63 admin admin] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:37.279725 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-3470101a-d13c-4818-9d4f-f3bdebde6e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:37.333745 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470101a-d13c-4818-9d4f-f3bdebde6e63 admin admin] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:37.337322 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff923c-d539-4262-a9a6-a220eeaffbda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df25b09762ab4130a1c656cd499d5fb2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:37.337943 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff923c-d539-4262-a9a6-a220eeaffbda service cinder] REQUEST_METHOD: `GET` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:37.338222 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff923c-d539-4262-a9a6-a220eeaffbda service cinder] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:37.338492 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff923c-d539-4262-a9a6-a220eeaffbda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:37.346555 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff923c-d539-4262-a9a6-a220eeaffbda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:37.347985 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff923c-d539-4262-a9a6-a220eeaffbda service cinder] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:37.357032 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1477/2928] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:16:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Feb 12 05:16:37.381720 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d4eef-cc35-48a9-9384-d58884089d72 None None] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:37.441455 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d4eef-cc35-48a9-9384-d58884089d72 None None] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:37.446019 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df5736-4b35-47f4-b7ac-fb3576214b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:37.446867 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df5736-4b35-47f4-b7ac-fb3576214b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:37.447146 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df5736-4b35-47f4-b7ac-fb3576214b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:37.447704 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df5736-4b35-47f4-b7ac-fb3576214b6d admin admin] PATH_INFO: `/v3/users/c0727f362a0f430babea36753636523c` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:37.448920 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df5736-4b35-47f4-b7ac-fb3576214b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0727f362a0f430babea36753636523c)` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:37.450813 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df5736-4b35-47f4-b7ac-fb3576214b6d admin admin] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:37.620575 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-74df5736-4b35-47f4-b7ac-fb3576214b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0727f362a0f430babea36753636523c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:37.621964 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-74df5736-4b35-47f4-b7ac-fb3576214b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0727f362a0f430babea36753636523c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:37.622585 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-74df5736-4b35-47f4-b7ac-fb3576214b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0727f362a0f430babea36753636523c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:37.633839 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-74df5736-4b35-47f4-b7ac-fb3576214b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0727f362a0f430babea36753636523c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:37.640728 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.notifications [None req-74df5736-4b35-47f4-b7ac-fb3576214b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0727f362a0f430babea36753636523c'} {{(pid=79267) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:37.693071 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1452/2929] 10.222.0.35 () {58 vars in 1223 bytes} [Sat Feb 12 05:16:37 2022] DELETE /identity/v3/users/c0727f362a0f430babea36753636523c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:16:37.698052 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e6e40-8779-4c8d-9462-675251a5ab6c None None] REQUEST_METHOD: `POST` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:37.698345 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e6e40-8779-4c8d-9462-675251a5ab6c None None] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:37.698619 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e6e40-8779-4c8d-9462-675251a5ab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:37.716289 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.auth.core [None req-e82e6e40-8779-4c8d-9462-675251a5ab6c None None] MFA Rules not processed for user `0d198e449ccb450a97886efab230ca66`. Rule list: `[]` (Enabled: `True`). {{(pid=79266) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Feb 12 05:16:37.717465 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e82e6e40-8779-4c8d-9462-675251a5ab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:37.772017 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1478/2930] 10.222.0.35 () {58 vars in 957 bytes} [Sat Feb 12 05:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Feb 12 05:16:37.782218 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df5736-4b35-47f4-b7ac-fb3576214b6d admin admin] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:37.783670 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-74df5736-4b35-47f4-b7ac-fb3576214b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:37.839629 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df5736-4b35-47f4-b7ac-fb3576214b6d admin admin] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:37.843602 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730e0d8-6a1d-4343-8172-8f2dc5436596 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9c5541a29cf42f6ab394133baa05fae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:37.844236 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730e0d8-6a1d-4343-8172-8f2dc5436596 service neutron] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:37.844518 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730e0d8-6a1d-4343-8172-8f2dc5436596 service neutron] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:37.844799 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730e0d8-6a1d-4343-8172-8f2dc5436596 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:37.853809 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730e0d8-6a1d-4343-8172-8f2dc5436596 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:37.855365 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e730e0d8-6a1d-4343-8172-8f2dc5436596 service neutron] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:37.864731 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1453/2931] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Feb 12 05:16:38.224441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e6e40-8779-4c8d-9462-675251a5ab6c None None] Authenticating user token {{(pid=79266) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:16:38.224441 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.fernet_utils [None req-e82e6e40-8779-4c8d-9462-675251a5ab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79266) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:16:38.238875 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e6e40-8779-4c8d-9462-675251a5ab6c None None] Validating token access rules against request {{(pid=79266) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:16:38.250601 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae9b6b-6664-425e-903a-c02a4d195999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d198e449ccb450a97886efab230ca66', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b029942a00eb466b8575ae912b6910ac', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79266) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:16:38.251494 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae9b6b-6664-425e-903a-c02a4d195999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:16:38.251775 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae9b6b-6664-425e-903a-c02a4d195999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:16:38.252048 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae9b6b-6664-425e-903a-c02a4d195999 admin admin] PATH_INFO: `/v3/projects/e7746d226514475a8cf350c31a233eff` {{(pid=79266) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:16:38.253240 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae9b6b-6664-425e-903a-c02a4d195999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7746d226514475a8cf350c31a233eff)` {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:16:38.255132 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae9b6b-6664-425e-903a-c02a4d195999 admin admin] RBAC: Authorization granted {{(pid=79266) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:16:38.356367 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-edae9b6b-6664-425e-903a-c02a4d195999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7746d226514475a8cf350c31a233eff', 'request_id': 'req-edae9b6b-6664-425e-903a-c02a4d195999'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:38.436193 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-edae9b6b-6664-425e-903a-c02a4d195999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7746d226514475a8cf350c31a233eff', 'request_id': 'req-edae9b6b-6664-425e-903a-c02a4d195999'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:38.441644 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-edae9b6b-6664-425e-903a-c02a4d195999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7746d226514475a8cf350c31a233eff', 'request_id': 'req-edae9b6b-6664-425e-903a-c02a4d195999'} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:38.453269 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-edae9b6b-6664-425e-903a-c02a4d195999 admin admin] The token cache is being invalidate because project e7746d226514475a8cf350c31a233eff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79266) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Feb 12 05:16:38.453554 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-edae9b6b-6664-425e-903a-c02a4d195999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:38.454180 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: DEBUG keystone.notifications [None req-edae9b6b-6664-425e-903a-c02a4d195999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79266) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Feb 12 05:16:38.455723 dv-cinder-828060-4-iscsi devstack@keystone.service[79266]: [pid: 79266|app: 0|req: 1479/2932] 10.222.0.35 () {58 vars in 1232 bytes} [Sat Feb 12 05:16:38 2022] DELETE /identity/v3/projects/e7746d226514475a8cf350c31a233eff => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Feb 12 05:17:15.445956 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730e0d8-6a1d-4343-8172-8f2dc5436596 service neutron] Authenticating user token {{(pid=79267) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Feb 12 05:17:15.465729 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-e730e0d8-6a1d-4343-8172-8f2dc5436596 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:17:15.541370 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730e0d8-6a1d-4343-8172-8f2dc5436596 service neutron] Validating token access rules against request {{(pid=79267) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Feb 12 05:17:15.600220 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe547f-8ac0-44a3-a2b3-c38194f840c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd48fd9b23a4946cc81a9ad7845d26623', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '688e546ab571490aa0b23c0b22a35c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79267) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Feb 12 05:17:15.600862 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe547f-8ac0-44a3-a2b3-c38194f840c8 service placement] REQUEST_METHOD: `GET` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Feb 12 05:17:15.601147 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe547f-8ac0-44a3-a2b3-c38194f840c8 service placement] SCRIPT_NAME: `/identity` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Feb 12 05:17:15.601426 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe547f-8ac0-44a3-a2b3-c38194f840c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79267) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Feb 12 05:17:15.603247 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.fernet_utils [None req-c9fe547f-8ac0-44a3-a2b3-c38194f840c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79267) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Feb 12 05:17:15.614678 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe547f-8ac0-44a3-a2b3-c38194f840c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Feb 12 05:17:15.616279 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe547f-8ac0-44a3-a2b3-c38194f840c8 service placement] RBAC: Authorization granted {{(pid=79267) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Feb 12 05:17:15.625965 dv-cinder-828060-4-iscsi devstack@keystone.service[79267]: [pid: 79267|app: 0|req: 1454/2933] 10.222.0.35 () {60 vars in 1365 bytes} [Sat Feb 12 05:17:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)